Skip to main content

Notifications

Customer experience | Sales, Customer Insights,...
Suggested answer

A/B testing inconsistencies

(0) ShareShare
ReportReport
Posted on by 176

Hi

I'm having trouble formatting my emails for use in the AB tester. 

I create my email in version A, i leave a few standard features like a masthead, social icons, footer in the dark blue (exclude from A/B testing).

I then select the images and content blocks i want to be featured in version A. 

Then when i open version B the contents is identical to Version A at first, so i change images etc. But at the stage am i supposed to delete the content blocks from version A which appear in version B? Because when i do this they are deleted from both versions. Should i clone the block then delete? But when i do that it removes both of the content blocks when i delete the version A block from my version B.

This really is a mess. Docs does not adequately explain how this feature works, as usual,  it shouldn't be this hard. Either i create version A and then version B is a blank canvas (except for the dark blue sections) or any content i delete while editing version B deletes it from version B only. The inconsistent behaviour is so frustrating!!!!

  • Suggested answer
    Nya Profile Picture
    Nya 29,058 on at
    RE: A/B testing inconsistencies

    Hi,

    You can set it by Section level.

    pastedimage1642397865645v1.png

    pastedimage1642397885469v2.png

  • Eddie Telfast Profile Picture
    Eddie Telfast 176 on at
    RE: A/B testing inconsistencies

    Yes with images it's easier, but how do you do this with content blocks that contain text? If i change the text then it appears on both version some of the time

  • Suggested answer
    Nya Profile Picture
    Nya 29,058 on at
    RE: A/B testing inconsistencies

    Hi,

    Please refer to the following steps.

    1. For example, only one image is different in the version A and B. Choose the image for version A.

    pastedimage1642149721444v1.png

    2. Click the A/B button in the red circle to enable the version A. The color will turn into light blue.

    pastedimage1642149826539v3.png

    3. Then switch to version B.

    pastedimage1642149872958v4.png

    4. Choose another image.

    pastedimage1642149906854v5.png

    This sets up the content of both versions without deleting or copying the content of version A.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Announcing Forum Attachment Improvements!

We're excited to announce that attachments for replies in forums and improved…

Vahid Ghafarpour – Community Spotlight

We are excited to recognize Vahid Ghafarpour as our February 2025 Community…

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,965 Super User 2025 Season 1

#2
Martin Dráb Profile Picture

Martin Dráb 230,817 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans