Configure an A/B test in AB Tasty

Step-by-step Playbooks
, , , , ,
1

Business Benefits

Test new website elements to improve user experiences and boost conversions.

Select Test from the top navigation bar, click Create in the top-right corner. Select the appropriate type of test for your campaign.

1600×444 192 KB

Name your campaign and set a hypothesis for your experiment based on the following model: If I apply [this change on my webpage] for [this audience], then it will impact [this behavior] and influence [this goal].

Here are some examples of how to influence goals and KPIs through experience optimization:

1034×480 34.7 KB

  1. Copy the URL of a page you wish to test and paste it into the “Sample URL to load in the editor” field.
  2. Select the type of editor you wish to use: a visual WYSIWYG editor or a code editor.

  1. Click “Save & go to next step” in the bottom right corner.

Set your targeting in the “Who”, “Where” and “Trigger” sections.

  1. WHO section: this is the most important one, where you have to choose the right segment as a function of the message you have created in the editor.
  2. WHERE section: choose the unique URL (or a saved Page) or the type of pages having the same construction (such as Product pages) on which your message will be visible). The URL used in the editor step remains a sample of the URL(s) you configure in this step.
  3. TRIGGER section: this step is optional. You can add specific session-based triggers, such as a required number of viewed pages before displaying a message, the landing page of the session, and so on.
  4. Click “Save & go to next step” at the bottom of the page.

Add JS and/or CSS code, use the visual/WYSIWYG editor, or add a widget from the library to create your modification in the unique editor view.

Set your goals. Here, you can select the goals on which you’d like to report. For example, you can select transactions, bounce rate, number of clicks, etc.

  1. When you test a change on a clickable element (e.g., CTA button), always turn on action tracking to see how people respond to the new version.

Choose the action tracking related to the element you have modified to determine if the change you’ve made converts better than other versions of the same element. User behavior is likely to be affected by such changes.

Set your targeting by selecting the audience segment for which you’d like to display the test.

  1. Carefully enter the targeted URLs in the “Where” section of your test to ensure that it will display correctly on the pages you want to target (e.g., product pages).
  2. We recommend copying and pasting the URL to ensure the integrity of the full string.
  3. Use the Device criterion in the triggers section if you want to limit the test to visitors using a specific device.
  4. [Optional] Select your triggers to configure the actions or behaviors that will trigger your test to display.

Set your traffic allocation. Use identical traffic allocation amounts for each variation. For example, avoid the following distribution: original 20%, variation 1: 50%, variation 2: 30%.

Use the QA Assistant to make sure that the modifications appear correctly on all targeted devices and that your action tracking is set correctly.

Before you launch your test to your targeted audience, disable the QA mode, make sure the targeting of your test has been saved, and traffic allocation is evenly divided between the variations.

Run the test for at least 15 days. Then analyze the test results and apply changes directly to your website.

Check which version has performed best according to the goal you wanted to reach.

Last edited by @hesh_fekry 2023-11-14T10:45:47Z