Create an A/B Test for Popups

Note: A/B testing for popups is currently in beta for Postscript stores on the Professional or Enterprise plans

A/B testing is a marketing experiment wherein shops can split their audience to test variations of popup creatives, incentives, or messages to determine which popup experience performs best.

Why You Should A/B Test Your Popups


  • Optimize your popup conversions by finding the best combination of popup creatives, timing, images, message copy, and incentives for your brand all through A/B testing.
  • Get a better understanding of which popup experience captures the attention of your site visitors so you can effectively create content that resonates and ultimately increases engagement.
  • Validate which characteristics of the winning popup increase subscriber list growth, then implement those characteristics to effectively grow your subscriber list.

What You Need to Know


  • You will need to create the variant popups you'd like to test before following the instructions in this tutorial.
    • For information on how to create a mobile popup, see here.
    • For information on how to create a desktop popup, see here.
  • When creating your variant popups, consider giving each popup a name that will allow you to easily identify each variant when you set up the A/B test.
  • You must have at least two popup variants for testing and the distributions for all variants must total 100%.

Create an A/B Test Popup


ABTestPopups.gif

  1. Select Acquisition in the side menu of your Postscript dashboard, then select Popups.
  2. Select Create in the upper right corner, then select Split Test.
  3. Choose which platform, mobile or desktop, you would like to test your popups on. Then select Create Test.
  4. Name the A/B test. Choose a name that will allow you to easily identify and track this test in the future.
  5. Under Choose Popups, select the variants you'd like to test. Remember, you must choose at least two variants.
  6. If you'd like to select more than two popups, select the + Add Variant button below Variant 2.
  7. Set the distributions for each variant by entering a percentage into the Distribution field next to each select variant. Remember, the distribution of all variants must equal 100%.
  8. Under Pages, select the dropdown under Include pages and Exclude pages to include or exclude pages of your site that you'd like the popups to display on. Note: Updating these included and excluded pages on this step will update the original popups as well. on.
  9. Under Ending the test, select Run until the test is stopped manually. You can end this test at any time.
  10. Once you've selected the popups you'd like to test and added the website pages you'd like to include and exclude the popups on, you can start your test by selecting Start Test in the upper right corner.

Perfect your popup


Have you ever wondered, “What’s the perfect popup formula to maximize conversions?” The answer may vary depending on your specific brand and audience—which is why we always recommend A/B testing different versions of your popup. Here are some ways to do that:

For Desktop Popups

Timing Triggers Display Copy and Design

Desktop_Timing.gif

Finding the perfect delay for your popup to appear is critical to its success! Delaying your popup between 5 and 10 seconds gives your visitors an opportunity to browse before they see the form.

Consider A/B testing two popups—one with a 5-second delay and one with a 10-second delay. See which resonates best with your customer base, and adjust your timing from there!

For Mobile Popups

Timing Display Copy and Design

Mobile_Timing.gif

Finding the perfect delay for your popup to appear is critical to its success! Delaying your popup between 5 and 10 seconds gives your visitors an opportunity to browse before they see the form.

Consider A/B testing two popups—one with a 5-second delay and one with a 10-second delay. See which resonates best with your customer base, and adjust your timing from there!


We’ll leave you with a few tips to help with building your popups:

  • Leverage two-touch opt-in for mobile popups.
  • Always, always, always display an exit bubble. If the visitor exits out of your popup—then wishes to complete an order—an exit bubble allows visitors to share their information in exchange for an incentive at the time they decide to make a purchase.
  • Use the least amount of copy as possible. Visitors should be able to understand your offer at a glance!

FAQs


  • How can I determine a winning popup? In order for you to determine a winner for your A/B testing, check the analytics for each popup on the Popups page under Split Tests.
  • Can I run my tests on separate site pages? No, tests must be run on the same page(s) of your site.
  • Where can I get ideas for popups to test? Check out some designs in our popup galleries for mobile and desktop popups to get inspo for your A/B testing.

Get Support


Have questions? Please feel free to reach out to our wonderful Support team at support@postscript.io or via live chat. You can also submit a support request here!

Need ongoing channel strategy guidance? Please fill out this form and we'll connect you to one of our certified partners.

Are you BFCM ready? Gear up for the 2022 holiday season with our Ultimate BFCM Planner for SMS Marketers! Get your copy here

Was this article helpful?
0 out of 0 found this helpful