Guide to A/B Testing Legacy Popups

Who gets this? Shops on Postscript Professional and above have access to this feature. Learn more about Postscript Plans.

A/B testing is a marketing experiment wherein shops can split their audience to test variations of popup creatives, incentives, or messages to determine which popup experience performs best. By A/B testing your popups, you can:

  • Optimize your popup conversions by finding the best combination of popup creatives, timing, images, message copy, and incentives for your brand all through A/B testing.
  • Get a better understanding of which popup experience captures the attention of your site visitors so you can effectively create content that resonates and ultimately increases engagement.
  • Validate which characteristics of the winning popup increase subscriber list growth, then implement those characteristics to effectively grow your subscriber list.

In this article, we'll discuss how to conduct an A/B test and recommend different ways you can test both your mobile and desktop popups. Before we begin, note that you will need to create and activate at least two variant popups before testing and the distributions for all variants must total 100%.

Create an A/B Test Popup


A:BTestDesktopPopups.gif

  1. Select Acquisition in the side menu of your Postscript dashboard.
  2. Select Create in the upper right corner, then select A/B Test.
  3. Choose either mobile or desktop to test your popups on. Then select Create Test.
  4. Name the A/B test. Choose a name that will allow you to easily identify and track this test in the future.
  5. Under Choose Popups, select the variants you'd like to test (note: you'll need to choose at least two variants that are already activated).
  6. If you'd like to select more than two popups, select the + Add Variant button below Variant 2.
  7. Set the distributions for each variant by entering a percentage into the Distribution field next to each select variant. Remember, the distribution of all variants must equal 100%.
  8. Optional: Under Pages, indicate specific pages of your site that you'd like the popups to be included or excluded on (note: All tests must be run on the same pages. Updating these included and excluded pages on this step will update the original popups as well).
  9. Under Ending the test, select Run until the test is stopped manually. You can end this test at any time.
  10. Once you've selected the popups you'd like to test and added the website pages you'd like to include and exclude the popups on, you can start your test by selecting Start Test in the upper right corner.

Perfect your popup


Have you ever wondered, “What’s the perfect popup formula to maximize conversions?” The answer may vary depending on your specific brand and audience—which is why we always recommend A/B testing different versions of your popup. Here are some ways to do that:

For Desktop Popups

Timing Triggers Display Copy and Design

Finding the perfect delay for your popup to appear is critical to its success! Delaying your popup between 5 and 10 seconds gives your visitors an opportunity to browse before they see the form.

Consider A/B testing two popups—one with a 5-second delay and one with a 10-second delay. See which resonates best with your customer base, and adjust your timing from there!

For Mobile Popups

Timing Triggers Display Copy and Design

Finding the perfect delay for your popup to appear is critical to its success! Delaying your popup between 5 and 10 seconds gives your visitors an opportunity to browse before they see the form.

Consider A/B testing two popups—one with a 5-second delay and one with a 10-second delay. See which resonates best with your customer base, and adjust your timing from there!

Before You Go


We’ll leave you with a few tips to help with building your popups:

  • Leverage Onsite Opt-in to optimize conversion rates, keep subscribers onsite when they opt-in, and maintain a clear understanding of attribution.
  • Always display an exit bubble. If the visitor exits out of your popup—then wishes to complete an order—an exit bubble allows visitors to share their information in exchange for an incentive at the time they decide to make a purchase.
  • Use the least amount of copy as possible. Visitors should be able to understand your offer at a glance.

Additional Resources


  • Interested in customizing your popup with CSS? Check out our CSS Glossary to better understand and locate the various HTML and CSS elements present in our popups.
  • Just getting started with designing your desktop popup? Check out this tutorial for how to customize your popup font, text size, text color, and more.
  • Want to do a deep dive of our desktop popup functionality? We've got you covered with this guide.

Get Support


Have questions? Please feel free to reach out to our wonderful Support team at support@postscript.io or via live chat. You can also submit a support request here!

Need ongoing channel strategy guidance? Please fill out this form and we'll connect you to one of our certified partners.

Was this article helpful?
0 out of 0 found this helpful