article thumbnail

Best Practices to Establish a Single Source of Truth (SSOT) for A/B Testing

ConversionXL

And you can’t trust the outcomes of your tests if you don’t know you’re looking at accurate metrics. That’s why you need to build your testing program around a Single Source of Truth (SSOT) dataset. If you can’t, even the simplest A/B test will lack value. What is A/B testing. Why would you want to do this?

article thumbnail

How to Minimize A/B Test Validity Threats

ConversionXL

You have an A/B testing tool, a well-researched hypothesis and a winning test with 95% confidence. There are factors threatening the validity of your test, without you even realizing it. Quite simply, validity threats are the factors that threaten the validity of your A/B test results. Not so fast.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Carly’s App of the Week: Dynamic Yield

Heinz Marketing

With Dynamic Yield, marketers, product managers, developers, and digital teams can algorithmically match content, products, and offers to each individual customer to help accelerate revenue and grow customer loyalty.

article thumbnail

Why Your A/B Tests Are Failing

ConversionXL

In a 2013 study by eConsultancy & RedEye , surveying almost 1,000 client-side & agency marketers, it was found that 60% found A/B testing to be “quite valuable” to their business. What’s interesting is that another study by VWO found that only 1 in every 7 A/B tests is a statistically significant winning test.

article thumbnail

Sample Pollution: The A/B Testing Problem You Don’t Know You Have

ConversionXL

Returning visitors to an e-commerce site stay for an average of 3 minutes longer than new visitors. For example, let’s say you run a simple A/B test from Tuesday to Thursday. To identify whether or not your tests are polluted, run through the four most common types of sample pollution. Returning vs. New Traffic.

article thumbnail

5 Uncomfortable A/B Testing Questions

ConversionXL

Better to find C which beats both A and B! A while ago I was working on a major CRO project for a large e-commerce client. If you run solid A/B tests that yield real lifts ( not imaginary ones ), you should be able to track these lifts down the road.

article thumbnail

How to Build a Strong A/B Testing Plan That Gets Results

ConversionXL

A strong A/B testing plan will allow you to increase your revenue. A/B testing produces concrete evidence of what actually works in your marketing. This post is about A/B testing, since this technique produces the fastest gains and has lower chances of error through misuse.