If ClickMagick never declares a winner because none of your variations rises above a confidence of 95%, that simply means there is no winner and no action should be taken. Think of it as a “tie.”

The biggest mistake that people make when split testing is guessing at the results or making changes to their website or funnel without statistically valid data to inform those decisions.

Do not do this under any circumstances or you’re essentially throwing money out the window. Even marketers who’ve been doing this for 20 years can’t guess which page will win a split test.

If you’re regularly running split tests without any clear winner, it simply means your variations are too similar and are therefore inherently much less likely to be statistically different from each other.

You may see marketers talking about how they got a 40% increase in opt-ins by changing the color of the submit button or other silly things like that – but don’t believe it.

99% of the time changing small things like button colors or a few words here and there are not going to result in statistically valid differences. And when it comes to split testing most marketers, even “gurus”, have no clue what they’re doing and no idea whether their data is statistically significant or not.

When split testing the idea is to test “big” changes – a completely different headline, a different offer, higher or lower pricing, more testimonials, etc. Then do it over and over and over again.

Article 797 Last updated: 12/08/2022 9:46:51 AM
https://www.clickmagick.com/kb/?article=797