Hello to all.
I've been running a few campaigns this week with a few headlines and images. Some headlines never got any conversions so those were obvious picks to eliminate I think.
My question is when do you have enough data in order to make a solid decision to cut a headline or image/graphics from the a/b test?
Here is my scenario: I have a total of 424 Clicks and 22 Converstions split by 2 headlines (ad16 and ad17). The ads also have different images as well as you can see below.
From what I see here ad16 wins and I should just chop ad17. I just don't know if this is enough data in order for me to make that decision. If any one out that has experience with A/B testing or know of a great thread that covers this material. Please share with me. I will like to know what experienced Affiliate Eyes see when they see the data below. Please share.
Thanks in advance.
Ad/img Clicks CR Prcntg
ad16 209 15 7%
img1 38 5 13%
img3 37 1 3%
img4 56 6 11%
img5 41 3 7%
img6 37 0%
Ad/img Clicks CR Prcntg
ad17 215 7 3%
img1 60 2 3%
img4 76 2 3%
img6 79 3 4%
Total 424 22 5%
I think this will help you: http://stmforum.com/forum/showthread...Banners-Part-1
Yes, that's a great post.
Also, I'd recommend reading:
How Do I Know When To Stop Running Ads? What Is "Statistical Significance"?
How Do I Know Which Landing Page Is Working Best? Do I Have Enough Clicks Yet?
Hope that helps!