Home > The Newbie Zone > Questions and Answers

Question about statistical significance (2)


07-20-2015 07:11 PM #1 balint (Member)
Question about statistical significance

Sorry if it had been somewhere, but could not figure out a good tip about that.

Doing mobile app adv. appetizer style.
I launched my first campaign, and not sure when should I say, okay I have enough data, I should stop the ones not working, and improve the ones that are over 50%
So when do you say that you have enough data about an angle/banner. Also do you use one angle always with different multiple angles when starting testing a compaign?

I have smart CPA goal (1.5x payout) set up as caurmen suggested in the appetizer and 8$ daily limit(his offer was $.45 payout)
Not sure why he suggested $15 to be spent for each. Quickly searched for statistical significance, but haven't found yet what I was hoping for.
So when do I have enough data? I saw somewhere as 15k impressions (is it wins?)would be good.


07-21-2015 11:34 AM #2 caurmen (Administrator)

I suggested $15 as the spend because at that point you'll have reasonably statistically significant data to optimise from. The maths for statistical significance on mobile is a little tricky, so I suggest that benchmark as a way to get started quickly without having to delve too deeply into the maths.

If you'd like to learn more about statistical significance, I'd recommend starting with the Getting Started Guide. I'll actually have new guides up next week focusing on statistical significance in mobile, but in the meantime, have a read of these:

http://stmforum.com/forum/showthread...he-Winning-Ads
http://stmforum.com/forum/showthread...ats-Calculator
http://stmforum.com/forum/showthread...-Landing-Pages

Alternatively, just go with the $15 spend - it should work well for most payouts around the $0.50 - $1.20 mark.


Home > The Newbie Zone > Questions and Answers