Home > General > Affiliate Marketing Forum

Excellent Bayesian A/B Testing Tools to help you pick offers (18)


05-11-2016 09:38 AM #1 edgekaos (Member)
Excellent Bayesian A/B Testing Tools to help you pick offers

To Start with , I am a newbie, and my path to the green is often plagued by questions like:

Campaign A: Payout $10 per conversion, the campaign has 100 clicks on the LP and no conversions so far.

Campaign B: Payout $2 per conversion, the campaign has 200 clicks on the LP and has one conversions.

If you only has the money to keep one Campaign going?

Which one will you pick ? A Or B?

__________________________________________________ _____________________________

It is actually an A/B Testing questions. but harder than it seems due to the small trial size ( 100/200)

with some research and went through the forum tutorials, I found the excellent resource like Bayesian calculator from peak conversions

but the drawback of peakconversion calculator is it assumes all successes trials has the same payout, so it is useful to pick placements/banners/LPs, but can't really use it to pick offers, or very complicated to do so.


after some more digging, I finally found this Excellent Bayesian A/B Testing calculator by win-vector

To Find out which Campaign is better,

Go the the site, click evaluate campaign, and enter the trials( LP views) , success( Conversions) , and success value(Payouts) accordingly. Voila

It will spit out the magic number:

Click image for larger version. 

Name:	qsexc6ew.png 
Views:	487 
Size:	161.5 KB 
ID:	11335

go back to the Campaign A/B question, in case you are curious:

It shows even though Campaign A has zero conversion, it has small edge(59%, 50% is even odds) over Campaign B to generate higher returns due to high payout ($10 vs $2)

Probably thats the main reason why the successful affiliate advises newbies to start with low payout offer, because you will know the campaign is not worth doing very soon, if the offer is high payout it takes a lot more clicks to confirm it is dead, which will cost your an arm and a leg.


Another good thing about win-vector calculator, It even comes with a youtube short course teach you how to use the calculator and a mini crash course to explain the statistical theory behind it.


05-11-2016 11:28 AM #2 caurmen (Administrator)

That's GREAT! Thank you very much for this find. Really useful.

I'm going to check into the math a bit, and if it looks sound (as it does at the moment) I'll write up a detailed guide and tutorial aimed specifically at affiliates.


05-12-2016 01:09 PM #3 edgekaos (Member)

Thanks Caurmen! I have followed your many great tutorials and learned a lot, glad to know you find it useful and look forward to the guide !


05-16-2016 05:01 AM #4 vortex (Senior Moderator)

OMG we've been looking forever for something like this!

Thanks a million times over!

Very much looking forward to caurmen's tutorial!


Amy


05-18-2016 02:14 AM #5 bobliu (Member)

Great share, love tools like this.

Quote Originally Posted by edgekaos View Post
It shows even though Campaign A has zero conversion, it is 59% better than Campaign B
To those reading and new to baes - I must point out that the tool should also be used with a little common sense for this point


05-18-2016 10:33 AM #6 edgekaos (Member)

Agreed bobliu, definitely need some caution. Bayesian statistic is a bit counter intuitive to me , probably thats why it is so useful. Win-vector video course is great too, for those new to Bayesians & statistics dont miss it. You will get an idea of where those numbers come from.


05-18-2016 03:45 PM #7 shakedown (Member)

You are THE man. I had been looking for exactly this.


05-25-2016 07:45 AM #8 pandabear (Member)

Extremely useful, thanks for the share!


06-08-2016 03:53 PM #9 mehdi (Member)

Application not available .. did they remove it ? :/



Mehdi


06-08-2016 06:41 PM #10 shakedown (Member)

Quote Originally Posted by mehdi View Post
Application not available .. did they remove it ? :/



Mehdi
I always worry about this happening and sure enough it did. One day the Peak Conversions one will probably get taken down also.

This would be a cool tool to have developed as an STM exclusive or maybe we can do a group buy and have one developed if anyone is interested.


06-08-2016 06:53 PM #11 greentea (AMC Alumnus)

The application is hosted on the free tier plan at shinyapps.io which only provides 25 active hours when the application is not idled. Should be back online at the start of the new monthly cycle come July 1.


06-09-2016 02:02 AM #12 shakedown (Member)

Quote Originally Posted by greentea View Post
The application is hosted on the free tier plan at shinyapps.io which only provides 25 active hours when the application is not idled. Should be back online at the start of the new monthly cycle come July 1.
Oh nice. I'm going to show it to some programmers on July 1st and see if they can recreate it.


06-09-2016 03:02 PM #13 pain2k (Veteran Member)

https://github.com/WinVector/CampaignPlanner/


06-15-2016 01:22 AM #14 greentea (AMC Alumnus)

Looks like the app is back online now. I might have been wrong about it being hosted on the free tier then.


06-15-2016 02:04 AM #15 kittybanks (Member)

Cool. John Mount PhD, the creator of the campaign planner is the co-author of Practical Data Science with R. He also has a udemy course.

https://www.amazon.com/Practical-Dat...data+science+r


07-17-2016 10:29 PM #16 david2772 (Member)

Thanks for the share!

Looking forward to Caurmen's guide as well!

What are you guys using for the Target Value per Action? Also is anybody using the "Plan Campaign" feature and not just the "Evaluate" feature?


04-08-2017 06:45 PM #17 chris_climbs (Member)

It looks like this app is down again! It probably hit it hours limits for the free tier on ShinyApps.

Does anyone know of an alternate hosted version? Or will I need to figure out how to deploy RStudio projects myself?

UPDATE:

I figured out how to deploy the code, but it looks like the git repo is for the older "v1" version. It still works, but it's not as nice as the newer version. You can find it here:

https://affiliatetools.shinyapps.io/campaignplanner/

This is the repo I cloned:

https://github.com/WinVector/CampaignPlanner

I'll keep digging, but if anyone has access to the V3 code, please send me the link, and I'll make a mirror of that app!


04-09-2017 03:24 AM #18 vortex (Senior Moderator)

Quote Originally Posted by chris_climbs View Post
It looks like this app is down again! It probably hit it hours limits for the free tier on ShinyApps.

Does anyone know of an alternate hosted version? Or will I need to figure out how to deploy RStudio projects myself?

UPDATE:

I figured out how to deploy the code, but it looks like the git repo is for the older "v1" version. It still works, but it's not as nice as the newer version. You can find it here:

https://affiliatetools.shinyapps.io/campaignplanner/

This is the repo I cloned:

https://github.com/WinVector/CampaignPlanner

I'll keep digging, but if anyone has access to the V3 code, please send me the link, and I'll make a mirror of that app!
Wow Chris - thanks for saving my life! I've gotten so used to using that tool - the one at win-vector is apparently still down.

Muchos gracias + RESPEKT!!!!!



Amy


Home > General > Affiliate Marketing Forum