Home > Paid Traffic Sources > Mobile

[DECISIVE] What's the Best Way to Test Angles for 1 Offer? (9)


02-26-2015 01:16 PM #1 fanatic4k (Member)
[DECISIVE] What's the Best Way to Test Angles for 1 Offer?

Hi STMer's, how are you doing

Just a quick noob question that I want some feedback from you guys.

What's the best way to test different angles for 1 offer targeting 1 country on Decisive?

Should I create different campaigns, each campaign represents one angle with its own banners/landers? Or should I lump them all into 1 campaign with say like 20 banners representing 5 different angles?

I'm going with the 1st setup. But it looks like I'm competing against myself since the "slots" are fixed, yet the number of bidders for each slot will go up (from the many campaigns I created) thus increasing the price? Not sure if I'm thinking about it the right way.

I also emailed Decisive's support for this question.

Let me know what ya think.

Thanks!


02-26-2015 03:11 PM #2 steveee1 (AMC Alumnus)

Hey there fanatic4k, I'm a newbie but just throwing out my 2cents

When I test angles, I would do several banners direct linked to one offer first. For example I would create 8 different banners with different designs/angles -> one offer and whichever one performs the best I would then create variations of that banner and or test new designs with somewhat of the same angle. For landers, I would rotate each lander so it'll eventually look like 8 banners -> 2-3 banners rotating -> offer. Hope that helped you a little bit. Best of luck to ya


02-26-2015 04:16 PM #3 fanatic4k (Member)

Quote Originally Posted by steveee1 View Post
Hey there fanatic4k, I'm a newbie but just throwing out my 2cents

When I test angles, I would do several banners direct linked to one offer first. For example I would create 8 different banners with different designs/angles -> one offer and whichever one performs the best I would then create variations of that banner and or test new designs with somewhat of the same angle. For landers, I would rotate each lander so it'll eventually look like 8 banners -> 2-3 banners rotating -> offer. Hope that helped you a little bit. Best of luck to ya
Thanks bud, I think I understand the concept But what I asked is how should I go putting those angles to the test in Decisive that is not counter-productive.

It's because when you have 5 campaigns representing 5 angles but all of them aim to the same demo/country, they would be fighting each other for the impressions. That's my initial thinking. Not sure if it's true or anything significant.


02-26-2015 06:24 PM #4 glennstacks (Member)

@fanatic4k initially i'd start with 1-2 angles max (per offer) because that's essentially 8 campaigns in decisive (splitting between wifi-app, wifi-site, etc.)

at this point, id collect data and decide which angle is working more, but at the same time, i can start filtering out which placements, carrier, os, handsets suck... by the time i start introducing additional angles, i'd have a filtered campaign with blacklisted placements, carriers, etc.


02-27-2015 01:50 AM #5 fanatic4k (Member)

Quote Originally Posted by glennstacks View Post
@fanatic4k initially i'd start with 1-2 angles max (per offer) because that's essentially 8 campaigns in decisive (splitting between wifi-app, wifi-site, etc.)

at this point, id collect data and decide which angle is working more, but at the same time, i can start filtering out which placements, carrier, os, handsets suck... by the time i start introducing additional angles, i'd have a filtered campaign with blacklisted placements, carriers, etc.
Thanks Glenn,

So that means you will setup 2 separate batches of campaigns (4 camps each batch) for those 2 angles, right? When you do so, do you cut off bad placements, carriers, etc at the same time on both of them or you will do it on a per-campaign basis?


02-27-2015 05:00 AM #6 glennstacks (Member)

Honestly, i use a tracking system (Voluum) which enables me to split test offers easily

in your case, correct me if im wrong, it seems like your following the appetizer guide (without using a 3rd party tracker and using decisive's tracking system)

if this is the case, what i would do is start by 1 angle first - 4 campaigns - 10 ads in each. i would let it run for a day or let it reach it's spend then start cutting from there.. if you see potential in those campaigns keep what's working, cull the rest, and let it run for another day's spend..

at this point, i won't just wait for those to end, i'll fire up another 4 campaigns based on a new angle.. cutting out the bad placements from the data i got from the previous campaigns

hope that makes sense.


02-27-2015 11:09 AM #7 caurmen (Administrator)

Definitely test one angle per campaign.

The 8 angles - 8 banners - 1 campaign idea seems appealing, but the problem is that it's very easy to get false negatives (a bigger problem than false positives). If your angle idea is great, but your banner copy or image sucks, you can end up with data suggesting that the angle doesn't work. And that can lead you to discard an entire angle that could have made you $x,xxx a day!

If, on the other hand, you're testing 8 banners with varied designs, images and text, you reduce the risk that failure of the campaign is just down to one banner, and increase the chance that it's an accurate sign that the angle doesn't work.


02-27-2015 02:23 PM #8 fanatic4k (Member)

Thanks Glenn and Caurmen for your gold suggestions. I can see the way now

One more thing I'd like to ask for your exp. Have you been in a case when one placement could be a bad performer for one angle but might convert for another angle (I'm talking about one offer)? I mean, when we optimized out the bad targets from the 1st angle, and then apply the remaining already-optimized list of targets for the 2nd angle, would that screw the results up?

I'll test it out anyway. But just want to hear from people with more exp than me.


05-27-2015 12:28 AM #9 jclark (Member)

Quote Originally Posted by caurmen View Post
Definitely test one angle per campaign.

The 8 angles - 8 banners - 1 campaign idea seems appealing, but the problem is that it's very easy to get false negatives (a bigger problem than false positives). If your angle idea is great, but your banner copy or image sucks, you can end up with data suggesting that the angle doesn't work. And that can lead you to discard an entire angle that could have made you $x,xxx a day!

If, on the other hand, you're testing 8 banners with varied designs, images and text, you reduce the risk that failure of the campaign is just down to one banner, and increase the chance that it's an accurate sign that the angle doesn't work.
Common advice on here is to cut campaigns when they've spent 3x the CPA amount without turning a profit. Since any one of the ads within a given campaign could be the winner, is it better to spend 3x the CPA amount per ad within a campaign before cutting?


Home > Paid Traffic Sources > Mobile