Had a follow along a while back, but was using decisive and they banned use of the name of the offer I was hitting even with. Switched to tapit and was paying much more for traffic with lower success rates so I decided to try something different.
Mobile pops.
Campaign 1:
Geo: Poland
Offers: 2
Payout: 3.7 & 5.5
LPs: 5
spend: 30.00
conversions: 0
Rev: 0
ROI: -100%
Damn, that is some low CTR for pops! Not sure why, is this bot traffic and I need to kill a bunch of plcements to improve it?

Don't mind my lack of costs, I forgot to enter what I was paying per pop view in
Placements

Based on talking to my mastermind, and the camp that will follow this, I know these ctrs are BS for pops
So I killed any placement that had over 50 impressions and a ctr of less than 2%, or the top 19 placements by spend, or 50% of my total traffic and spend
Updates soon...
Campaign 2:
Geo: ZA
Offers: 1
Payout:1.9
LPs: 3
spend: 15.00 (only one of two days do far)
conversions: 0
Rev: 0
ROI: -100%
Much better ctr so far, but still under the ideal 20%

And placements here are doing much better. Looks to be some promising, high CTR

Actions taken: blacklisted top 4 placements by spend that had ctrs under 10%.
Bumped up bid to be able to spend my daily budget based on traffic planner.
Update soon....
What do people think of my process? Am I blacklisting too early, too aggressively, not aggressively enough?
aarg, how do I make "follow along" in the title be red like everyone else?
Campaign 1, day 2 :
Geo: Poland
Offers: 2
Payout: 3.7 & 5.5
LPs: 5
spend: 10
conversions: 0
Rev: 0
ROI: -100%
CTRs slightly higher, but still lots of shitty traffic it seems

if this is bot heavy traffic, direct linking will not really tell me which are bot heavy placements or not until I get some decent conversions happening, and still none yet. Not sure if I should leave direct linking or take it out until I find placements with a decent ctr that is not shit traffic. Any thoughts?
Lots of shit placements it seems still. Killed top 20 by spend again.

Also blocked wifi traffic, carrier only now.
Campaign 2, d2:
Offers: 1
Payout:1.7
LPs: 3
spend: 15.00
conversions: 4
Rev: 6.8
ROI: -55%
One of each lander and direct linking converted lol

Similarly, placements exhibited no strong tendency to convert, and no placements were money sucks, so nothing done beyond funding another day to gather more data before taking further action
Don't you feel it's kind of early to kill those placements? Some of them got less than 20 Visits.
The payout of your offers is $3.70 and $5.50. You can't expect them to convert after spending just $0.45.
I think your problem is lander, not placement. Test more landers to get higher CTR before cut anything.
Just my $.02 
Dropped the Poland campaign to focus on the other. I bumped up spend on poland, removed my shitty blacklisting, and let it run with no conversions. Maybe my landers suck, maybe the traffic does....back to the drawing board.
Campaign 2:
Offers: 1
Payout:1.7
LPs: 3
spend: 15.21
conversions: 3
Rev: 5.1
ROI: -66

Finally seeing the beginning of some statistical difference in LP performance!
But wanted to see more conversions before I made a decision.
Placements: none were sucking too much out of the budget, so no killing.
Instead added in 3 new landers. and killed direct linked because ROI was shittiest, and bumped spend
Next day:
Spend 25$, grab 4 conversions only on the new landers.
In the morning 2 were even green! later in day not so much though. But promising so far with much better ctrs!.

As a result of this, I removed the worst performing lander. It did not have the lowest ctr, but it did have the worst ROI of -85 vs the remainder which ranged from -70 to -10
I killed two placements. One that had one conversion but at -70 ROI, and another that had spent almost 1.5 payout.
more data soon....
I need to ask. Why do you write: „I'm seeing the beginning of some statistical difference“?
Your data is FAR away from statistical significance. If you really care about this, use a tool like this: http://drpete.co/split-test-calculator. You don't always need statistical significance, but you should understand the difference and their consequences.
Or am I the one getting it wrong?
Edit: Check this one out: http://abtestguide.com/calc/. There is a real chance that your worst performing lander (the one you kicked) actually performs a better than your best performing lander (the one with the highest ROI in your screenshot).
I may be incorrect? In the last image I posted, the lander in the second position vs 5th position
These are my thoughts on why the 2nd is better than the fifth
Lander A had 252 views, 57 clicks, and 2 conversions for a CTR of 22.6% and a cr of 3.51%
Lander B had 1024 views 174 clicks, and 1 conversion for a ctr of 17 % and a cr of 0.57%
I used http://splittester.com/
to compare both the ctrs and the crs (using conversions instead of clicks)
when ctrs were compared, A was 95% certain to be better
when crs were compared A was 85% certain to be better
So I thought those ads were significantly different enough to kill one? was I incorrect?
Hey! I am really much interested to know few things.
1. Which traffic source you're using now?
2. Which GEO you're doing now?
3. You are doing quiz landers?
Thank you.
Spend more.
Yes you'll have to spend way more - the clicks do not matter much, you have to look at the conversions to make the decision which lander performs better.
I've had one lander with 4 times higher CTR than another one, and in the end the lander with the 4 times LOWER CTR ended up generating a better ROI than the one with the high CTR.
You're right, if you look at the clickrate of your creatives you have enough data, but you do not based on their conversion rate. This is obviously not 100% applicable to affiliate marketing, but in "real life" I would never base a decision on an a/b-test, if one of the following things is not true:
1. Every variation got > 100 conversions.
2. The data is statistical significant.
so it really could be 2 variables here.
Traffic could be shit , doesn't look like it cause you are getting some conversions with it.
and your landing pages. My guess is your LP needs some serious tweaking. I'd run 2 test with 2 completely different LP's and maybe even one with a JS alert redirect only because you saw some success DL'ing. From the 2 completely different LP's you can see which performs better, the one that performs better start tweaking it for higher CTR's (alerts, OS call out, device, model, date call outs ect.) Then split test it against another insanely different LP. hope that helps.

You don't pay what you bid because the traffic source most likely charges you only what you need to pay in order to get that traffic. Let me give you an example:
Bidder 1: 0,1 / Redirect
Bidder 2: 0,2/ Redirect
Bidder 1 is on the 2nd position, but Bidder 2 pays only 0,11 for the first position. How much more he needs to pay depends on the traffic source, that at least is all I know about this.

Well I have not been updating this thread, but still taking everything into consideration above and I have reached profitable! small volume but it is promising so far!
Also, anyone know what is up with CTRs over 100% for a lander that is just a JS pop that redirects to the offer when the OK button is clicked?