Home > Technical & Creative Skills > Tracking Campaigns

Where/How To: Dump thousands of IP's into duplicates cleaner...but sorting out the (8)

01-23-2014 11:48 PM #1 johnnybegood (Member)
Where/How To: Dump thousands of IP's into duplicates cleaner...but sorting out the

Hey Stackers, I wanted to know what you would do in this situation. Im looking for a tool that I can dump 100k IP's into it and have results showing which are duplicate. What Ive found was keyword "cleaners" which delete duplicate IP's, however in this case we want that data in order to see any IP's that are hitting consistently many times. Suggestions?

01-24-2014 12:37 AM #2 snipe (Member)

Here I did it for you in Excel. Just paste your IPs into col A, then drag the formula from col B,C,D down to the end of the rows.
When you're done with that filter based on Col D

Cheers

01-24-2014 12:59 AM #3 johnnybegood (Member)

Ahh ya..thanks baby!

01-24-2014 01:42 AM #4 rafael (Member)

I've also done this on the linux command line using this method :

http://encodable.com/tech/blog/2008/..._BASH_OneLiner

This will count how many times a unique IP address shows up in your logs.

01-24-2014 01:57 AM #5 johnnybegood (Member)

How many times would you "allow" an IP to show before you decide to can it? Im trying to prevent spytools and prying eyes, my traffic is typically ppv.

01-24-2014 09:07 AM #6 zeroonedigital (Member)

Quote Originally Posted by johnnybegood View Post
How many times would you "allow" an IP to show before you decide to can it? Im trying to prevent spytools and prying eyes, my traffic is typically ppv.
I've tried to do this and found that it was a waste of time. If you're running any worthwhile volume you'll soon realize that it's too much to keep up with (doing everything manually). Also, most of the spy tools and professional snoopers seem to rotate IPs and/or continuously obtain new ones on a regular basis. Even cloaking will fail to block these guys 100%. You're never going to be able to hide you stuff and you're never going to be able to stop it from being ripped. Also if you haven't noticed, some traffic sources (like LI for instance) are notorious for serving the same IP multiple times in a row, or even serving it multiple times within the same frequency cap period. With my LI campaigns it's common to see 3 hits from the same IP all served at the same time. Are you going to block out these ones too? The problem is, with all the spying out there, combined with your paranoia, combined with traffic source error; it's hard to know exactly which IP's are up to no good.

Sucks to hear right? Well, on the bright side you can take comfort in the fact most people who rip your campaigns don't really know wtf they're doing and once the campaign has been run into the ground they'll be left digging for other peoples scraps while you'll be profiting from new campaigns.

01-24-2014 10:35 AM #7 johnnybegood (Member)

Quote Originally Posted by liamtheterrier View Post
Sucks to hear right? Well, on the bright side you can take comfort in the fact most people who rip your campaigns don't really know wtf they're doing and once the campaign has been run into the ground they'll be left digging for other peoples scraps while you'll be profiting from new campaigns.
This put a smile on my face.... Ive heard this idea so many times, yet for some reason this post puts it all into crystal clear perspective.
You can tell a damn good marketer when he gets smack dab into your head and makes you wanna sing..."Dont worry, bout a thang..cuz every little thing..gunna be alright." Hee hee.

Thanks

01-25-2014 05:45 AM #8 getzlaf15 (Member)

I run a 4 hour blacklist on ips. If they hit any of my landers in that period I then forward them to a different lander that I don't
care if they rip. That way I still make money for ips that aren't meant to be duplicates.

But for spiders, I am going to work on something to cut them out more.

Home > Technical & Creative Skills > Tracking Campaigns