Home > Other Systems (CPVLab, iMobiTrax, P202, Track Revenue, Click, Google Analytics, etc.) > Normal Prosper202

Prosper 202 - How much volume is too much and DB size issues? (8)

03-29-2014 05:55 PM #1 naesm (Member)
Prosper 202 - How much volume is too much and DB size issues?

Hey everyone I am getting ready to scale my camps as much as possible in the next few days and want to make sure I am prepared. Right now I am still using Prosper. I checked my DB size and it's sitting at about 650mb right now. Yesterday my click volume was about 70k.

Am I going to run into problems with the database size if I keep going?
Am I going ot have any issues with speed if I scale much more?
If I am going to run into problems what is a better solution? I have been looking into Voluum. They are still in beta right now and not charging.

Also, I'm sure you guys are going to want to know my server config. Right now I am still on a Storm VPS. Going to upgrade to their bare metal dedi solution very soon. But support has told me I am still nowhere near utilizing the server.

Thanks for any suggestions.

NAES

03-30-2014 09:46 PM #2 naesm (Member)

bump

03-30-2014 10:43 PM #3 deondup (Member)

You can comfortably do 1mil clicks per day and even beyond that it depends on your server set-up. People seem to think that because Prosper is free its not as good. Wrong!

When you do double your current volume you should start looking beyond your VPS

The only issue is with generating reports. 650MB is getting large for generating complex reports. Clear your database! everything should be fine then.

03-31-2014 01:14 AM #4 zeno (Administrator)

I'm not even sure how the database size influences Tracking202 performance - is there much in-memory caching? With reports I can see things getting intense, both with disk I/O and memory usage - you could track this with NewRelic to get an idea of things.

On a side note, has anyone tried replicating a Tracking202 database to another server that you then process all reports on? You could probably offload this to some cheap VPS that you just use for looking at the data - that way running reports has no impact on tracking performance. In a perfect world you could also clear your main database while maintaining everything in the offloaded one. Infinite history!

03-31-2014 03:31 AM #5 swiftclick (Senior Member)

Quote Originally Posted by deondup View Post
You can comfortably do 1mil clicks per day and even beyond that it depends on your server set-up. People seem to think that because Prosper is free its not as good. Wrong!

When you do double your current volume you should start looking beyond your VPS

The only issue is with generating reports. 650MB is getting large for generating complex reports. Clear your database! everything should be fine then.
can you elaborate a bit? are you running that much traffic through prosper? im on a dedicated server running lightspeed with memcache enabled, and depending on excess tracking variables 1 mil clicks = ~1.5GB db size for me. anything over 2-3GB makes my prosper virtually unusable.

03-31-2014 06:06 AM #6 bbrock32 (Administrator)

Depends on the server.

For me it works ok till it reaches 5-6gb in database size.

03-31-2014 09:21 AM #7 deondup (Member)

I never allow my database to get that large. When it hits 1GB I do a backup and then dump it.

If you capture a lot of data then it makes things quite heavy and it can be slow when generating reports.

Once campaigns are running smoothly I drop as many variables as I can. If you track C1-C6 + all the usual mobile stuff you will have very large databases

03-31-2014 04:27 PM #8 caurmen (Administrator)

With a solid server you can hit a few million clicks in the database, at least, before it starts having a funny turn. Get a dedicated server with a powerful CPU, well-tuned, lots of memory, SSDs and a solid install of something like MariaDB and you should be golden.

Home > Other Systems (CPVLab, iMobiTrax, P202, Track Revenue, Click, Google Analytics, etc.) > Normal Prosper202