Home > Programming, Servers & Scripts > Hosting, Servers & Security

Need Help with high traffic, server suggestion (13)


06-12-2014 08:32 PM #1 godspeed (Member)
Need Help with high traffic, server suggestion

Whats good hosting for 500k-1mil visitors/day? I upgrade my Beyond from starter to VPS2048, but im getting Internal server error on my domains/loosing money.
Support explained that VPS2048 can take up to 150k visitors/day.


06-13-2014 02:53 AM #2 zeno (Administrator)

For 1 million a day I would move to a dedicated server...

Since you're already with BH the fastest solution is probably getting a dedi with them and asking them to migrate everything for you.

Otherwise, you could always get a beastly VPS from e.g. RamNode or Linode and get a server admin to configure everything + have Nginx running very low connection timeouts. I believe 10 users per second shouldn't be a problem if you expire connections quickly!

Note: if you do continue with a VPS make sure to offload everything you can to a CDN... if pages are running on your server try CloudFlare if you want a 'turn on and go' approach - but your tracking system and landers will need to be on a different (sub)domain.


06-13-2014 11:02 AM #3 caurmen (Administrator)

Yep, I'd go for either a dedicated server or a much larger VPS. We're doing load-testing currently on a tracking system, and for that volume 4 Gb is an absolute minimum, and I'd probably aim at 8 or 16Gb on a dedicated server - with a decent CPU as mentioned below.

You should also definitely spend money on a sysadmin to tweak your settings. I've written some guides here on STM which will help, but they're no substitute for employing a really good sysadmin to get your system humming.

Apache will handle that volume, albeit not quite as well as nginx, but your real bottleneck will be your database. Get rid of vanilla MySQL and upgrade to MariaDB stat. And if you're getting a dedicated server, make sure it has a powerful CPU.


06-16-2014 01:28 PM #4 testosterone (Member)

Here's what we did --

until now we were rejecting big volume / low conversion affiliates and type of traffic -- like popunders, redirects, etc.

Now we had consultations with big traffic guys and for us the solution is in 3 dedicated servers.

two to host our key scripts and one for data (video hosting we outsource).

If there will be need for more traffic after that - we have a solution - and should you need it, I can have my tech guy explain it to you. Feel free to pm.


06-16-2014 03:35 PM #5 superboi (Member)

double post


06-16-2014 03:37 PM #6 superboi (Member)

man im jealous...

i used to get that much traffic before... (FOR FREE TOO!!!)... well i had to pay 5 employees to keep promoting (spamming)... lol.. but it only costs $600 per month... to get 1m visitors per day...

and i used to have these types of problems before...

I used to have 5 dedicated server with 24 CPU's 24GB RAM and 2TB per server...

until that stupid google panda... lol...


anyway... like others said...
dedicated server(s) will solve your problem... be sure to have SSD as well...
especially if u want your pages to load super fast... high I/O is needed if pages are accessed more frequently...
I believe cpvlab now supports MEMCACHED? it will also help you with your database...

memcached will help a lot with page generation...


06-16-2014 04:17 PM #7 _mcr_ (Moderator)

The best solution for you, in my humble opinion, is scalable cloud servers. I run a few in Rackspace Cloud. The extreme scalability will give you the lowest cost for the best performance. VPS or dedicated is a commitment. Dedicated servers are hard to scale. In the cloud, when I need more juice I simply spin up more servers and add them to the load balancer as needed. If traffic drops, I drop a few servers. You can get servers with a large number of cpus and a lot of ram, and all primary disks are superfast SSD. The load balancers have built-in caching for even more speed. There is no large upfront cost to set up the server as opposed to dedicated in my exprience.

You can also set your servers to autoscale, so they add more capacity during the times you need it most, which saves you even more money.

Any questions, let me know. I run several shared, VPS, dedicated, and cloud accounts, both Windows and Linux, so I've gained a bit of experience over the years (no humble brag).


06-16-2014 08:12 PM #8 testosterone (Member)

Quote Originally Posted by superboi View Post
I believe cpvlab now supports MEMCACHED? it will also help you with your database...
be aware with cpvl with big traffic -- we had serious issues with it couple days ago -- our database got too big for it to handle.

You must clean it from time to time.

I am split-testing maniac so it was hard to me to see all that data gone - but what had to be done, had to be done.


02-22-2016 10:58 PM #9 fraser (Member)

Anybody have a good System Admin referral I can hire on a contract? We're running high volume of clicks now and need to move to a new hosting solution asap so would want somebody to do the move and optimize for a lot more volume upcoming.


02-23-2016 03:15 AM #10 dlauer (Member)

Quote Originally Posted by godspeed View Post
Whats good hosting for 500k-1mil visitors/day? I upgrade my Beyond from starter to VPS2048, but im getting Internal server error on my domains/loosing money.
Support explained that VPS2048 can take up to 150k visitors/day.
This depends on what you're doing; where you're hosting your tracker, what events you're tracking. If you're just running standard affiliate arb (impression/click/conversion;engagement,ctr,cvr), in capable hands, a small VPS can handle this amount volume.


02-23-2016 10:15 AM #11 caurmen (Administrator)

@dlauer - Exactly. It also depends on how the tracker is set up - some trackers make a lot more database calls than others and so require more powerful hardware for the same volume of clicks.


02-23-2016 11:10 AM #12 simolife (Member)

from my personal experience, we host lot of buzz web site with 1.2 millions visitors / day we use Jelastic. and they increased our limit to 1024 cloudet = the limit is the sky with jelastic.


03-03-2016 11:41 AM #13 integrity (Member)

Quote Originally Posted by _mcr_ View Post
The best solution for you, in my humble opinion, is scalable cloud servers. I run a few in Rackspace Cloud. The extreme scalability will give you the lowest cost for the best performance. VPS or dedicated is a commitment. Dedicated servers are hard to scale. In the cloud, when I need more juice I simply spin up more servers and add them to the load balancer as needed. If traffic drops, I drop a few servers. You can get servers with a large number of cpus and a lot of ram, and all primary disks are superfast SSD. The load balancers have built-in caching for even more speed. There is no large upfront cost to set up the server as opposed to dedicated in my exprience.

You can also set your servers to autoscale, so they add more capacity during the times you need it most, which saves you even more money.

Any questions, let me know. I run several shared, VPS, dedicated, and cloud accounts, both Windows and Linux, so I've gained a bit of experience over the years (no humble brag).
I'd love to hear more about your setup.


Home > Programming, Servers & Scripts > Hosting, Servers & Security