Home > Programming, Servers & Scripts > Hosting, Servers & Security

500k-1mil traffic/day... what is the best server for me? (27)


11-06-2014 08:48 PM #1 itsjustbrian (Member)
500k-1mil traffic/day... what is the best server for me?

I currently have the minimum dedicated server with LiquidWeb.

Any server experts know exactly what type of server/upgrade I need to make sure I'm running 100% smooth?

My traffic is 500k/day, but I do foresee that growing to 1 mil per day soon.

https://www.liquidweb.com/dedicated/

Maybe what I have is good enough? I'd be curious to see if an upgraded server would bump ROI +20% or something


11-06-2014 09:45 PM #2 Mr Green (Administrator)

PM STMer @goshev he is the Sultan of Servers. He will have you hooked up with a flawless set up.


11-06-2014 10:25 PM #3 acepowermarketing (AMC Alumnus)

Same issue here. Increased roi? Really?


11-06-2014 10:31 PM #4 maynzie (Moderator)

Same issue here. Increased roi? Really?
Certainly, if you better your server game for faster loading times etc can definitely see ROI increases. Every time I've upgraded my server the extra in running costs is covered by the little spike in Roi's


11-06-2014 10:37 PM #5 acepowermarketing (AMC Alumnus)

Can we be a little more exact here? My mobile landing page loads in around 1 second. How fast is yours? And how much faster did it get with the increased speed and how much roi increase is that?


11-07-2014 12:19 AM #6 jennatalia (AMC Alumnus)

1 whole second?!

Plenty of room for improvement there.

https://blog.kissmetrics.com/loading-time/


11-07-2014 06:35 AM #7 dlegia (Member)

@itsjustbrian - you have to provide more details about. For example:

To determine what internet channel you need:
1. Do you host landing pages on this server or use cdn cloud service from other providers
2. If you host LPs how big are they (average in KB)
3. Do you have statistic about server load by hours, day of week (it is usual some hours or days to have more traffic)

To determine server hardware:
1. What kind of tracking software you use now and do you plan to change it
2. Do you host other websites on this server or only tracking software


You said you plan to reach 1 mil. daily - is this the max amount of users you want this server to handle or you expect more?


11-07-2014 06:50 AM #8 goshev (Administrator)

Minimal server on liquidweb is Intel Xeon E3-1220 v2. Is that the one you are using? The VPS and Cloud packages I do not really like virtual servers as all the companies will oversell those unless they offer KVM VPSes which are also not impossible to oversell just way harder.

If you have that XEON 500k or 1 mil a day should not be a problem. This of course depends on the traffic spikes which may appear. You should be able to handle more than 1 mil clicks but if there are not spikes with more than 500 - 1000 clicks per second.

Feel free to PM me, will be happy to help with any tweaks or upgrades if needed.


11-07-2014 01:19 PM #9 caurmen (Administrator)

@xavierfolk - read http://stmforum.com/forum/showthread...hlight=loading.

In summary: your loading time can affect your ROI a LOT, unless your pages literally load faster than it's possible for humans to perceive (around 20ms).


11-07-2014 01:56 PM #10 subzer0 (Member)

Quote Originally Posted by itsjustbrian View Post
I currently have the minimum dedicated server with LiquidWeb.

Any server experts know exactly what type of server/upgrade I need to make sure I'm running 100% smooth?

My traffic is 500k/day, but I do foresee that growing to 1 mil per day soon.

https://www.liquidweb.com/dedicated/

Maybe what I have is good enough? I'd be curious to see if an upgraded server would bump ROI +20% or something

I would suggest you to go with a cloud server with Rackspace or Singlehop

let me know your budget and i can help you get set up there feel free to pm me


11-07-2014 06:18 PM #11 zeno (Administrator)

Why would you go with a *cringe* Rackspace (or Amazon) VPS for anything unless you need huge scalability and geographical load balancing?

IMO both Rackspace and Amazon offer insanely overpriced and under-performing options in the context of self-hosted click tracking systems.


11-07-2014 07:35 PM #12 karim0028 (Member)

Quote Originally Posted by zeno View Post
Why would you go with a *cringe* Rackspace (or Amazon) VPS for anything unless you need huge scalability and geographical load balancing?

IMO both Rackspace and Amazon offer insanely overpriced and under-performing options in the context of self-hosted click tracking systems.
How about Amazon just geographical load balancing/latency?

Is there something else other than amazon u can use? Im pretty sure co-locating (close to traffic origin) servers makes a decent sized difference, even against a pure CDN setup....


11-08-2014 03:19 AM #13 manny030 (Member)

I have 3-4 m hits a day on a $10/m linode.com package & $20/m cloudflare account.

Click image for larger version. 

Name:	Screen Shot 2014-11-08 at 11.41.19.png 
Views:	259 
Size:	40.3 KB 
ID:	4366


11-08-2014 03:49 AM #14 paulis1 (Member)

Quote Originally Posted by manny030 View Post
I have 3-4 m hits a day on a $10/m linode.com package & $20/m cloudflare account.

Click image for larger version. 

Name:	Screen Shot 2014-11-08 at 11.41.19.png 
Views:	259 
Size:	40.3 KB 
ID:	4366
Enough said.


11-08-2014 05:53 AM #15 zeno (Administrator)

Quote Originally Posted by karim0028 View Post
How about Amazon just geographical load balancing/latency?

Is there something else other than amazon u can use? Im pretty sure co-locating (close to traffic origin) servers makes a decent sized difference, even against a pure CDN setup....
Do you mean DNS-based load balancing? If you want to load balanced between servers in different countries then this has to happen at the DNS level.

There are services that do this but Amazon Route 53 is the cheapest - but the most manual as you have to add rules for each server/country rather than something intelligent and auto-selecting.

You can use Route 53 for this and don't need servers with Amazon at all. Amazon only recently added geo-based DNS records to Route 53 and it may have mad me tingle.


11-08-2014 09:12 AM #16 goshev (Administrator)

Singlehop -- not really good

SingleHop -- Dedicated servers amazing stuff and extremely good support in case of networking problem or hardware issues

I am working with these guys 4 years now and never had an issue which cannot be resolved within minutes. Anyone who may want a server with SingleHop let me know. I can get pretty good discounts on certain offers.

As for any load balancing this requires extremely well organized servers behind the machine which will do the actual load balancing. Not impossible to setup but too expensive if it should be well configured and reliable. Better get a really fat dedicated servers on 2 - 3 locations and spread the content on those. With Thrive having the function to be installed on multiple servers this should not be a problem right.


11-08-2014 10:36 AM #17 caurmen (Administrator)

If you're buying Amazon servers make sure that the I/O speed is up to scratch. I know some Stackers use Amazon services and get excellent results, but you do need to be careful about the performance of the box you choose.

That'll be more critical if you're running tracking on there too, mind - just for a lander I imagine that a micro-instance would probably be fine.

Hmm... actually, that's worth a test...


11-15-2014 08:50 PM #18 BeyondHosting-Tyler (Member)

Quote Originally Posted by goshev View Post
Singlehop -- not really good

SingleHop -- Dedicated servers amazing stuff and extremely good support in case of networking problem or hardware issues

I am working with these guys 4 years now and never had an issue which cannot be resolved within minutes. Anyone who may want a server with SingleHop let me know. I can get pretty good discounts on certain offers.

As for any load balancing this requires extremely well organized servers behind the machine which will do the actual load balancing. Not impossible to setup but too expensive if it should be well configured and reliable. Better get a really fat dedicated servers on 2 - 3 locations and spread the content on those. With Thrive having the function to be installed on multiple servers this should not be a problem right.

When we started in 2007 we were renting around 20 singlehop dual quad core boxes with 4x 300G sas disk in a raid 10 configuration. We constantly had issues with raid card failures and all sorts of dumb network issues with them.

We kept a few server there until recently to use for DNS but have cancelled those off due to constant network issues with their *global* vlan configuration.

They are in the process of moving all of chicago 2 to chicago 3 because they didn't want to renew their lease.

I would call their support *ok* I often had to have them use an IP KVM to fix our servers because they couldn't do so.

We have our own datacenter and all our own gear now, we've not had any such issues in years, if you want to do anything advanced you just have to build it yourself.

Surprised no one has mentioned us honestly... I've seen a ton of customers stuffing over 100k clicks an hr through a VPS2048 + Litespeed with cloudflare. http://beyondhosting.net/Virtual-Pri...x-VPS-Hosting/


11-16-2014 03:04 PM #19 goshev (Administrator)

Hello Tyler,

I can list here a few huge hosting companies using SingleHop and hosting there a few thousand servers each. I worked for all those and we never had any issues. We use mainly RAID 1 or 0 because 10 was making the service to experience and it had to be as affordable as possible for the end client. There was never an issue with RAID controller. Some issues with drives but this is not something that will never happen in any data-center. Two of the companies I worked for used Softlayer before and those guys are amazing. They indeed have the best hardware offered on the market but unfortunately slightly overprices and also their support is not really good. Right now I have quite a few servers with SingleHop and they never had any issues with the hardware.

Now the vLan issue you have mentioned they had slight issues with the in Chicago 1. I never had issues in Chicago 2 and 3. This is the past 4 years I do not have any servers in Chicago 1 4 years now. This Chicago1 is not even active anymore.

What does this have to do with their servers quality? They indeed are moving the servers but ensured pretty fast migration. This happens when you rent servers still does not mean their service is bad.

They do not have KVM that is correct. They however do offer IPMI KVM over IP which is basically the same thing.

Owning your hardware is indeed better. However we are not talking anything like creating a data-center here. Also a dedicated server is as good as its hardware is and of course for connectivity the networks to which it is connected. As for your VPS service I strongly believe there are just a handful of hosts who can match it if even that many.

I was talking bare metal though and at this point comparing price/quality/support/overall experience for the past 7 years:

1. Softlayer -- not recommended for AM as they will stop your servers if they receive DMCA complaint , they give you 2 hours max to get it resolved ( delete the content ). If any complaint is filed the resolution period is really not long enough. You get reconnection fees and all kinds of nasty things. But they are the best probably WorldWide ( excluding mainland China ).
2. SingleHop -- 24 hours for DMCA complaints and they are pretty understanding that some of those may be just not real. They will allow you to work with the complaining party and resolve the issue instead of unplug you immediately. Their support is amazing and always fixed any issues really fast, this is of course my experience I cannot say anything for the rest of the World.

This is my personal opinion . I have never had a package with BeyondHost because I just do not like Virtual servers. I prefer to get my hardware configured as I want it and use 100% of the machine, instead of allowing anyone to configure it for me. This again is my personal preference on building environment where I will host anything.

LiteSpeed is good you are right. However there are the tons of alternatives which are free and can deliver even better performance. There are things which cannot or is hard to run on not well known web services but still not impossible. The only reason LiteSpeed is that well accepted is because it integrates with cPanel and extremely high number of hosts work with cPanel because it is easy to use.

I would like to apologies if any of the above sounds offending or anything like that. I just wanted to answer all the issues you listed above as I never had those in that particular data-center.


11-17-2014 09:36 PM #20 BeyondHosting-Tyler (Member)

They use supermicro white box servers. None of the hardware is tested for reliability or compatibility, Softlayer is the same way. I can name countless random issues that I've seen with their gear. My buddy at mddhosting.com was using supermicro but after having several issues with a system not rebooting unless its power cycled has gotten him to buy some of our used dell gear. :-)

We back litespeed because of its cPanel support but also its consistently testing faster in multiple fields than nginx/varnish/fpm. :-)


11-18-2014 03:20 AM #21 zeno (Administrator)

I feel like such a server noob in this thread now.


11-18-2014 04:44 AM #22 dotcom (Member)

Quote Originally Posted by manny030 View Post
I have 3-4 m hits a day on a $10/m linode.com package & $20/m cloudflare account.

Click image for larger version. 

Name:	Screen Shot 2014-11-08 at 11.41.19.png 
Views:	259 
Size:	40.3 KB 
ID:	4366
Did you notice a significant speed difference with the Cloudflare FREE vs PRO?


11-18-2014 02:05 PM #23 goshev (Administrator)

Hello,

Indeed they do use SuperMicro. Of course DELL is better I do not argue about that. There was one issue 4 years ago because of which they keep servers they have tested and are ready to use. However how often do you reboot your servers? I never had issue rebooting one but probably because most of them are with pretty nice uptime. Also the full powercycle you can complete on your own and the server is up in a few minutes, unless FSCK initiates but there is no different if you have DELL or SiperMicro the file system check takes pretty much the same time on any box. Softlayer will get you whatever you want as long as you pay for it and it is pretty darn expensive which is basically true with SingleHop as well.

I am not saying that owning your hardware is not the better option. However when you have to upgrade you pay for the new components and with rented servers you just get the new hardware on pretty much the same price. Will be moving from E5-2620 to E5-2650 free and because of this one thing I am really glad I do not own the boxes.

As for LiteSpeed I agree it offers pretty good performance. However with proper nginx/varnish/fpm or fastcgi setup you can get better results. It requires a lot of tweaking but still it is free so you have to learn a few things about those services. Again for cPanel based environment and person without experience with server management LiteSpeed is the better option probably, unless you find someone to maintain your server.


11-19-2014 05:22 AM #24 manny030 (Member)

Quote Originally Posted by dotcom View Post
Did you notice a significant speed difference with the Cloudflare FREE vs PRO?
Yes, but it's probably because I do use all 20 page rules and the image optimization that comes with the pro plan.


11-19-2014 01:07 PM #25 goshev (Administrator)

Also you are not running tracker on that linode container or am I mistaken?


11-19-2014 02:24 PM #26 BeyondHosting-Tyler (Member)

Quote Originally Posted by goshev View Post
Hello,

Indeed they do use SuperMicro. Of course DELL is better I do not argue about that. There was one issue 4 years ago because of which they keep servers they have tested and are ready to use. However how often do you reboot your servers? I never had issue rebooting one but probably because most of them are with pretty nice uptime. Also the full powercycle you can complete on your own and the server is up in a few minutes, unless FSCK initiates but there is no different if you have DELL or SiperMicro the file system check takes pretty much the same time on any box. Softlayer will get you whatever you want as long as you pay for it and it is pretty darn expensive which is basically true with SingleHop as well.

I am not saying that owning your hardware is not the better option. However when you have to upgrade you pay for the new components and with rented servers you just get the new hardware on pretty much the same price. Will be moving from E5-2620 to E5-2650 free and because of this one thing I am really glad I do not own the boxes.

As for LiteSpeed I agree it offers pretty good performance. However with proper nginx/varnish/fpm or fastcgi setup you can get better results. It requires a lot of tweaking but still it is free so you have to learn a few things about those services. Again for cPanel based environment and person without experience with server management LiteSpeed is the better option probably, unless you find someone to maintain your server.

I would be happy to provide a server and all the licensing required if you would test Litespeed vs your blend of software. I'd be pretty surprised if you could prove more than a 5-10% margin between the 2. :-)

I think this would make a great write up!


11-19-2014 03:21 PM #27 manny030 (Member)

Quote Originally Posted by goshev View Post
Also you are not running tracker on that linode container or am I mistaken?
It's basically one landing page with 24 images (1MB total). The landing page does all the tracking (custom php script), it writes all kind of data (referer, useragent, campaign, provider...) into a mysql database (hosted on the same linode).

The images are served from Cloudflares cache while the cache is deactivated for the landing page. On the linode I use Nginx without any customizations.


Home > Programming, Servers & Scripts > Hosting, Servers & Security