Hey guys and gals,
Just today I switched over to BeyondHosting and got a CPVlab optimized Hybrid plan. The majority of sites load a lot faster than on my previous shared host (most are between 2-4 secs now) but some sites, particularly anything from the main domain (which is used for the hosting account) shows some weird stats.
F.e. the following screen, you'll see retarded page load times of 6+ seconds, and marked in red you'll find a 32kb file that takes longer to load than a 136kb file:

...is this normal?
Also, I didn't play around with js/css compression etc. yet because I wanted to see the before/after stats but if it already takes 6+ secs for the whole page to load then...idk.
EDIT: Figured out the reason, please scroll down past tijn's first reply to find it. Still need help 
log a support ticket
move your static files off onto a CDN like MaxCDN or Amazon Cloudfront.
tijn, thanks for your suggestions. I didn't want to put stuff on a CDN yet because I assumed that page load times would decrease already, at least slightly, by changing from shared to VPS hosting.
I played around with it a bit more now and found out the reason for this: SSL certificate! If I turn it off (have forced all redirects of the domain to go through https via htaccess), the page loads in between 2-4 seconds, just like all the other domains on that hosting account. I want to force stuff through https since this is my tracking domain.
How can you have everything go through https WITHOUT such a huge increase in page load? Since this is the tracking domain, it obviously has to load pages quickly 
Any ideas? (not talking about CDN, shrinking file size etc.) Anyone else having this problem with their SSL tracker domain?
I just typed up a long reply and VB decided to eat it, lovely.
The reason in short is SSL requires a lot more processing and the browser has to do a lot more work to send request get request send get send get ect. The pingdom page load speed test seems to be pretty inaccurate as well, It's all over the place during the day, I use it often.
Unless the page HAS to be served in SSL don't. Correct me if I'm wrong, don't you only need SSL for post back pixels?
Thanks for your reply Tyler, appreciate it.