Hi,
I've been looking at Optimizely and VWO; does anyone have any experience in using these services? Are they worth using to split-test different landing page variations?
Thank you!
Yes I use Optimizely and I like it. I've had some very technical requirements, due to long forms on my sites, and their support has been excellent in figuring out the best way to test variations.
For simple tests its really easy to set up and get going.
i use optimizely. its super easy to use.
love it.
Yeh we use Optimizely as well. Best out of the bunch.
Optimizely is great. It's easy to implement and run tests while taking the guesswork out of determining your winning campaigns.
What's the effect on loading speed from running Optimizely? I'm always dubious about anything that involves a call to a third-party server before the page loads.
Looks interesting, though - anyone know if their multivariate testing is just full-factorial or something a bit smarter?
They are great tools, but you should not use them blindly.
You should at least know the basics of statistics yourself, and also to understand what type of tests they are using, including whether they are one-tailed or two-tailed tests.
LOL, on one-tailed tests (the default for VWO and Optimizely) it is very easy to test the exact SAME landing pages and get a result showing that one version is massively better than the exact same version if you are not careful.
If you don't understand statistics, you will blindly accept and make spending decisions based on ridiculously nonsensical results like this:

Indeed, one guy almost got fired because he did not really understand what he was doing with these tools and even wrote a blog post about it: http://blog.sumall.com/journal/optim...#ixzz3YRz5PNyr
So according to that article, optimizely is crap?