Home > Questions and Answers > General Questions

Does anyone use Optimizely or VWO for split-testing? (8)


01-20-2014 07:27 PM #1 olimits7 (Member)
Does anyone use Optimizely or VWO for split-testing?

Hi,

I've been looking at Optimizely and VWO; does anyone have any experience in using these services? Are they worth using to split-test different landing page variations?

Thank you!


01-21-2014 11:28 AM #2 solaris (Member)

Yes I use Optimizely and I like it. I've had some very technical requirements, due to long forms on my sites, and their support has been excellent in figuring out the best way to test variations.
For simple tests its really easy to set up and get going.


01-21-2014 01:39 PM #3 dconstrukt (Member)

i use optimizely. its super easy to use.

love it.


01-22-2014 10:17 AM #4 grandtheftpixel (Senior Member)

Yeh we use Optimizely as well. Best out of the bunch.


02-01-2014 04:08 AM #5 socialevo (Member)

Optimizely is great. It's easy to implement and run tests while taking the guesswork out of determining your winning campaigns.


02-01-2014 11:54 AM #6 caurmen (Administrator)

What's the effect on loading speed from running Optimizely? I'm always dubious about anything that involves a call to a third-party server before the page loads.

Looks interesting, though - anyone know if their multivariate testing is just full-factorial or something a bit smarter?


04-26-2015 08:54 PM #7 cmdeal (Veteran Member)

They are great tools, but you should not use them blindly.

You should at least know the basics of statistics yourself, and also to understand what type of tests they are using, including whether they are one-tailed or two-tailed tests.

LOL, on one-tailed tests (the default for VWO and Optimizely) it is very easy to test the exact SAME landing pages and get a result showing that one version is massively better than the exact same version if you are not careful.

If you don't understand statistics, you will blindly accept and make spending decisions based on ridiculously nonsensical results like this:






Indeed, one guy almost got fired because he did not really understand what he was doing with these tools and even wrote a blog post about it: http://blog.sumall.com/journal/optim...#ixzz3YRz5PNyr


03-10-2017 10:33 PM #8 clickspark (Member)

So according to that article, optimizely is crap?


Home > Questions and Answers > General Questions