Home > Technical & Creative Skills > Design - Imagery, Banners & Landers

Google Translator VS OneHourTranslation! [RESULTS inside] (13)


05-04-2012 05:09 PM #1 stackman (Administrator)
Google Translator VS OneHourTranslation! [RESULTS inside]

PRE-DETAILS

I have always hated on google translator as a translation process for anything. The grammar is broken.. that's a fact. Human translation is always better!
…BUT does that necessarily mean it will convert better?

Sometimes i've split tested buttons that said "clicke now" or "clickk now" and they would out perform the proper spellings. So in the back of my mind i always thought the broken grammar from google translator would increase CTR, but not necessarily conversion rate (this was just a hunch though).

So i set out on a journey through the wild affiliate kingdom to see exactly how the following would compare head to head.
1. Google Translator
2. One Hour Translator
3. A Friend Translator (using slang terms in the text)

#3 was added into the case study to use "slang" in the text, instead of 100% proper wording. Also to compare the quality of one hour translation.


WHAT DID WE TEST?

So after some deliberation, dating was decided upon.. dating in Italy.
Traffic source: Adperium (they only allow mild style ads, nothing even close to risque)
Offer: C-Date [IT]
Targeting: Men looking for women

The ads and landing pages we're your average dating pages. Nothing too fancy was incorporated. We stuck to telling the user:
- That the women on the site are active users who message frequently
- No empty inboxes
- Signups won't be free forever
- Included a testimonial

3 separate landing pages we're rotated, each with 1 of the types of translations.


THE GOODS (stats)

*This case study only had 1 purpose, which was to see what type of translation would convert the best.

One Hour Translation
- 1240 clicks to offer
- 12 leads

Friend Translation
- 1230 clicks to offer
- 12 leads

Google Translation
- 1163 clicks to offer
- 17 leads


CONCLUSIONS

THATS RIGHT! GOOGLE TRANSLATOR CONVERTED AT 30% HIGHER THAN BOTH HUMAN TRANSLATIONS.
…weird! yep

Also:
- My initial hunch of higher CTR from google translator was incorrect
- Both human translations converted near exactly the same

That's what you get when you split test the unexpected. Now I'm not saying go completely abandon one hour translation, because this may not happen 100% of the time. but.. the more you know.


05-04-2012 05:24 PM #2 novad (Member)

I don't see any scientific reasons for this apart of twisting the mind of the reader with non-sens sentences and syntax...


05-04-2012 08:18 PM #3 rich (Member)

Maybe they thought the women would be easier :P


05-05-2012 07:26 PM #4 kokofai ()

Great case study but I would say the results are not significant enough. Apart from the clicks, I would say let the campaign run for 1 week and see what will be the end result.

I'm not trying to criticize because Jordan, I really appreciate you for spending your time and money to put up this case study. Would appreciate even more if this case study could be run longer to get a more significant result.


05-05-2012 11:13 PM #5 grikis (Member)

Would be interesting to see ad impressions and CTR comparison.
Did you test this on PPV?


05-06-2012 12:56 AM #6 tical (Member)

The psychology behind them "correcting" the verbiage in their mind actually helps them better receive your message. I believe the explanation of this "phenomenon" is closely related to the social psychology theories of capturing and disrupting attention.

Here are some good reads from a social psychology textbook of mine (the chapter is "Social Influence and Persuasion"). If anyone want's the PDF just drop me a line, I have it scanned.

Pique Technique. Often when panhandlers
approach us, they ask "Can you spare a quarter?" or
"Can you spare any change?" People who live in large
cities have heard these requests so many times that
they often just ignore the panhandler and move on.
Pedestrians have a refusal script in mind the instant
they see a panhandler, such as "Sorry, I don't have
any change." To be effective, the panhandler must
disrupt this refusal script and capture the pedestrian's
attention. The pique technique captures the
pedestrian's attention by making the request novel.
Instead of asking whether the pedestrian can spare
any change, for example, the panhandler could ask
whether the pedestrian can spare 17 cents.
In one study (Santos, Leve, & Pratkanis, 1994),
confederates disguised as panhandlers asked pedestrians
whether they had any change, or they asked
them whether they had 17 cents. The results showed
that 37% of pedestrians complied with the 17 cents
request, whereas only 23% complied with the spare
change request. It helps to grab people's attention
before they tune out.
Disrupt-Then-Reframe. In the disrupt-thenreframe
technique, a non sequitur or unexpected
element is introduced to provide a momentary disruption.
The disruption absorbs critical thinking
functions and prevents individuals from processing
the persuasive message. The requester then reframes
the message in a positive light.
For example, researchers managed to disrupt
attention by stating the price of Christmas cards
in pennies (rather than dollars) before stating, "It's
a bargain!" (Davis & Knowles, 1999). When homeowners
were told that a package of eight cards cost
$3.00, about 40% of the homeowners bought the
cards. When homeowners were told the cards cost
300 pennies (the disruption), "which is a bargain"
(the reframing), about 80% of the homeowners
bought the cards. In another study (Knowles & Linn,
2004), people were more likely to buy cupcakes at
a bake sale when they were called "halfcakes" rather
than "cupcakes" before the seller declared "They're
delicious!" To work, this technique requires both the
disruption and the reframing, in that order. Distraction
prevents people from processing persuasive messages
at a deep level.
Looking forward to seeing skin care trials being advertised for "one-hundred and ninety five pennies!"


05-06-2012 01:40 AM #7 grizzlymaze (Member)

haha... that's crazy. Looks like it's back to Google Translator lol jks.


05-06-2012 01:46 AM #8 maynzie (Moderator)

That's a rad as case study,

Did you get the google translate professionally untranslated to see what it really said man haha,

But yeah thats a split test and a half, this game constantly surprises me lol


05-06-2012 05:07 AM #9 rileypool (Member)

Quote Originally Posted by kokofai View Post
Great case study but I would say the results are not significant enough. Apart from the clicks, I would say let the campaign run for 1 week and see what will be the end result.
An average of over 1200 clicks to the offer (not counting clicks to the lander) isn't significant enough for you?

I don't know why this worked out the way it did, but its' a significant amount data.


05-07-2012 03:46 AM #10 inversion (Member)

You guys will love this.

Paste this in google translate, with the "from" language to English and the "to" language to German. Then click the Listen icon in the german box.

pv zk bschk pv zk pv bschk zk pv zk bschk pv zk pv bschk zk bschk pv bschk bschk pv kkkkkkkkkk bschk bschk bschk pv zk bschk pv zk pv bschk zk pv zk bschk pv zk pv bschk zk bschk pv bschk bschk pv kkkkkkkkkk bschk bschk bschk pv zk bschk pv zk pv bschk zk pv zk bschk pv zk pv bschk zk bschk pv bschk bschk pv kkkkkkkkkk bschk bschk bschk pv zk bschk pv zk pv bschk zk pv zk bschk pv zk pv bschk zk bschk pv bschk bschk pv kkkkkkkkkk bschk bschk bschk pv zk bschk pv zk pv bschk zk pv zk bschk pv zk pv bschk zk bschk pv bschk bschk pv kkkkkkkkkk bschk bschk bschk


05-07-2012 06:11 AM #11 wyffgoal (Member)

^ This has been there for a while, beat box eh? haha


05-07-2012 06:42 AM #12 bmcadvertising (Member)

Quote Originally Posted by rileypool View Post
An average of over 1200 clicks to the offer (not counting clicks to the lander) isn't significant enough for you?

I don't know why this worked out the way it did, but its' a significant amount data.
Depends on the placements. What if those 1200 clicks were spread out to 60 different sites (I don't know how Adperium works). 20 clicks per site is not close to statistically significant.

The difference between 12 and 17 conversions on a likely $3 dating offer is statistically insignificant, although I hope my competition thinks otherwise.


05-08-2012 01:47 AM #13 Ryan Eagle ()

One hours translation is absolutely fucking horrible, but it's really one of the only options I have.


Home > Technical & Creative Skills > Design - Imagery, Banners & Landers