We recently concluded some interesting A/B/n tests for an online driving school’s landing page. I thought I’d share the results, as it’s a great example of the distinction between usable design and persuasive design.

We restricted our test to the main content area of the page.

To help develop test hypotheses, we conducted a heuristic usability review of the page. Then we threw in a few informal user tests for good measure. Our subjects were not carefully screened and did not closely match the target group, but we usually figure “any test is better than no test”. Afterward, we were quite confident in our hypotheses, which included:

  • The most important conversion event was an online course registration. Yet the link to the registration forms was merely one of four grey buttons of identical size and design. We hypothesized that we could increase conversions by making the most important button much more prominent.
  • The page contained four sections with non-stop animation. We believed this was a huge distraction and hypothesized that conversions would increase if we froze the central area of animation and placed bulleted benefits there instead.

We produced three alternate designs that varied somewhat in design.

Then we launched the test, confident of a big win. Yet after four weeks, Google Website Optimizer had still not revealed a winner. In fact, one version was actually performing slightly worse than the original!

Back to the drawing board. We brought in a fresh set of eyes (thanks, Darcy). He agreed that the revised versions were certainly more usable, but noted that they weren’t as much fun. Could it be that for this particular target market, the animation we found distracting and annoying was actually stimulating and motivational?

We stopped the original test and developed a new one. We revised our test page, adding the animation back in and putting the bulleted benefits below it.

It worked! After a few weeks, GWO declared our revised page a winner. It was converting over 15% better than the original. Which is a big deal, because in this experiment, a conversion was an actual sale. This test should pay for itself in just a few weeks, and from there on it’s all profit for our client.

For me, there were two main takeaways. First, more usable does not always mean more effective or persuasive. In this particular case, perhaps our target audience needed a bit more visual stimulation to hold their interest.

Second, though I still advocate that “any user test is better than no user test”, I’ll add the caveat that sometimes user tests can be misleading. Sometimes — especially when you’re trying to establish how persuasive a site is rather than just how usable — it’s important to recruit subjects who closely match the target audience. In this particular case, our test subjects were probably somewhat too sophisticated and (dare I say it?) cynical. Even if they found the animation to be fun and engaging, perhaps they thought it would be uncool to admit it.

Message Sent

Thank you for registering.

Cardinal Path hosted a live session to connect with you and answer all your questions on Google Analytics.
Get all the expertise and none of the consultancy fees in this not-to-be-missed, rapid-fire virtual event.

Thank you for submitting the form.

Thank you for submitting the form.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you.

Click here to download access the tool.

Message Sent

Thank you for registering.

Message Sent

Thank you.

Message Sent

Thank you.

Message Sent

Thank you

Message Sent

Thank you

Message Sent

Thank you.

Message Sent

Thank you

Message Sent

Thank you.

Message Sent

Success!
Your message was received.

Thank you.

Thank you for registering.

Cardinal Path is continuing with its series of free training. Next we are conducting training on Google Data Studio. Check it out here.

Message Sent

Thank you for registering.

Thank you for your submission.

Your request has been submitted and a rep will reach out to you shortly.

Message Sent

Thank you for your interest.

Thank you for registering.

You should receive a confirmation email from GoToWebinar with your unique webinar login information. If you do not receive this email or have trouble logging in to the event, please email asmaa.mourad@cardinalpath.com.

Thank you for subscribing!

You're now looped into the world's largest GMP resource hub!

Thank you for your submission.

Thank you for your submission.

Thank you for your submission.

Thank you for your submission.

Message Sent

Thank you for registering.

Message Sent

Thank you for your submission.

Thank you for your submission.

Message Sent

Thank you for registering.

Thank you for registering.​

Paid media spend by Government websites increased a whopping 139% YoY in 2020.

2020 Online Behavior Live Dashboard

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

2020 Online Behavior Live Dashboard

Thank you for your submission.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Success! Thank you
for reaching out.