Whenever we’re about to launch a new experiment, I always give clients the same speech. It goes something like this:

“You probably won’t be able to resist logging into GWO and checking the results every day. But always bear in mind that experiments cannot yield reliable results until they have run long enough to gather sufficient data. Early results are often surprising — even alarming — but you must resist jumping to conclusions. Let the experiment run its course.”

Now I have a confession to make: I sometimes have a very hard timing taking my own advice. A recent example comes to mind.

We were running an A/B test of a lead-generation form for a Financial Institution. Our revised (“B”) version quickly took the lead over the original. Within a week or so, it was showing an improvement of about 200%! We were astonished, and of course we started congratulating ourselves on how clever we were.

Luckily, we didn’t share our internal boasting with the client. Because over the next few weeks, we watched in dismay as our lead fell to 150%… to 100%… to 50%… and eventually settled at around 20%. Still respectable, but imagine how bad we’d have looked if we had told the clients we’d given them a 200% lift!

In other cases, we’ve seen GWO declare a winner, only to “undeclared” it the next day. You can’t rely entirely on what the tool is telling you.

So when can you confidently say the experiment has run its course? I’d suggest a good rule of thumb is, when all three of these criteria are met:

  • The experiment has run for at least two weeks (preferably longer)
  • Each version of your page has 100 or more conversions, and
  • Google declares a winner

Don’t trust what small numbers tell you. Be patient… difficult as it is.

Message Sent

Thank you for registering.

Cardinal Path hosted a live session to connect with you and answer all your questions on Google Analytics.
Get all the expertise and none of the consultancy fees in this not-to-be-missed, rapid-fire virtual event.

Thank you for submitting the form.

Thank you for submitting the form.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you.

Click here to download access the tool.

Message Sent

Thank you for registering.

Message Sent

Thank you.

Message Sent

Thank you.

Message Sent

Thank you

Message Sent

Thank you

Message Sent

Thank you.

Message Sent

Thank you

Message Sent

Thank you.

Message Sent

Success!
Your message was received.

Thank you.

Thank you for registering.

Cardinal Path is continuing with its series of free training. Next we are conducting training on Google Data Studio. Check it out here.

Message Sent

Thank you for registering.

Thank you for your submission.

Your request has been submitted and a rep will reach out to you shortly.

Message Sent

Thank you for your interest.

Thank you for registering.

You should receive a confirmation email from GoToWebinar with your unique webinar login information. If you do not receive this email or have trouble logging in to the event, please email asmaa.mourad@cardinalpath.com.

Thank you for subscribing!

You're now looped into the world's largest GMP resource hub!

Thank you for your submission.

Thank you for your submission.

Thank you for your submission.

Thank you for your submission.

Message Sent

Thank you for registering.

Message Sent

Thank you for your submission.

Thank you for your submission.

Message Sent

Thank you for registering.

Thank you for registering.​

Paid media spend by Government websites increased a whopping 139% YoY in 2020.

2020 Online Behavior Live Dashboard

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

2020 Online Behavior Live Dashboard

Thank you for your submission.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Success! Thank you
for reaching out.