Cardinal Path’s response to COVID-19 Cardinal Path is sharing all we know to help marketers during COVID-19.  Learn more.

It goes without saying that when you want to make a change to your website, that it is a great idea to introduce the new changes via an A/B or Multivariate test. The tests will let you know quantitatively whether or not the changes that were made helped or hindered your web visitors and your business.

When design your test there are a few things to consider. Should one do an A/B test or a multivariate test?
How many combinations should the multivariate test include?

As a rule of thumb A/B/n test are good for testing one layout versus another (even though it is best to only vary one variable in a true A/B/n test) or when you don't have many successful conversions that will occur in a one month time period.

When doing a first test it is often best to do an A/B test to get a quick win and convince others in your firm of the value in testing changes to your website.

If your firm has already seen the light then you may want to move to multivariate testing. One thing to be careful of when running a multivariate tests is the number of combinations that are created when you design your test. You want to make sure that your site will be able to produce 100 successful conversions per combination in a month. So that means that if your site currently gets 700 people a month filling out your lead form and you want to test some new options that you shouldn't have more than 7 combinations in your test. Having 100 conversions per combination helps with the statistical significance of the test and having it complete in a month enables you to implement changes without waiting forever for result. If you can get results in 3 weeks as a results of a large number of success that is great, but when design a test a good rule of thumb is 100 successful conversion per combination in a month.

Too many people create tests that have too many combinations as a result of testing too many small changes. Focus on bigger items and fewer of them.

Sharing is caring!

Popular

COVID-19 Crisis Navigator​

In partnership with Dentsu, Cardinal Path helps you distill the overwhelming news and information into a bi-weekly report highlighting emerging trends and insights during the pandemic.

EXPLORE THE REPORT

Analytics Rising Logo

FREE VIRTUAL EVENT

October 14

Practical Strategies Delivered By Leaders of Digital Marketing

Register for #AnalyticsRising and get a Starbuck’s Gift Card when you share the news.

Message Sent

Thank you.

Click here to download access the tool.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you.

Message Sent

Thank you.

Message Sent

Thank you

Message Sent

Thank you

Message Sent

Thank you.

Message Sent

Thank you

Message Sent

Thank you.

Message Sent

Success!
Your message was received.

Thank you.

Message Sent

Thank you for registering.

Thank you for submitting the form.

Thank you for your submission.

Thank you for your submission.

Thank you for your submission.

Message Sent

Thank you for registering.

Thank you for your submission.

Message Sent

Thank you for registering.

Thank you for registering.​

Paid media spend by Government websites increased a whopping 139% YoY in 2020.

2020 Online Behavior Live Dashboard

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

2020 Online Behavior Live Dashboard

Message Sent

Thank you for registering.

Thank you for submitting the form.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Message Sent

Thank you for your submission.

Message Sent

Thank you for registering.

Message Sent

Thank you for registering.

Thank you for registering.

Cardinal Path is continuing with its series of free training. Next we are conducting training on Google Data Studio. Check it out here.
Cardinal Path hosted a live session to connect with you and answer all your questions on Google Analytics.
Get all the expertise and none of the consultancy fees in this not-to-be-missed, rapid-fire virtual event.

Message Sent

Success! Thank you
for reaching out.