fbpx The options | ComputerMinds Skip to main content

The options

A guide to FREE A/B testing on Drupal
An article from ComputerMinds - Building with Drupal in the UK since 2005
29th Jan 2019

Nathan Page

Developer
Series summary

This is our guide to FREE A/B testing.

A/B testing is the resolution to the long-nagging question of whether blue or red is better on the homepage banner. It is the answer to your SEO fella's missing data and it is, potentially, the key to unlocking better customer experiences and higher revenues on your site.

Read our guide to find out your best available options and our experiences.

Read more

If you need to do some A/B testing at minimal cost, this is our quick overview of the available options that we found.

There are some powerful free options, and some free trials for some superb products. As with all things, the free options come with limitations that mean that for some circumstances it may be totally worth paying up for the right product/service. Free is not always better, and paid is not always better! We leave the final decision and hard negotiation to you :)

optimizely

Optimizely has a 30 day trial, then paid plans. No public pricing. Has a Drupal module

Optimizely is a bit like Google Tag Manager. It has a really helpful user interface where you can create, edit and manage your A/B tests easily. You just add the base Optimizely Javascript to your site, and it sorts the rest out by itself. It will load the right code and run the Javascript to make the changes directly on the page, then monitor and report appropriately.

If you're running a big site with budget, this is great. You might be able to get the results you need from a 30 day trial, but they clearly hope you'll like the experience so much that you'll stay.

There is a Drupal module, which helps you add the Optimizely code to your site and control some of its actions. It's not in active development, but has Security Coverage.

VWO

Visual Website Optimizer has a 30 day trial, then paid plans. No public pricing.

VWO is much like Optimizely, and has a bunch of really nice features that make it worth doing if you have some cash available. 30 days will only get you so much data, but if you just need a couple of quick tests, it might be worth trying out.

ABJS

ABJS is a free contrib Drupal module.

ABJS lets you set up and control experiments from a Drupal interface. It's sort of like Optimizely/VWO in that the experiments are all Javascript based, but lacks some of the shiny polish.

If you've ever thought "Surely A/B testing is simple to do yourself- you just need some Javascript and analytics tweaks and you're done!", then ABJS may be for you!

You'll need to wire in your analytics events tracking yourself if you need it, but that's not too scary for most developers. Google Analytics is generally quite a dream to work with nowadays. Plus, we'll have a guide to setting that up later in this series.

 Google: Content Experiments

ContentExperiments is a free offering from Google Analytics.

They're having a really strong go at making the GA platform provide everything you could ever need, and this is a hugely powerful set of tools.

With Content Experiments, you need to create the page variations yourself, then tell Experiments about those variations so that it can work its magic. This is a slightly different way of working, so might be a bit of fuss. But there's probably a way to make it work with Tag Manager and some JS if you want to. As always, Google have made an interface that's nice to work with.

The most interesting tool is the Multi-armed bandit experiment, which can take a number of page variations and rapidly decide which is the most effective for the goals you've specified. This looks to be really useful if you want to compare a selection of different layouts.

Hi, thanks for reading

ComputerMinds are the UK’s Drupal specialists with offices in Bristol and Coventry. We offer a range of Drupal services including Consultancy, Development, Training and Support. Whatever your Drupal problem, we can help.