A/B tests allow you to compare two versions of the same product and monitor the effectiveness of small changes in design. If you own a website, an app, or any other digital product, this method can help you test the changes that convert more and find out how can they improve the user experience through the analysis of conversion statistics and usability of the different versions. If the new version works best, you define it as winner and it starts to be displayed for 100% of the audience.
Big companies like Facebook, Google and Microsoft often perform A / B testing to improve their products. You probably should have already participated in one of these tests while surfing the internet and did not even notice.
An A/B test conducted by Facebook in 2014 indicated that when users opened the social network application for iOS and were surprised with a personalized loading animation on Facebook (left), this meant that they blamed the application by the delay in loading . In a B version of the app, presented to only a few users, an iOS native circular spinner (right) was displayed instead of Facebook’s default. Experience has shown that with this, users were less likely to blame the Facebook app and put the blame of the slowness on the OS.
#renio interesting! Facebook did A/B testing to determine that users blamed FB on left, iOS on right, for slowness. pic.twitter.com/zEVbTime1Q
What to test?
Your choice of what to test will obviously depend on your goals. If you want to increase the number of entries in a form on your website for example, you can test the length of the registration form, field types, privacy policy view, etc. The purpose of the test in this case is to find out what stops visitors to sign up. Is the form very large and intimidating? Are Visitors concerned about privacy?
Or maybe the site is trying to convince other visitors to register? All these questions can be answered, one by one, testing the elements properly.
Some examples of what can be tested on a website:
Using Google Analytics to perform the tests
Since 2012, A/B testing can be done via Google Analytics. There is a tab within the tool to help you in the test creation process.
Google Analytics measures the effectiveness of each version of the page, and, with an advanced engine statistics, determines the most effective version.
The tool also provides a different model of tests, allowing to analyze two or more versions of the same page (multivariate tests A/B/N). They may be small changes, or you can test completely modified pages for specific groups of users from different URLs. See what you can do:
A/B tests and multivariate tests are excellent resources because they offer real feedback from the market, measured accurately. It is not a simple research in which someone can answer one thing and do another one; but they are consolidated facts. The different versions are distributed randomly in the same duration without risk of external factors influencing the conversion rate, making it a much more reliable result.
Do experiments like this in your company’s products. The results are very satisfactory for you and especially for users who, consequently, will receive an improved version of the product and obtain a better experience.
Read more
This content was originally published here.