A/B Testing Tools Comparison

For Google Optimize Free, Google Optimize 360, and Convert Experiences


(LAST UPDATED: NOV, 18TH, 2016)
Convert Experiences
Professional Team 1
Google Optimize Free
Optimize Free
Google Optimize 360
Optimize 360
Optimizely
Enterprise
Price >$499 USD a month Free >$150,000 USD a year >$35,000 USD a year
Features
Available Now Now Now Now
Privacy Servers in Germany Servers in USA Servers in USA Unknown
Footprint Carbon Neutral Infra. Unknown Unknown Unknown
Experiment Traffic – Counting Methodology Visitor-based Session-based Session-based Visitor-based
Number of experiments Unlimited 3 Concurrent Unlimited Unlimited
Targeting Metric Unlimited 3 Max. Unlimited Unlimited
Chrome plugin Yes, optional Yes, essential Yes, essential No, partner made one
Free Starter Plan Offered as one service Offered as one service Offered as one service Offered as a separate service
Multivariate Experiments Yes Yes, Max. 16 Variations Yes Yes
Statistical Significance Methodology 2-tailed Z-test Bayesian Method Bayesian Method 2-tailed likelihood ratio test and false discovery rate control
Integration with Google Analytics 360 Near Native (Automated Tracking) Native Native Third Party
Experiment Scheduler (schedule tests to start & stop at a specific time) Yes (all plans) No No Yes (for enterprise plans)
Customer Support Web-based Email, Chat and Phone No Web-based Email Agency Support Web-based Email (depends on plan), Phone (depends on plan)
Shareable test reports Yes No (but you can share a custom report created in Google Analytics) No (but you can share a custom report created in Google Analytics) Yes
Analytics goals for testing Yes, Import is available if the specific experiment is integrated with an Analytics custom dimension and a custom report is created Yes (automatically available within the Experiment dashboard) Yes (automatically available within the Experiment dashboard) Not available within Optimizely’s dashboard; it’s only available if the specific experiment is integrated with an Analytics custom dimension and a custom report is created
Requirements before using the testing platform Add Convert code snippet to your site Have a Google Analytics account; add Google Optimize code snippet to your site; use Chrome web browser to create test, and download the Google Optimize Chrome Extension in order to create your test (this isn’t necessary to view test results) Have a Google Analytics account; add Google Optimize 360 code snippet to your site; use Chrome web browser to create test, and download the Google Optimize Chrome Extension in order to create your test (this isn’t necessary to view test results) Add Optimizely code snippet to your site
A/B Experiments
Redirect experiments
Testing and personalization services
Preview experiment on different devices (desktop, tablet, mobile)
User-friendly visual editor
HTML, Javascript, and CSS edits
jQuery Edit of Variation Code
Geotargeting
Target data layer variables from Google Tag Manager for testing
Unlimited Projects / Sub Accounts
Multi-page experiments
Use of non-analytics goals as experiments goals
Ability to prioritize customized experiences, where users may qualify for more than one experience
Third-party integration with heat mapping technology (e.g. ClickTale, CrazyEgg)
View changes made to a specific experiment
View dashboard change history
Mobile SDK
API making variations
Mobile app testing
Access to Google Analytics audience segments for testing
Add code snippet within Google Tag Manager
Convert Experiences

Professional Team 1

  • Price: >$499 USD a month
Are you an A/B testing Pro? This plan with lots of features like advanced targeting (cookie, javascript, ecommerce, geo-targeting) and email, chat and phone support. With 500K unique tested visitors you should be able to get some great results and you can grow this plan with 100,000 visitors each time you hit your max.
Google Optimize

Optimize Free

  • Price: Free
Free offer (invite-only during beta period) for small to medium-sized businesses that are just getting started with testing and experimentation. Bayesian methodology to help get the variation performance based on session statistics. Limited to 3 experiments and limited multivariate testing to 16. User friendly visual editor. Self-service help.
Google Optimize 360

Google Optimize 360

  • Price: >$150,000 USD a year
Premium, enterprise-class testing and personalization solution for larger enterprises with more complex testing needs. Bayesian methodology to help get the variation performance based on session statistics. Unlimited number of experiments and unlimited multivariate testing. User friendly visual editor. Native integration with Analytics 360. Enterprise-level support service.
Optimizely

Enterprise Plan

  • Price Per Month: >$35,000 USD a year
You need mobile app testing combined with website testing, this is probably your best pick. Optimizely did a great job merging the two at a very attractive rate. Enterprise features combined less expensive that tools like Adobe & Webtrends.
 
(15 days free)

4000+ Websites use Convert