What are tested users (MTUs), and what happens if I go over my quota?

Tested users are the site visitors actually bucketed into experiments you’re running, not your total traffic, and overlaps are disregarded: a visitor who sees three of your tests counts once. If your traffic spikes past your plan’s limit, nothing gets cancelled; A/B testing should support growth, so Convert alerts you at 90% and 100% of your allotment, and beyond that you can purchase additional tested users at $399 per 100,000 on Growth or $699 per 250,000 on Pro. Scale isn’t a concern either way: Convert has served high-traffic sites for over a decade on the Akamai CDN.

What AI features does Convert Experiences support?

Convert understands that AI has dramatically shifted the way experimenters, marketers, growth professionals, and product leaders make decisions and run tests. However, our own agency AI usage research shows that AI compresses certain parts of the flywheel. But it doesn’t improve or impact the speed to results for others. Many AI inclusions require strict guardrails to implement. And unwanted access to sensitive data is always a challenge. The AI features at Convert are designed to give you scale and momentum, without giving up on privacy, data integrity, and the human judgment. Our MCP server is highly-regarded as very well-built. It not only queries your account data and our dev repositories, it also builds, edits, deploys tests and experiences with granular control & complete safety. The power of the MCP server finds home in-app as Convert Intelligence® . Yes, you can use it to conduct prompt-based, natural language experimentation. Most importantly, it is a guide that sits on top of 17 years of testing know-how from our brand. It helps you learn the platform better and improve the way you run tests. Approval flows. Not an AI-assisted feature. But one every AI-savvy and multi-stakeholder team needs. It adds a human-in-the-loop as a reviewer for high-stakes actions like putting experiments live.

Does Convert Experiences apply sampling?

No. Convert Experiences reports are based on unsampled data. This means our stats engines consider all the data collected by your set-up to call winners, thereby bypassing the issue introduced by most digital analytics platforms.

Does Convert Experiences allow server side testing?

Convert Experiences started out as a client-side A/B testing tool . But over the years we have received multiple requests from users who would like to include server-side testing to their optimization mix. As a result we do support server-side A/B testing through the manual creation of a Convert custom cookie which can determine Experiment ID/Variation ID, and programmatically assign it to website visitors.

How well does Convert Experiences work with Single Page Applications (SPA)?

In the standard format Convert Experiences takes note of the URLs website visitors navigate to trigger experiments (and goals). But with Single Page Applications (SPAs), this is not the case. Thus SPAs have to be handled differently. Our tool is capable of doing that. We use custom code to start polling for both when an experiment should be triggered on a page, and when a goal should be fired. We have detailed documentation in our support repository to walk users through this process for various SPAs like React/Redux and Angular.

How can you track revenue/transactions for eCommerce stores using Convert Experiences?

Convert Experiences has robust revenue tracking and it is privacy friendly as well. If you have the latest version of Google Analytics ecommerce tracking running on your store and the Convert tracking code is duly added after the tag, then we automatically connect revenue tracking to your experiments. You can also set up a revenue goal manually, count multiple transactions per customer, and track revenue attributed to actions that are not accompanied by URL changes.

Will my page load speed be impacted by the installation of Convert Experiences tracking code?

Convert Experiences is one of the fastest loading A/B testing tools in the optimization space. Through the use of our patent-pending SmartInsert™ Technology, we can offer you the advantage of fast loading time, and no flashing. Learn more here .

Do I need to ask consent from site visitors before testing with Convert Experiences?

No As long as you use Convert Experiences in its default setting, you do not need to ask consent from your website visitors and browsers. This is because we don’t store any personal data in the default, and use only first party cookies. If however you need to target audiences by city, or enable cross domain linking, you will see in-app GDPR warnings that are designed to let you test to your fullest potential while staying on the safe side of privacy.

What are must-have features for an A/B testing tool?

An A/B testing tool is obviously a key part of any conversion rate optimization drive. In recent times though there has been a definite shift in the way leaders, businesses and experts perceive optimization & experimentation. The discipline of CRO is no longer restricted to only conversion rates. The sentiment is swaying towards: Customer Experience Optimization (CXO). Learning from smaller experiment wins in the short term to benefit in the long haul Leveraging testing to mitigate risks in decisions across web design, revenue generation, product development, and Ops. “Recruiting” experimentation champions not just in the C-suite but across the entire organization, and doing this in an organized way. These shifts prove that even though experimentation & A/B testing are a rigorous science, the success of experiments largely rely on people and the extent to which a culture of experimentation is inculcated in them. Do they obsess over a few lifts in the present or do they get the value of being truly experiment driven for robust decision-making and a more mature, sustainable business model? How this is achieved is going to be unique to an organization and not defined by “tools”. Hence A/B testing tools should first and foremost provide flexibility, reliability, and support. These vendors too should have a culture of putting people (users) first over constant, forced price upgrades, the bureaucracy of gated pricing, and the tendency to tier important features like APl access, integrations, QA by exorbitantly priced anual plans. Want to learn more about the culture at Convert? Come meet our team.

Kayla Matthews, Author at A/B Testing Software

Kayla Matthews

Kayla is a digital tech journalist, researcher, writer and blogger covering topics related to smart gadgets, the future of work and personal productivity. Her work has been featured on Outbrain, Convince and Convert, Contently, Marketing Dive, The Week, The Next Web, Lifehacker, Mashable, The Daily Dot, WIRED and others.

Topic:

Author:

A/B Testing 02 Jun, 2020

6 A/B Tests You Can Run on Your E-Commerce Cart

By Kayla Matthews

Any successful e-commerce business aims to increase conversions. A/B testing — also called split testing — can aid in achieving that goal. A/B testing involves showing two different versions of something to different groups to see which one performs better. A/B testing offers numerous advantages. For example, it helps you...

Privacy 25 May, 2020

How to Prepare for the Coming Cookie Disruption — 6 Steps to Take

By Kayla Matthews

Cookies, the little pieces of data websites collect from users, are becoming a lot less relevant due to recent events. Don't be mistaken, though. The search for more data is at an all-time high and will continue to climb in the coming years. Cookies just aren't one of the best...

The Convert Experiences blog has a great mix of current news, information, and useful guides

The topics covered are varied, including transparency & privacy, technical writeups, best practices, and industry roundups, all while staying relevant to marketers and optimizers of all skill levels.

Articles are backed up by practical, real-world examples and vetted by industry experts, so new pieces are always relevant with the most up-to-date information. It is one of my go-to sources for CRO focused content!

Matt Beischel

Founder & CEO, CorvusCRO

Your Blog Section is a great resource for both brands and marketers

I love the content you publish at Convert. I appreciate the time you take to produce such insightful posts on various marketing-related topics.

The majority of posts include real examples from brands and marketing campaigns, which is a great value addition for your readers. I personally enjoy many of your expert roundup posts, case studies, and the latest marketing tactics you cover.

Shane Barker

Digital Marketing Consultant and strategist

Convert Blog: Learn A/B Testing, Optimization & Marketing

Kayla Matthews

Blog Posts

6 A/B Tests You Can Run on Your E-Commerce Cart

How to Prepare for the Coming Cookie Disruption — 6 Steps to Take

Important. Please Read.