Tips to Set Up Winning Split URL Tests (and Some Common Mistakes to Avoid) in 2026

Dionysia Kontotasiou
By
Updated ·

If you’ve run experiments before, you’ve probably encountered situations where an A/B test isn’t the right technique. Not because the hypothesis is wrong, but because the change you want to test is too big to build inside an editor.

In cases like this, split URL testing (or redirect testing) can help.

This guide walks through what a split URL test is (and how it differs from A/B testing), how to correctly set up split URL tests in Convert Experiences, and how to avoid some common mistakes.

What Is Split URL Testing?

Split URL testing is a technique that compares two or more distinct versions of a webpage hosted on two different URLs to determine which performs better. The differences being tested are usually too significant or structurally different to be handled within a single page using an editor, e.g., full page redesigns, backend changes, or entirely different page architectures.

Unlike standard A/B tests, where both the original and variation live on the same URL and the testing tool decides which one to render, split URL tests send each variation to its own distinct URL.

When a visitor lands on the original URL, the tool checks their assigned bucket: if they’re in the original group, they stay put; if they’re in a variation group, they’re redirected to that variation’s URL.

Convert Experiences allows you to set up split URLs without having to edit in the Convert Visual Editor. The two most common setups look like this:

  1. Different landing pages on the same domain:
    • Original: www.convert.com/landingpage1
    • Variation: www.convert.com/landingpage2
  2. A subdomain or separate domain for a redesigned page:
    • Original: www.convert.com
    • Variation: www.beta-convert.com

How the Industry Defines Split URL Testing (And Where It Diverges)

We analyzed how eight major experimentation platforms, including VWO, Kameleoon, and OptiMonk, define and categorize split URL testing.

All the tools agree on the fundamentals: separate URLs are required, traffic is split randomly between them, and the method is best suited for large structural changes rather than element-level tweaks.

Beyond that, the framing diverges:

  1. Is it a subtype of A/B testing, or a separate method entirely? Most tools (VWO, Amplitude, Fibr, Intelligems) treat split URL testing as categorically distinct from A/B testing, with the same-URL vs. different-URL distinction as the dividing line.

    Kameleoon and ABsmartly, however, treat it as a variant of A/B testing, which affects how teams plan, choose tools, and scope tests.
  1. The redirect method matters more than most tools acknowledge. Only VWO and Kameleoon are explicit about how their redirect works. VWO deliberately uses a JavaScript (instead of a 302) for SEO reasons, while Kameleoon offers both JS and HTTP 302 depending on whether you’re using their web or server-side SDK.

    The other tools we analyzed are silent on this, which is a gap because the choice of redirect has real implications for both SEO and sample ratio mismatch.
  2. How “different” does the variation need to be? Fibr and Amplitude frame split URL testing as a method requiring fundamentally different experiences: different architectures, different user flows, or different backends.

    But VWO and Intelligems take a looser view and recommend it for any significant page-level change, including landing page swaps from paid traffic. In fact, Intelligems actively recommends it for straightforward cases where others would say a standard A/B test is sufficient.

There’s also a split in what teams are trying to learn.

CRO-native tools like VWO, OptiMonk, and Fibr frame split URL testing around a conversion question: which page converts better? But tools like Amplitude and Kameleoon frame it around behavioral analysis: how does the full user path differ across variants?

It’s the same mechanism, but a different approach to what counts as a useful result. It’s worth knowing which lens your team is operating from before you set up your next test.

Split URL Testing Visual Flow

Here is an example of how Convert serves URLs to visitors bucketed in a Split URL Experience:

Split URL test flow Convert Experiences

Benefits of Split URL Testing

A/B and multivariate Testing are great for quickly evaluating minor changes to UI elements. Most A/B testing software offers A/B and Multivariate Testing capabilities with a user-friendly interface, allowing testing variations to be developed with just a few clicks.

However, when it comes to making significant changes to your website, the Visual Editor provided by these testing solutions falls short. A new web page almost always requires the collaboration of the design, UX, and development teams, making it a much larger undertaking.

Split URL testing provides the flexibility to make these changes without restriction, while still getting the benefits of A/B tests. Convert’s Split URL Experiences are helpful in a number of ways, allowing you to:

  • Try out a completely new design, while keeping the old one in mind. Users are able to compare the reports from two variations to see which features function best in each.
  • Run experiences with changes that aren’t UI-related. Trying to improve page load speeds by switching to a different database? This is just an example of the backend or development changes that affect websites. Split URL Experiences ensure that the modifications that aren’t visible have no negative impact on user experience.
  • Evaluate the functionality of multiple web pages as a unit. Workflows have a significant impact on conversions, and testing new paths before implementing them is an excellent method to see if any issues have been neglected.
  • Improve user experience, with faster connection and better browser performance. While A/B tests can suffer from the flicker effect (which occurs when a Variant loads slowly and clearly in front of the user), Split URL Experiences are capable of loading many sites at once without an issue. (Slow page loading tells users that they are participating in a test, thus skewing the test results.)
  • Test different page designs or content without jeopardizing your conversion rate. By randomly splitting website traffic between the Original version and Variations, you can be sure that any statistically significant variance in performance is related to the experience, rather than factors such as traffic source or time of day.

How to Set Up a Split URL Test in Convert Experiences

Create a Hypothesis

Once you’ve determined why you want to test a specific area of your sales funnel, it’s time to establish a hypothesis. With your hypothesis, you’re attempting to solve a problem by speculating about what might perform better than the existing version.

Maybe you think a promotional banner will boost conversion rates, or that showing shipping fees upfront will increase engagement. These are hypotheses you need to pressure-test before building anything.

Update hypothesis Convert Experiences

If you’re having trouble coming up with viable solutions, have a look at what your competitors are doing. Ask yourself:

  • What are they doing that you aren’t?
  • What stands out most about their pages?
  • Where might you be losing conversions that they’re capturing?

Review evidence from previous tests, consult your team, and make sure there’s a solid rationale behind what you decide to test.

AI tools like ChatGPT, Perplexity, or Claude can help at this stage, whether that’s synthesizing research, surfacing patterns from session data, or stress-testing a hypothesis before you commit to building a whole new page.

However, Ben Labay, CEO of Speero, cautions against treating every AI-generated insight as a reliable input. Instead, he recommends filtering behavior-based insights from opinion-based ones, stress-testing weak evidence, and flagging context-dependent findings before regarding them as universal truths.

Without that scrutiny, you risk building a test on shaky foundations, which is a costly mistake when doing a split URL test.

Determine the Necessary Sample Size

To improve your chances of obtaining useful data, you want to avoid conducting tests that produce statistically insignificant findings, as much as possible. So, before you begin testing, figure out the sample size you’ll need. You can do the math using this calculator.

Input the numbers based on the results you anticipate from your test, and see how the statistical significance appears. If you’re at least at 90%, you’re in pretty good shape.

Convert A/B testing significance calculator

Of course, this isn’t a foolproof solution, but it will increase your chances of success.

Create the Variations outside of Convert

Once you’ve calculated the required sample size based on your informed guess, it’s time to make your Variations.

Since Split URL Experiences do not offer a Visual Editor or Code Editor, you’ll need to design your variations outside of Convert. For example, Johann Van Tonder, CEO of CRO agency AWA Digital, combines AI tools like Claude Code, Codex, Google Stitch, and Magic Patterns to rapidly generate and iterate on page variations.

Johann describes this in the context of A/B testing, but the same approach applies when building variations for a split URL test.

Once your variations are ready, host each one at its own publicly accessible URL so that Convert can split traffic between them and handle the statistical analysis.

Create a New Split URL Test

You can create a new experience in your “Experiment Dashboard” under “New Experience”, in the top right. There are 6 experience types to choose from. Select “Split URL”, and add your Experience Name and the URL of your Original site:

Name split URL in Convert Experiences

Add Variation URLs

You’ll see that the Original URL is filled in on the next screen. This is where you will add the Variation URLs, as well.

You can name each Variation and add more than one Variation using the (plus) icon.

The traffic will be split evenly between your Original and all other Variations.

Create split URL variations in Convert Experiences

Need Regular Expressions? (This is Optional.)

Let’s say you use Google Adwords or any other system that passes variables to your site, and you want to keep that. You can turn on variables with the option “Transfer Original URL Variables to the Variation URL”.

Create a split URL with Regex in Convert Experiences

What this does is create a regular expression. Simply explained, it adds the following code after the Original URL:

/{0,1}(([\?&]{1}[^=]{1,}=[^=]*[&]{0,1})*)$

and it adds $1 to the Variation.

Essentially, the regular expression takes everything that follows a question mark on the URL and pastes it into the Variation where there is a $1 sign.

Verify Targeted Pages

When you click “Continue”, you will be directed to the Experience Summary.

The Locations area is where you will configure the criteria that trigger your experience.

The most basic configuration triggers the experiment based on a URL, such as “https://www.convert.com”.

This setting is automatically configured when you first create your Split URL Experience and will be configured to the URL used to create it.

Make sure to verify the pages where the Split URL Test will be running and adjust the Location accordingly.

update location settings for Split URL Experience.webp

Verify Targeted Audience

Next, you’ll need to verify the Audience and make sure it’s the group of visitors you want to target. If not, you’ll need to specify this by going into its configuration.

Configure targeted audiences for split URL test in Convert Experiences

Verify Goals

You can make lots of different changes in “Experience Summary”, but for now, we will just focus on verifying our goals are set up properly.

Configure goals for split URL test in Convert Experiences

Here are some of the common goals used in Split URL Tests:

  • Conversion rate
  • Clicks on buttons
  • Clicks on links or CTA
  • Newsletter sign-ups
  • Adding to cart
  • Revenue per visitor
  • Engagement
  • Page visits
  • Time spent on page
  • Bounce rate

Add the Domains to the Project Configuration

If your new Variation URL is different from the Original, you’ll need to add it to the Project Configuration. Make sure to add all of the various domains that include your Variation URLs.

To do this, click on “Configuration” in the top menu, then click the “Active Websites” section. Lastly, add the domain URL and save it.

Configure active websites for split URL test in Convert Experiences

Add Convert Script on All Domains

Finally, make sure to install the main Convert tracking code in the <head> section of your pages, and for split URL accuracy place it before analytics code so redirects do not inflate original-page analytics.

Install tracking code for split URL test in Convert Experiences

QA your Test

Before launching your test to the public, double-check that everything is working as it should. Craig Sullivan, Experimentation Consultant at Optimise or Die Ltd., is emphatic about this: a single undetected bug can tank your results, making a winning variation look like a loser.

Here’s his QA process:

  1. Pull your GA data to identify the devices, screens, and setups your visitors actually use. Craig has a free public Looker Studio dashboard for this.
  2. Use that data to draw up a device testing list. Typically four to six devices is enough to cover 90%+ of your audience.
  3. QA the test on those specific devices and setups. Check to make sure you’re being randomly directed to either the Original or the Variation, by visiting the Original URL a few times with an incognito browser window.

    Try converting on both pages a few times, to ensure that the software is accurately tracking and reporting goals.
  1. Confirm your test is free of device-related skew before you go live.

On the subject of which devices to use, Sullivan says:

I always recommend using real devices for QA and general testing. You should never use the Chrome mobile emulator for checking A/B tests targeted at mobile devices. You shouldn’t use simulators of any kind either. Real devices are what matters.

QA split URL experience Convert

Once you’ve confirmed everything is tracking and reporting correctly across your device list, you’re ready to launch.

Analyze Results

When reviewing your results, ask yourself the following:

  • How did your test go?
  • Was your hypothesis correct?
  • Are the results statistically significant?

If all went well, you should be able to identify a clear winner!

split URL experience reporting Convert Experiences

Now, you can either choose to stop testing and set the winner as your new Original, or you can keep testing and iterating.

If you don’t see a clear winner or if your results aren’t statistically significant, try not to get discouraged. This actually happens more than you’d think!

Identify any errors you might have made the first time and run a new test.

split URL experience reporting winner Convert Experiences

Hybrid Test: Split URL Test + Deploy

Let’s say your Split URL Test has been created, configured and tested, and everything is going according to plan. Say your traffic is being evenly distributed, your query parameters are being transferred, your audiences and specific goals are all set, and now you want to try out new styles for your experience pages.

Since Split URL Tests lack the capability to customize and style pages through the Visual Editor, one option you might consider is setting up a “hybrid” experiment (Split URL + Deploy Experience).

How to Set up Your “Hybrid” Experiment

Start by creating your Split URL Experience as directed in the previous section.

Get the Experience and Variation IDs

Once you have finished configuring the Variations of the experience, take note of the Variation IDs from the Experience summary page. Copy the link from the preview of the Variation:

preview variation Convert Experiences

The link copied will look something like this:

https://url.com/?convert_action=convert_vpreview&convert_v=100368636&convert_e=10036216

●    v=100368636 -This is the Variation ID: 100368636
●    e=10036216 - This is the Experience ID: 10036216

Set up a Deploy for Your Variation Page

Now it is time to create a deployment for your Variation page. Use the Visual Editor to apply styles and customize the page.

convert Visual Editor

Try Convert Deploy: Click & Edit Ease for Your Web Needs.

Set up a Custom Audience for Your Deploy

If you only want visitors from the Split URL Experience and the specific Variation to see your deployment, you must include a Custom Audience:

Custom Audience Deploy Convert Experiences

Visitor cookie: (replace with the Experience and Variation ID previously noted)

conv_v contains xxxxxxxxx.{v.yyyyyyyy

This is it! You have successfully applied styles to a Split URL Experience!

Set up a Multipage Split URL Test

Now, let’s say you want to do a Split URL Test for multiple pages on your site (such as product pages). Reference this article on multipage tests and the chart below:

multipage split URL experiment flow

Run Multiple Split URL Tests Simultaneously

There may come a time when you need to conduct two or more Split URL Tests on the same website. Here are your options:

  1. Run the tests simultaneously, without having to worry about them interfering with one another.
  2. Carry out the tests at the same time but with different audiences
  3. Perform the tests in order (complete test 1 before moving on to test 2).

Although Option 3 is the safest, it will severely limit your abilities with Split URL Experiences.

It’s totally possible to run a few simultaneous Split URL Experiences on the same page or set of pages, but be aware that bucketing in one experiment can impact the data of another experiment that is running simultaneously.

Here’s the ideal way to run simultaneous split URL experiences using the Convert convert.redirect() javascript.

  1. First, create a normal Convert A/B Experiment (not split URL experiment). You can use any of the initial URLs to start the configuration of the experiment. Let’s say: https://domain.com/page1.html.
  2. While you configure this experiment, it will open the visual editor. Open the “Variation JS” editor:
open the visual editor. Open the "Variation JS" editor:
  1. Add the following code to the Editor and configure it according to your experiment requirements and save your test and exit the editor.
if (document.location.href.includes("https://domain.com/page1.html")) {

    convert.redirect("https://domain.com/page1b.html");
 }

else if (document.location.href.includes("https://domain.com/page2.html")) {

    convert.redirect("https://domain.com/page2b.html");
 }

else if (document.location.href.includes("https://domain.com/page3.html")) {

    convert.redirect("https://domain.com/page3b.html");
 }
  1. Configure your Location by adding the Visitor Requested URLs that will bucket them into the experiment:
Configure your Location

Now test your experiment in a fresh incognito session or utilize Convert’s well documented QA process.

Pass Parameters from Original to Variation URLs

If you want to pass parameters from original to variation URLs you can extend the above code with this:

var parameters = (new URL(document.location)).searchParams;
if (document.location.href.includes("convert")) {
convert.redirect("https://www.convert.com" + "?" + parameters);
}

Set up Split URL Tests for Shopify Themes

If your website was designed on Shopify, you may want to take advantage of Convert’s Split URL option. This way, you can test two or more different versions of Shopify themes (applied to your website) against one another.

Shopify now offers a wide range of themes, so it would be great to know how one Shopify theme on a website would perform against another.

For more details, here’s an article that explains the full process of Split URL Testing for various Shopify themes.

Below you can see the Split URL Experience report between the two different themes:

Split URL Experience report between the two different themes

Use an A/B test as a Split URL Test (Yes, that’s Possible!)

It’s actually totally possible to turn your A/B Experience into a Split URL Experience!

Convert has a JS function that allows you to be redirected to a new page, while still storing stats for that specific Variation:

convert.redirect("URL_here");

For example, instead of using:

document.location.href="http://www.mysite.com/my_variation_page.html"

Use the following:

convert.redirect("http://www.mysite.com/my_variation_page.html");

Tip: The above code can only be used inside the “Custom Javascript” section inside the Visual Editor.

You can even pause the Original from the reports section and have all your users directed to the Variation. In this case, 100% of traffic will see the Variation.

Stop variation in Convert Experiences

How to Determine if your Split URL Tests are Statistically Significant?

So far, you’ve learned how to set up numerous kinds of Split URL Tests, but how can you be sure your results are trustworthy?

Let’s assume you’re conducting a Split URL Experience and sending 200 visitors to each Variation of a landing page. The Original captures 50 conversions, whereas the Variation captures 40.

You may be tempted to abandon the Variation entirely, in favor of your Original, but keep in mind that the test is still not finished and the results are not yet statistically significant.

Tip: Statistical significance establishes the degree of certainty to which a test’s results are not the consequence of a sampling error.

Conversion Rate Analysis in A/B testing significance calculator

Your findings are almost just as likely to be random as they are to be a result of the effectiveness of one page over another.

Convert provides a calculator to help you figure out the statistical significance of a Split URL Experience. The only four data points required are Original visitors, Original conversions, Variant visitors, and Variant conversions. Simply enter the information into the calculator’s left-hand side, to receive your answer.

Now that you understand how to set up Split URL Experiences and verify their statistical significance, let’s go over a few common mistakes to avoid when running your tests.

When Should You A/B Test vs. Conduct Split URL Tests?

The short answer is: it depends on the scope of your changes. We put this question to three experimentation leaders and here’s what they had to say.

1. A/B testing is for element-level changes on an existing page.

If you’re testing a headline, a CTA, a form layout, or trust signals, a standard A/B test is usually the right call. Marcella Sullivan, our in-house CRO expert, puts it this way:

My default if improving something on an existing page like headlines, layout, CTAs, forms, trust signals is to run an AB test. I get a cleaner read on what actually moved the needle when testing elements through an AB rather than a full redirect.

Marcella’s right. When you’re testing one or two elements within the same page, an A/B test shows you exactly what caused any shift in performance. As the scope of changes grows, that clarity gets harder to maintain.

Daphne Tideman, the Growth Advisor at Growth Waves, echoes this sentiment: “A/B testing is for when you’re refining what you already have. You’re tweaking a headline, testing a different CTA, changing the layout of a section. The page stays on the same URL, and the changes are relatively contained.”

2. Split URL testing is for when you’re questioning the whole approach

When the change you want to test is too significant for an editor, split URL is the right method.

“Split URL tests are really for things like a completely different landing page, a new structure, a different way of moving users through the journey,” says Marcella. “There are also some practical reasons to go split URL like if the changes cover most or all of the page, you want it properly built in your CMS, or you’re testing a fundamentally different approach.”

Tideman extends this to backend changes as well, positing that when you’re testing something like page load speed from a different tech stack, the variations need to live on separate URLs. She also notes that split URL pairs well with Meta’s native experimentation feature for teams running paid traffic tests.

Ruben de Boer, owner of Conversion Ideas, sees the use case growing, saying “With the rise of fast development and vibe coding, I expect we’ll see more of these tests.”

A few things to keep in mind before you choose

First, split URL tests have an inherent interpretability tradeoff worth planning for before you launch. Marcella explains it this way:

Split URL will tell you which version won, but not always why. When you change lots of things at once, it’s hard to know what actually made the difference. That’s why you need to design your experiment with a solid hypothesis and have a plan for your analysis like session recordings, heatmaps, follow-up tests, whatever makes sense for what you’re trying to learn.

Second, the flicker argument for choosing split URL over A/B isn’t as clean-cut as it’s often presented. Marcella notes that client-side A/B tests can cause flicker when you’re making big visual changes, and split URL can sidestep that because the page loads as intended rather than being modified after the fact.

However, she points out that if a split URL test takes too long to redirect, it can have load speed and performance consequences.

Ruben also emphasizes the importance of getting the fundamentals right when running split URL tests.

Users in both variants must have a consistent, comparable experience, and your data collection needs to be clean. Too often, client-side split URL tests introduce issues, like redirects firing after analytics loads, skewing bounce rates and pageviews, or slower load times because users briefly see the original page before being redirected. That directly impacts behavior and makes results unreliable.

Here’s his recommendation: “If you can’t guarantee a seamless experience and clean data, the split should be handled server-side.”

Common Mistakes to Avoid when Running Split URL Tests

Uneven Traffic between the Original/Variation

Let’s say your website receives 15,000 visitors each week, and you begin running a Split URL Test with an Original and a Variation. In an ideal world, each of these different versions would receive 7500 visitors (half of 15,000).

However, it’s more likely that the numbers in each variation will be in the range of 7490 to 7550. (Minor variances are typical and due to pure chance.) On the other hand, it is quite concerning if, say, one of your Variations captured 6000 visitors and the other received roughly 9000.

That’s where the SRM test comes in. Instead of relying on intuition, it uses the Chi-square goodness of fit test. For example, it can determine whether 7300 or 7800 visits are “normal” in comparison to the other amount of visitors received.

In December of 2021, the Convert team introduced our own SRM method, which Convert users can enable by going into Project Configuration > More Settings.

This will allow them to see the SRM tags in the reports:

Convert Experiences report with SRM enabled

Although reasons for SRM issues can vary, here are some ways to help eliminate SRM tags from your tests:

Wrong Page Targeting

Let’s assume you want to use the Split URL Experience to target all pages of your website (and not just the homepage) while using the same query parameters in both the Original and the Variation.

  • The Original URL is https://www.convert.com
  • The Variation URL is https://www.convert.com?v1=true

This is not as simple as it seems and must be set up correctly in order to avoid SRM tags.

First, define your Location with “Page URL contains https://www.convert.com” and input “query string contains v1=true” into the exclude section.

Site Area exclusion rule Convert Experiences

While you define the Split URL Variations, you use a regex formula to catch all pages:

([a-z]{1,2}tps?):\/\/((?:(?!(?:\/|#|\?|&)).)+)(?:(\/(?:(?:(?:(?!(?:#|\?|&)).)+\/))?))?(?:((?:(?!(?:\.|$|\?|#)).)+))?(?:(\.(?:(?!(?:\?|$|#)).)+))?(?:(\?(?:(?!(?:$|#)).)+))?(?:(#.+))?

Script Not Installed on All Pages

It’s important to always double-check that the Convert script is installed appropriately on both the Original and Variations.

One common issue we discovered, after troubleshooting customer requests, was that the Convert script was missing from one of the Variations. This resulted in uneven traffic distribution and thus SRM tags.

Make sure to include the script on every page where the Split URL Test will take place.

Bot Traffic Targeting One Variation

Another common finding in Split URL Tests with uneven traffic distribution, is that one of the Variations will receive visits from unusual user agents (which we suspect to be bots).

For example, the Original variation might receive totally normal traffic, while Variation 1 receives hits from user agents like the following:

  • Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.11 (KHTML like Gecko) Chrome/23.0.1271.97 Safari/537.11
  • Mozilla/5.0 (Windows NT 5.1; rv:27.0) Gecko/20100101 Firefox/27.0

We suspect these to be bots since they are using much older versions of Chrome and Firefox browsers. (Chrome browser now is around 99, as opposed to 23, shown above.)

Because we were unable to find an official bot with this user agent header, we suspect that this is advanced targeting made to appear as though it’s a human.

In such cases, you can exclude specific bots from your Split URL Experiences by following these steps.

Redirect Loops

Let’s say you’ve created a Split URL Test on your website and you discover that your users are internally redirected in a loop.

When a visitor arrives on the test page, they are forwarded to the Variation URL according to the traffic allocation you provide. On the Variation URL, visitors can click any element/link to return to the Original page. But, because the test is set up on the Original URL, the visitor is forwarded to the Variation URL, and the process repeats indefinitely.

url

These infinite redirect loops must be prevented ahead of time, as they will affect your site performance and experience stats.

Let’s say you want to target just the homepage (https://www.convert.com) with the Split URL and pass all query parameters the visitors might have.

  • The Original URL is https://www.convert.com
  • The Variation URL is https://www.convert.com?v1=true

To avoid any redirect, you’ll need to set the Locations to “Page URL matches exactly https://www.convert.com” and input “query string contains v1=true” in the exclude section.

This ensures that the conditions of the experiment will still match if you end up at “https://www.convert.com ?v1=true”.

Double Traffic Recorded in Original in Your Analytics Tool

When running a Split URL Test, all of your traffic will go to the Original URL, which the Convert script will then redirect to a Variation URL (if the Variation is to be presented to that specific visitor).

In some instances, your analytics software (like Google Analytics) may show that your Original URL is receiving all of your traffic, even though the Variation URLs appear to be receiving the right portion of the traffic.

This can make it look as though your page views have increased, but in reality, the Original is displaying the sum of all the other percentages, plus its own.

split URL test mistake Google Analytics report

Here’s how you can fix this:

Order of Tracking Codes

Make sure the Convert experiments tracking code is placed on the page BEFORE your analytics software tracking code. This will solve the issue most of the time.

Convert Experiences code placement

Wrap Analytics Tracking Code

To prevent traffic from being recorded on the Original URL, wrap your analytics software tracking code whenever the Variation is presented. Here’s an example:

if(!convert || !convert.isRedirect) {

 // your analytics tracking code here

SEO Considerations of Split URL Tests

When doing Split URL Testing, duplicate content is something you may want to consider from an SEO standpoint.

Duplicate content is defined as blocks of content that are the same or extremely similar across several web pages, with only slight variations in graphics, design, or language. Duplicate material negatively impacts the search engine user experience, but luckily there are ways to account for it when needed.

Consider how a search engine perceives duplicate content. Search engines index pages to keep search results relevant, and will avoid showing pages with comparable information, as part of the user experience. Their algorithms will essentially group all pages with comparable information, displaying the Original or best content (based on their findings), while filtering out the rest.

In the case of fraudulent SEO methods, search engines must also deal with content repetition. Google has been known to remove websites from search results if the algorithm detects that duplicate content is being used to manipulate search results. Google rarely, if ever, imposes punishments, but it’s best not to leave it to chance– just in case!

Let’s have a look at some of the suggested solutions.

Do Not Use Googlebot User-Agent in Your Audiences

You won’t receive a penalty, as long as you aren’t basing your traffic allocation on a search engine versus human distinction (using Googlebot user-agent in the Audiences feature). Google doesn’t care which version of your website its bot sees. What matters is that it gets the same user experience as a random visitor.

Exclude bots Convert Experiences

Use rel=”canonical”

If a Split URL Test has multiple URLs, place the “rel=canonical” link attribute on all of your alternate links pointing to your Original page. If bots are indexing your website, this will direct them to your Original page. Experiments involving redirects should be fine as long as they don’t redirect to unexpected or unrelated content.

use rel="canonical" Convert Experiences

Use 302s for redirect

Google advises against utilizing a permanent 301 redirect, favoring a temporary 302 redirect. This informs search engines that the redirect is only temporary (meaning it will only be active for the duration of the experiment). It also tells them to preserve the Original URL in their index, rather than replacing it with the redirect’s location (the test page).

Only Run Split URL Tests for as Long as Necessary

If there is enough traffic to justify it, you can run your Split URL Test and then turn it off if it fails to reach a conclusion within your expected timeframe (or immediately after a conclusion is reached).

Summary

Split URL Tests are an excellent way to evaluate conversion and engagement rates across two different versions of a landing page. With Convert Experiences, you can set up a Split URL Experience in a multitude of ways, depending on your needs.

The results of these tests will allow you to optimize your designs and layouts for your target audiences and will be critical to your success as you develop your CRO knowledge and programs.

Happy testing!

FAQs

What are the best platforms for split URL testing?

Not to toot our own horn, but Convert Experiences is one of the best tools available for split URL testing, especially if you prioritize data privacy and test reliability. Convert supports split URL testing natively, flags sample ratio mismatches, handles query parameter transfers, and has solid documentation on the edge cases that tend to cause problems in practice.

Other reliable tool options include VWO (deliberately uses JS redirects for SEO reasons), Kameleoon (offers both JS and 302 redirects, and addresses SRM risk directly), Optimizely (strong for complex architectures and multi-domain testing), and AB Tasty (a good mid-market option).

The right choice depends on your stack, traffic volume, and how much configuration flexibility you need.

What SEO considerations should you keep in mind when split URL testing?

The main concern is duplicate content. When two URLs serve nearly identical or structurally similar pages, search engines may index both, dilute authority between them, or in rare cases, filter one out of results entirely.

To manage it: add rel=”canonical” on your variation pages pointing back to the original. This  tells crawlers which URL is authoritative and prevents the variation from competing in search. Also, use 302 redirects rather than 301 so search engines preserve the original URL in their index rather than replacing it with the variation.

You should also keep tests running only as long as necessary. The longer a variation URL is live and indexed, the more likely you are to accumulate SEO side effects.

What are the most common mistakes in split URL testing?

Some of the most common mistakes include:

Missing tracking script. If your testing tool’s script isn’t on every URL in the test (original and variations), traffic won’t be recorded consistently, and you’ll end up with uneven distribution.

Redirect loops. Variations that link back to the original URL create an infinite redirect cycle if your site area isn’t configured to exclude the variation’s URL.

Double-counting in analytics. If your analytics script fires before your testing tool’s script, the original gets credited with all traffic. The fix is to place your testing tool’s script before your analytics code in the page head.

Stopping tests too early. Split URL tests need the same statistical rigor as any other experiment: enough visitors, enough conversions, and enough time to account for day-of-week variation. So, don’t stop the test too early, even if you see a lift.

Not accounting for bot traffic. Bots don’t always distribute evenly across variations, which skews your traffic split and can trigger SRM warnings. Excluding known bots from your experiment audience keeps your data cleaner.

How can split URL testing lead to sample ratio mismatch?

Sample ratio mismatch (SRM) occurs when the traffic distribution between your original and variations doesn’t match what you configured. For example, setting a 50/50 split and getting a 62/38 split.

In split URL tests, the usual culprits are: the testing tool’s script being missing from one variation, incorrect location targeting that buckets some visitors more than once, or bot traffic landing disproportionately on one variation.

Convert flags SRM directly in the reporting interface. When detected, the affected variation gets tagged in your report. You can enable this in Project Configuration under More Settings. It won’t fix the underlying issue, but it tells you not to trust the results until you’ve diagnosed what went wrong.

How can you split test two funnels?

Testing two separate funnels means each variation needs its own set of pages, all on separate URLs, with consistent tracking across every step. This is more complicated than a single-page split URL test, but the logic is the same: visitors are bucketed at the entry point, and that bucket assignment follows them through the entire flow.

In Convert, you’d set this up as a multipage split URL test, where each funnel step in the variation gets its own URL and Convert maintains bucket assignment as visitors move through the pages. Your goals should capture conversion events across the full funnel, not just the landing page.

How do you run a split URL test on a Shopify store?

If you want to compare two Shopify themes, split URL testing is how you do it. Each theme gets its own URL or subdomain, and your testing tool splits traffic between them.

The setup process follows the same steps as any split URL test:

1. Publish the variation theme to a separate URL or subdomain
2. Install your testing tool’s tracking script in the head of both themes1.
3. Create a new split URL experience in your tool, add both URLs, and configure your traffic split
4. Add both domains to your project configuration
5. Set your goals (e.g., add-to-cart, checkout initiation, or revenue per visitor)

Make sure the script is in both theme files (it’s easy to install it in one and miss the other) and double-check that your checkout URLs are being tracked correctly, since Shopify’s checkout flow sometimes lives on a different domain depending on your plan.

CTA Free trial
CTA Free trial

Mobile reading? Scan this QR code and take this blog with you, wherever you go.
Updated - Originally published
Written By
Dionysia Kontotasiou
Dionysia Kontotasiou
Dionysia Kontotasiou
Convert's Head of Integration and Privacy, helping customers with technical queries.
Edited By
Carmen Apostu
Carmen Apostu
Carmen Apostu
Content strategist and growth lead. 1M+ words edited and counting.
Start your 15-day free trial now.
  • No credit card needed
  • Access to premium features
You can always change your preferences later.
You're Almost Done.
What Job(s) Do You Do at Work? * (Choose Up to 2 Options):
Convert is committed to protecting your privacy.

Important. Please Read.

  • Check your inbox for the password to Convert’s trial account.
  • Log in using the link provided in that email.
  • To ensure you receive your 30-day trial from our ambassador, please use the same browser to claim your account.

This sign up flow is built for maximum security. You’re worth it!