Experimenting with prices and pricing strategy is a bold decision for any business.
But when transparency is at stake, and research points in the direction of price inclusion, the only way forward is through careful execution of a robust hypothesis based on solid data.
And also achieved a significant 15% uptick in conversion rates on the site.
This case study details how seasoned CRO experts crafted the hypothesis and their approach to the successful A/B test.
iProspect is a global, award-winning agency focused on converting consumer intent into action and driving business performance for the world’s largest brands, including Diageo, Hilton, Burberry, General Motors, Procter & Gamble, Gucci, and Microsoft. The iProspect team works across a network of 4,600 employees spread over 94 offices in 56 countries.
In 2018, iProspect won more than 200 awards including 15 leadership recognition awards and 25 Agency of the Year titles, and was named Digiday’s Agency of The Year. iProspect is named a Leader in The Forrester Wave™: Search Marketing Agencies, Q4 2017, #1 Global Digital Performance Agency by RECMA, Industry Agency of Choice at The International Performance Marketing Awards, and took home 4 Effie awards across the globe in 2018.
iProspect is part of the Dentsu Aegis Network, a wholly owned subsidiary of Dentsu Inc.
Convert is the brand powering the decade mature A/B testing platform Convert Experiences. With a privacy-focused, transparency respecting approach, Convert has designed its flagship tool to be fully GDPR compliant, suited to advanced testing needs, and flexible with over dozens of one-tag integrations.
As with any great hypothesis, the process started with research and data mining.
Since the main goal of the testing drive was to increase lead submissions through query forms – a mid-commitment action – iProspect scrutinized the obvious friction points on the site keeping potential leads from sharing their contact details.
The most glaring omission was pricing information.
However, the items being sold came at a premium and were distributed through a network of franchisees and so it was difficult to settle on the inclusion of concrete price points that all stakeholders could agree upon.
iProspect leveraged research and industry best practices to formulate a pre-hypothesis that even the mention of a “starting at” price, with a monthly spend indicator could add much needed transparency to the offer during a person’s decision-making journey.
Their specialists then conducted several user studies on the website to bolster this pre-hypothesis with qualitative data.
…. Participants always commented on the lack of transparency in pricing. One participant in the study said that they would find it much easier if, transparency-wise, all prices were listed directly on the site. They felt that they were being put at a significant disadvantage when the pricing wasn’t readily available.Karen Kysar, Director, UX/CRO, iProspect
Site visitors who see pricing on the website will convert significantly better (on form submissions) than prospects who see no pricing information.
The rendering of the A/B/C test was fairly simple.
The actual challenge lay in providing pricing transparency, while maintaining the freedom of the various franchisees to set their own prices and provide their own financing options.
iProspect came up with the effective solution of having the stakeholders agree on a range of prices, and then picking a “low” and a “high” starting price from that spectrum for the two variants that would challenge the control.
The variants and the original are shown below.
The A/B/C test was served using Convert Experiences. The goal was set to “lead submissions”.
The Control saw an estimated 8,500 visitors, who got no pricing information.
The variant with the “high” starting price got 5,000 visitors and the variant with the “low” starting price received 8,500 people. The test was run until it reached 95.26% statistical significance, and it was live for an entire month.
The reason there is a lower number of visitors for Variation 2 (high starting price) is because it was switched off once a clear winner was indicated in Variation 1, or the variation with the “low” starting price. This was a calculated move and since the conclusion of the test in January, the conversion rate on the winner has continued to improve.Kristin Warwick, Lead, UX/CRO iProspect
iProspect used Convert Experiences to continue serving the winning variant to all site visitors, until the design was deployed on the site.
In short, the variation with pricing won over the control experience. This is what iProspect had anticipated all along.
There was a 15% increase in the conversion rate of lead submissions through query forms for the variant with the low monthly price point.
The most notable findings from the test were:
The client has traditionally stayed away from showing pricing because their products do come at a premium, but when we’re able to help a user understand what impact a purchase will have on their monthly budget by showing monthly payment pricing, we’re able to instil confidence and remove the fear of the product being out of their reach financially. Transparency is always the best approach.Karen Kysar, Director, UX/CRO, iProspect