Is This the Future of Growth Marketing? What I Learned from Each GMS 2024 Speaker

Marcella Sullivan
By
June 28, 2024 ·

On the 19th of June, I had the opportunity to attend a conference I have only heard great things about, Growth Marketing Summit (or Growth Minded Superheroes!). Not only was this my first time at the conference but also my first time in Frankfurt. With the Euros in Germany, the sunny streets of the city were packed with football fans more likely to be disappointed than me.

This article will take you through all the insightful talks lined up by André, Julia, and the konversionsKRAFT team. The quality of the speakers is a testament to the effort they put into this event.

So, my round-up of what we saw this year…

1. How Disappointment Affects Your Users, Why It’s Bad for Your Business & What You Can Do About It

Speaker: Michael Aagaard, CRO Expert & Keynote Speaker

Michael’s keynote speech was an entertaining and insightful story about the science of disappointment. He began with an anecdote from his childhood about buying sea monkeys, sharing his disappointment gap—the disparity between his expectations and reality.

In an analysis of the negative business impacts of disappointment, Michael presented startling research: 93% of users reported that disappointment negatively affected their behavior. He explained that this response is a neurochemical event known as “reward prediction error,” which happens when there’s a mismatch between received and predicted outcomes.

The key points in his presentation were:

  • We underestimate how much disappointment actually affects behaviour; scientific literature shows it impacts memory, reactions and learning.
  • Humans have what may seem intense or exaggerated reactions to disappointment—it’s just the way we’re wired.
  • What we often perceive as ‘friction’ is actually the emotional pain of our expectations not living up to reality.

How do we become more aware of where we could be disappointing users?

  • Use review mining and analysis to identify and address common pain points.
  • In a usability test, go beyond asking, “What was your experience like”. Use a pre-test expectation measurement and a post-test experience measurement. For example, ask, “On a scale of 1-5, how difficult do you think this will be?” before the test, and then ask how difficult it was in the post-test measurement.
  • A discrepancy between these measurements signals potential disappointment.
  • Take disappointment into consideration when implementing changes on your site.

Michael concluded by explaining that disappointment destroys conversions, trust, loyalty, and brand reputation, urging businesses to mind the expectation gap when implementing changes and carrying out user research.

Michael on stage
Michael on stage, photo by Julia Seyfried Cohen

2. Optimizing Optimization for More ROI

Speaker: Luke Frake, Experimentation Lead User Growth at Spotify

Luke talked about how automation in experimentation can benefit us all, emphasizing its effectiveness in variant checking, automated error detection and Sample Ratio Mismatch (SRM) checks for accurate results.

He stressed the democratisation of data, pointing to Spotify’s use of Backstage to make data accessible to all team members, thereby reducing reliance on gut feelings and freeing up key players for more strategic tasks. This is a hot topic as we saw in the Convert survey at ExElite this year, where data availability was identified as a major challenge for those looking to embed an experimentation culture.

Pivoting to long-term thinking, Luke also advocated for running multiple experiments to drive sustained growth rather than focusing on single outcomes. By avoiding false starts and keeping users at the heart of everything, he showed how democratizing data and thorough analysis can significantly enhance the experimentation culture and overall ROI of running tests.

Key takeaways:

  1. Automate Processes: Streamline steps to scale effectively; think tagging and issue alerting.
  2. Democratise Data: Ensure everyone has access to and understands the data.
  3. User-Centric Focus: Prioritise long-term positive impacts for users over short-term gains.
Luke Frake wrapping up his talk
Luke Frake wrapping up his talk

3. Your Senior Leaders Don’t Care About Experimentation

Speaker: Shagun Aulakh, Director of Product Management & Experimentation at American Express

Shagun tackled the difficult issue of fostering a culture of experimentation within organisations. She exposed a significant gap between leadership’s perceived support for experimentation and the reality of its implementation. Leaders often claim to champion experimentation and tolerate failure, yet often prioritise predictable outcomes over innovative efforts. This discrepancy, Shagun noted, stems from misaligned expectations and a lack of understanding about what it takes to build a Center of Excellence (CoE) or drive skill levels across experiment teams.

Shagun shared that leadership underestimates the complexity and investment required for successful experimentation. They may underestimate its impact, baulk at costs, fail to grasp the process fully, or juggle competing priorities.

To bridge this gap, Shagun suggested:

  • Listening more, especially in one-on-one meetings with leaders
  • Asking open and discovery questions to reveal their priorities and concerns
  • Being humble and recognising the value of their experience—what she referred to as “Valuing HiPPOs” (Highest Paid Person’s Opinion)
  • Focusing on outcomes, aligning the conversation around North Star metrics that drive desired outcomes.

Shagun shared that building a true culture of experimentation comes from consistent actions and practices within teams, not off-the-shelf solutions. It’s something you earn, not purchase. By aligning experimentation goals with broader business objectives and actively engaging leadership, organisations can hurdle barriers to creating a successful experimentation culture. This alignment echoes Speero’s maturity report which showed that 67% of transformative organisations strongly agree that performance measurement goals could correlate with the organisation’s main goals.

Shagun showing a meme most of us can relate to
Shagun showing a meme most of us can relate to, courtesy of Shiva Manjunath

4. Hacking Growth: How Today’s Fastest-Growing Companies Drive Breakout Success

Speaker: Sean Ellis, Author of “Hacking Growth” & Founder of GrowthHackers.com

In his talk, Sean shared insights on how the world’s top companies use growth hacking techniques to achieve standout success.

He explained that traditional companies often fall short of their growth potential due to slow adaptation.

The solution? Start with value delivery and quantify it with a North Star metric. Think Uber’s weekly rides or Slack’s daily active users. The key to sustainable growth, he said, is delivering “must-have” value.

Successful growth hacking requires rapid, systematic testing and strong cross-functional collaboration. Sean dropped a pro tip for measuring product-market: ask users how they’d feel if they could no longer use the product.

Focus on those who’d be “very disappointed”—about 40% of users need to feel this way for true product-market fit and sustainable growth.

Sean showing how Twitter's accelerated testing strategy brought them accelerated growth
Sean showing how Twitter’s accelerated testing strategy brought them accelerated growth

5. Continuous Discovery – How Product & CRO Could Benefit from Each Other

Speakers: Stefanie Grimmling & Anastasia Shvedova, Management Team Members at konversionsKRAFT

Stefanie and Anastasia explored the synergy between product management and conversion rate optimization, emphasising the importance of continuous discovery.

They pointed out that product teams often lack the time to understand users, leading to biases such as false consensus and confirmation bias.

They introduced a behavioural design framework that integrates user insights into daily routines. A case study with Villeroy & Boch showcased how the company initially misidentified user needs in bathroom planning but, through deep interviews and prototype testing, discovered the real issues and developed effective solutions.

Stefanie and Anastasia provided three key takeaways:

  1. Frame problems correctly to avoid solving the wrong puzzle.
  2. Start small with product discovery, treating solutions as hypotheses.
  3. Combine multiple methods for efficient and effective discovery.

They stressed the importance of dedicating time to product discovery to ensure businesses truly understand their users and create valuable products.

Stefanie and Anastasia pulled off the most seamless two-person talk I’ve ever seen—let’s all hope they share the stage again soon! They’re looking for feedback on their Product Discovery Methods cheat sheet so be sure to reach out to them.

Stefanie and Anastasia with the konversionsKRAFT Behavioural Design Framework
Stefanie and Anastasia with the konversionsKRAFT Behavioural Design Framework

6. How AI Will Impact User Experiences and What You Should Do About It Today

Speaker: Ioana Teleanu, Senior Product Designer AI at Miro, Founder + Design Consultant, Educator & Speaker at UX Goodies

Ioana explored the evolving role of AI in user experiences, emphasising the designer’s responsibility in shaping future interactions. While AI is currently in a phase of disillusionment, Ioana believes it holds significant potential for future stability and integration.

She stressed that AI should be viewed as a tool to enhance, not replace, human creativity and problem-solving. One interesting point in Ioana’s talk was about the twinkly, magical and purple visual cues often used to signify AI integration (see below).

Ioana shows us examples of colours, iconography and vocabulary surrounding AI integration
Ioana shows us examples of colours, iconography and vocabulary surrounding AI integration

She highlighted several key challenges in AI design: bias baked into AI systems, safety and security concerns, unpredictability of AI outcomes, and the need for trust and transparency.

Ioana advocated for a user-centred approach, designing AI systems with people in mind and making AI tools accessible to reduce societal disparities.

She proposed principles for ethical AI design, including starting with user needs, ensuring safety and control, and building trust through explainability. She envisions a future where AI enhances product relevance, personalisation, and accessibility, urging designers to think critically about the integration of AI into their work.

Recommended Resource:
AI Playbook for Research, CRO, and Experimentation – the first book of its kind, crafted by Experimenters for Experimenters. This playbook is the result of over 3,000 hours of research and 500+ hours of testing with real datasets. 60+ prompts and tips to bootstrap your workflow.

7. Design for Impact: Simple Frameworks for Better Results

Speaker: Erin Weigel, Senior Group Product Design Manager at Deliveroo

Erin began her talk with a historical anecdote about Ronald Fisher, who discovered the importance of robust experimental design after finding decades of research data to be flawed due to poor methodology. This set the stage for her main point: the power of convergent design, which integrates design, science, and business to drive meaningful improvements rather than mere changes.

Erin introduced the concept of systems thinking, which embraces the complexity and dynamic nature of real-world interactions, contrasting sharply with the traditional linear approach to product development.

She outlined the convergent design process, consisting of seven interconnected steps: understanding, hypothesising, prioritising, creating, testing, analysing, and deciding. This process enables teams to collect reliable data, make informed decisions and create value.

Erin Weigel’s convergent design process
Erin Weigel’s convergent design process

Erin highlighted practical frameworks for each phase, emphasizing the importance of high-quality evidence and ethical considerations in decision-making.

She underscored the need for a culture of experimentation within organisations, where rigorous methods and systems thinking are ingrained in daily practices.

In conclusion, Erin said that designing thoughtful experiments and embracing a holistic approach can lead to substantial, sustainable improvements and drive growth effectively.

For more insights like these, order a copy of Erin’s new book ‘Design for Impact’.

Erin wrapping up her talk
Erin wrapping up her talk

8. Humanizing Digital Experiences – Things to Avoid and How to Look at the Right Data

Speaker: Maria Luiza de Lange, CRO Lead at Tele2

In her talk, Luiza advocated for humanising digital experiences through simplicity, accessibility, and genuine user focus.

She highlighted the need for using real user data, noting that bots can significantly distort insights. It’s crucial to ensure your website is accessible, with nearly one billion people globally affected by impairments, and the EU Accessibility Act will soon mandate compliance.

Luiza warned against cognitive biases such as gamblers’ fallacy, pareidolia, and confirmation bias, which can negatively impact decision-making. She also touched on the fact that even though 95% of companies collect data, only 35% analyse it and 10% take action. With nearly half of internet traffic potentially bot-generated, verifying user data authenticity is essential.

Luiza identified three key pitfalls to avoid: verifying the authenticity of users to filter out bots, addressing the needs of all users, and ensuring unbiased decision-making.

These steps, she argued, can help companies create more human-centric digital experiences that resonate deeply with their customers.

Luiza with some figures on how many people have impairments, related to her desire to meet the needs of all users
Luiza with some figures on how many people have impairments, related to her desire to meet the needs of all users

9. How to Run Many Tests at Once: Interaction Avoidance and Detection

Speaker: Lukas Vermeer, Director of Experimentation at Vista

Lukas used the hero’s journey to frame his talk, addressing the often-asked question: ‘What about interaction effects?’. Looking to give a more expanded answer than ‘Yes, what about them?’ was the reason for this exploration where he addressed concerns about running multiple experiments interfering with each other.

Lukas argued that alternatives to running simultaneous experiments, such as not testing, running sequentially, or isolating traffic, all come with downsides that make them less attractive than running tests simultaneously. Running multiple tests at once and then using regression analysis to detect and manage interaction effects is just a more efficient approach.

While interaction effects are real, they are rare and often easy to detect. The real issue lies in the fear of these effects, which can lead to suboptimal testing strategies. By embracing overlapping experiments and employing robust detection methods, teams can enhance their experimentation processes and drive better outcomes.

Lukas concluded by encouraging the audience to share real-world cases of interaction effects to improve collective understanding and methodologies in the field.

Lukas with his key takeaway on interaction effects
Lukas with his key takeaway on interaction effects

10. How to Craft Landing Pages That Read Well and Convert Well

Speaker: Eden Bidani, Conversion Copywriter and Head of Strategy at cape.agency

Eden shared insights on high-converting landing pages. She introduced the WIFM (What’s In It For Me) framework, which helps structure the page to address readers’ needs and interests. You don’t have to be a copywriter to effectively use this framework so it has universal appeal.

She stressed the value of

  • Using the customer’s voice and real feedback to make the content relatable and persuasive
  • Prioritizing clarity and specificity over unnecessary filler words.
  • Designing landing pages that enhance the user experience by leading the visitor smoothly towards conversion, making the process feel natural and effortless
  • Using dynamic content for personalised experiences for users at various stages of awareness.

Her approach is grounded in the idea that the strategy and understanding of the customer journey trump mere wordsmithing in driving conversions. This customer-centric approach is the foundation for creating more effective and engaging landing pages.

Eden telling us about the right way to integrate AI into copywriting, using a proven framework plus AI to write your landing page
Eden telling us about the right way to integrate AI into copywriting, using a proven framework plus AI to write your landing page

11. I Have Seen The AI Powered Future of CRO and It’s Bright

Speaker: John Ekman, Chief Conversionista at Conversionista!

John’s closing keynote highlighted the transformative role of AI in CRO. He emphasised that understanding the generative AI basics is crucial for leveraging its potential – echoing Ioana’s point on accessibility through understanding. John explained that AI, particularly large language models (LLMs), predicts the next word or action in a sequence.

John pointed out how AI can streamline tedious tasks, such as creating campaign pages or generating reports, enhancing efficiency. He used the Double Diamond model to illustrate how AI excels in divergent thinking, expanding problem understanding, while human insight remains crucial for converging on optimal solutions.

He provided an example of a company using AI to predict office relocations by analysing real estate listings and news articles. They coined this system ‘Bloodline AI’ – as it drips leads into their inbox every day. This predictive capability allowed the company to preemptively target potential customers and grow its reach.

Looking forward, John predicted a seismic change in the role of websites. With referral traffic from Google expected to plummet, websites must pivot to influencing AI-generated answers and delivering personalised content.

John concluded by urging the audience to embrace AI for both efficiency and exploration, moving from execution to strategic roles, ensuring CRO adapts to the evolving digital landscape.

John with an optimistic ending point about how we should view AI
John with an optimistic ending point about how we should view AI. ‘We do rocket science, we can put things in orbit, we can go to the moon and the price of rocket fuel just dropped 90%’.

Parting Thoughts

Held in the beautiful Alte Oper concert hall, the Growth Marketing Summit (GMS) was a feast for the mind.

Some themes that hit home:

  • Human-centric design as the North Star of product management
  • AI can be very useful for minimising grunt work and enhancing creativity
  • Making data accessible to all team members will lead to more informed decisions across the board
  • Aligning experimentation with business objectives and getting leadership buy-in cannot be an afterthought.

I came away with a robust set of practical tools to try. Michael and Sean shared ready-to-use user and market research questions, while Eden unveiled her WIIFM framework for crafting effective messages, even for those new to copywriting. Insights and knowledge from this year’s GMS will undoubtedly inspire and influence our strategies in the coming months. I’m already looking forward to next year!

Mobile reading? Scan this QR code and take this blog with you, wherever you go.
Originally published June 28, 2024 - Updated July 16, 2024
Written By
Marcella Sullivan
Marcella Sullivan
Marcella Sullivan
Business Psychologist and CRO
Edited By
Carmen Apostu
Carmen Apostu
Carmen Apostu
Head of Content at Convert

Start Your 15-Day Free Trial Right Now.
No Credit Card Required

You can always change your preferences later.
You're Almost Done.
I manage a marketing team
I manage a tech team
I research and/or hypothesize experiments
I code & QA experiments
Convert is committed to protecting your privacy.

Important. Please Read.

  • Check your inbox for the password to Convert’s trial account.
  • Log in using the link provided in that email.

This sign up flow is built for maximum security. You’re worth it!