Product Experimentation Lead

The Wow

Betsson Group is looking for a Product Experimentation Lead to operationalize, scale, and champion our experimentation program across our global portfolio of digital products. This role is central to ensuring that every customer-facing decision is backed by evidence, rigor, and user insight.  

Sitting at the intersection of product, analytics, UX, and engineering, you will drive evidence-based decision-making through robust A/B testing and live validation frameworks. You’ll execute and interpret high-quality experiments to evangelize a test-and-learn culture and scale the infrastructure that supports it. This includes instilling best practices, improving tools, and ensuring we learn the right things—not just run the right tests.

A taster of what you will be involved with: 

Experimentation Platform & Governance:

• Own and optimize the use of experimentation tools (e.g., Optimizely), ensuring robust configuration, scalability, and cost efficiency  

• Develop best practices, playbooks, and governance models to ensure statistical rigor and test hygiene across all markets and brands 

• Establish guardrails to prevent test collisions and misleading results  

• Ensure test documentation is consistently captured, tagged, and archived for future reference. Help build and maintain a repository that connects experiments to broader user insights, product decisions, and research learnings

• Support the development of a cross-functional knowledge system to prevent redundant testing, track learnings over time, and accelerate future decision-making

Strategy & Roadmap:

• Develop and maintain a strategic experimentation roadmap aligned with product priorities and market goals  

• Partner closely with Analytics and UX Research (UXR) teams to track research insights and ensure continuity from discovery to validation 

• Prioritize initiatives based on user needs, business impact, and technical feasibility 

• Account for seasonality, test interdependence, and long-term effects on user behavior in planning

Test Design & Execution:

• Collaborate with PMs, researchers, and analysts to define hypotheses, test structure, and success metrics 

• Guide test design including traffic allocation, sample sizing, segmentation, and statistical methods 

• Manage test execution end-to-end and ensure robust post-test analysis

• Ensure tests are designed to capture both short-term effects and longitudinal impacts (e.g., retention, engagement)

• Pre-test analysis using GA or similar tools, to identify experiment parameters 

• Manage or preferably execute robust post-test analysis ensuring all relevant data sources are used to ‘paint the full picture’ and insights/recommendations are clear 

• Proactively develops the applicable experiments to run during low-request periods. Identify opportunities for improvements  

What we are looking for: 

• 5+ years of relevant experience in product experimentation, CRO, product analytics, or related role
• Hands-on experience running and scaling A/B and multivariate tests across high-traffic digital products 
• Expertise with testing platforms (e.g., Optimizely, AB Tasty, VWO) and analytics tools (GA, Amplitude, Adobe Analytics, ContentSquare)
• Strong statistical acumen: understanding of test design, power analysis, segmentation, and validity  
• Experience working cross-functionally with product, analytics, research, design, and engineering teams  
• Clear communicator able to translate test results into actionable insights and strategic recommendations  
• Experience in Data Visualization (through Google Looker Studio, Power BI, Tableau or similar) 
• Experience using Business Intelligence and Operational Intelligence tools 

What we offer

Much like a rollercoaster, life at Betsson Group is fast-paced, full of twists and turns, and always exciting. With more than 2,800 colleagues representing over 75 nationalities across a global network of offices - including 1,500 at our operational headquarters in Malta - every day brings new challenges and opportunities to grow. It may not be for the faint-hearted, but if you thrive on innovation, enjoy pushing boundaries and want to be part of a diverse, international team, then you’ll fit right in at Betsson.