Experimentation + Testing Deep Dive By Reforge – Free Download Course
A deep dive into creating and executing a strategic experimentation system for breakthrough ideas.
Go beyond A/B testing to build an experimentation system that produces wins – not random data points. Drawing on the methods used to grow companies like Slack, Instacart, SurveyMonkey, MongoDB, and more, this program focuses on building a strategic system of experimentation. You will learn how to identify strategic opportunities, create step function ideas, and test them in a high-velocity, high precision way.
Built and Led By Top Executives
MIRO, NETLIFY, MONGODB, SURVEYMONKEY
Elena is a Reforge EIR and Growth Advisor at Miro, Netflify, and MongoDB. She was formerly SVP for Product & Growth at Malwarebytes, and also an SVP at SurveyMonkey. She has a breadth of experience across freemium, self-serve, and free-trial subscription revenue models for both B2C and B2B companies.
What you get as a Reforge Member:
Reforge membership combines cohort-based programs, with a year-round experience to help you learn, execute, and scale yourself and your company. Participation in Experimentation + Testing Deep Dive and access to the content and community of all programs is included.
Cohort Based Programs
6-weeks, part-time, virtual, and intense
Built and led by executives
Live case studies with a cohort of peers
On-Demand Access content from all programs
Step-by-step projects to help you execute
Weekly releases, events, and updates
Connect with peers solving similar problems
Cohort Format For Experimentation + Testing
Deep Learning Guided By A Leading Executive
Each week you will go through 2 to 3 hours of self-paced material covering actionable frameworks and proven systems for B2B & B2C companies that were created by leading executives. The topics this program covers are:
WEEK 1: EXPERIMENTATION STRATEGY
Great experimentation starts with identifying a strategic opportunity. You will define and scope an opportunity by piecing together user insights, data insights, and business insights.
WEEK 2: SOLUTION IDEATION
Once we have a strategic opportunity, we need to generate ideas targeted at that opportunity. You will learn the spectrum of solution ideation from optimizations to innovations and then evaluate and prioritize the ideas.
WEEK 3: THE SCIENCE OF TESTING + PREPARING TESTS
Experimentation is based on a foundation of statistics. You will learn the applicable statistics you need to know to scope, prioritize, and analyze tests properly for both a/b and Bayesian tests. You will then learn how to create a test by crafting a hypothesis, simplifying build complexity, assigning users, and deploying a simultaneous vs sequential test.
WEEK 4: ANALYZING TEST RESULTS
Good tests are nothing without proper analysis. You will learn how to monitor test data, methods to call a test, analyze the test outcome and then build a plan to iterate on wins and losses.
WEEK 5: ACTING ON TEST RESULTS + PRODUCTIZING WINS
Acting on results is an art form that requires collaboration. Learn to use test outcomes to inform iterations, measure value, and document initiatives in a way that will drive confidence and buy-in from stakeholders.
WEEK 6: MANAGING AN EXPERIMENTATION SYSTEM
Learn how to build a program from the ground up including measuring an experimentation system, setting goals, creating experimentation roadmaps, measuring individual performance, developing experimentation tools, and evangelizing the program.
Live Case Studies Each Week
Each week, you will go deeper by attending a live online session via Zoom where Elena Verna and a featured leader will walk through a real-life scenario applying the concepts you learned. Live sessions are 2 hours and take place weekly during live programs.
Hear how industry leaders from companies like Slack, Dropbox, LinkedIn, and more have addressed similar challenges.
A selection of guests we’ve had in the past:
Lenny Rachitsky ex-Product Lead @ Airbnb
Nate Moch VP of Product Teams @ Zillow
Andy Johns Partner @ Unusual Ventures
Angel Steger Director Of Product Design @ Facebook Bela Stepanova VP of Product at Iterable
Brittany Bingham VP Marketing at Guru Bangaly Kaba ex-Head of Growth Instacart, Instagram Crystal Widjaja – ex-SVP Growth + BI at Gojek. David Burson Head of Product Growth at Canva
Adam Fishman CPO @ Imperfect Foods
John Egan Head of Growth Engineering @ Pinterest
Ludo Antonov Head of Growth Engineering @ Lyft
Connect With Peers Solving Similar Problems
Every week there will be optional opportunities to connect with peers in the cohort solving similar problems to you. Join a small group to discuss applying the concepts, attend/host a community deep-dive session on a special topic, or discuss questions within the forum and Slack.
Apply the Concepts
Translate the frameworks to your company with active, hands-on exercises, worksheets, and weekly micro-projects. Expect to spend about 2 hours a week on active learning.
A PLAN FOR ACTION
Build a plan that you can take back to your company. Start small, achieve results, and amplify your impact.