Senior Engineering Manager (Experiments)
Posted Updated
Description
- As the manager and team lead of the Experiments Team, you will oversee the A/B testing system that powers Duolingo’s product development lifecycle. Experiments play an essential role at Duolingo, with almost all product changes going through some form of test
- You will manage our in-house Experiment Platform that is responsible for defining experiments, executing them in the app, and measuring their outcome. While the role is platform-focused, you will remain highly connected to the product in all parts of Duolingo, shaping how we use A/B testing to build the best possible experience for our learners
- Expand the capabilities on our Experiment Platform to support more sophisticated types of A/B tests and statistical methods
- Empower teams to confidently evaluate their key metrics and easily gate access to new functionality
- Help shape the future of the accelerated feature shipping at Duolingo by enabling improved experiment automation and backend-based control of the learner experience
- Scale the Experiment Platform to be able to handle dramatically increased experiment velocity in a statistically sound and cost-efficient manner
- Partner with product teams to devise unique approaches to measuring complex product scenarios and to advise on experiment strategy
- Shape the future of the Duolingo product lifecycle through A/B testing
Benefits
- Medical, dental, and vision for employees as well as eligible partners and dependents
- Mental health benefits such as therapy sessions and coaching to support you to be your best self
- Fertility benefits to support your family planning journey
- Fully paid parental and adoption leave
- Fully paid subscription to Care.com and paid backup days for dependents and your fur family
- 401(k) with generous match and immediate vesting
- 20 days of paid time off, with two additional weeks off for winter break
- First-time home buyer bonus (in Pittsburgh)
- Competitive salaries and equity
- Yearly stipend for professional development
- Transportation reimbursement for however you get to work
- Lunch prepared daily by our in-house chefs
- Annual international retreat for all full-time employees
- Monthly events celebrating our team and their amazing work
- On-site gym and massages
- Game room for taking brain breaks
- The ability to work from or relocate to Pittsburgh, PA or New York, NY
- Experience with A/B testing, either via supporting experiment infrastructure or using A/B tests in product development
- Strong cross‑functional leadership and communication skills, especially between product and platform teams
- A track record of building scalable infrastructure and working with large datasets
- Experience leading, managing, and building a team of software engineers, with demonstrated ability to hire, develop, and retain talent
- Prior experience building an experimentation platform or A/B testing-related tooling
- Experience operating in a high-speed product development environment
- Comfort with the statistical methods behind hypothesis testing
- Talent Matching reviews your resume and responses to application questions to determine the extent to which your qualifications match the job requirements selected for this role. These requirements and their desired weighting are established by our recruiters in collaboration with hiring managers
- All Talent Matching output is reviewed by our recruiting and hiring teams, who make the final decision on each application. Talent Matching does not automatically disposition any candidate or make hiring decisions
Skills
Sign in to read and join the discussion.