Skip to content

Improve Growth Infrastructure to Better Support Experimentation

Created by: anna-mmikhova

Problem to solve

Currently our experimentation infra is limited. Custom tooling has limited functionality and no owner to maintain/improve it. We need more sophisticated tools to iterate, test & measure impact of Growth experiments. Ideally we'd find a 3rd party tool that could suit our requirements to reduce needed maintenance, though investing in the custom tool is also an option,

Without the infra investment we'll depend on limited functionality and error prone methods. These methods have slow deployment and release speed.

Measure of success

Handbook has updated, more thorough framework for experimentation. Best practices are clear. Templates exist for guiding experiment process & documenting plans. Findings are also documented in standard template and appropriately stored/tagged for easy access sin the future.

All growth team feature flags (in both cloud & on-prem deployments) are able to run off the new infrastructure (3rd party or evolved custom system).

Solution summary

Do market research and migrate to a promising service for AB testing. Collaborate with analytics to define best practices, build templates, and publish and socialize changes in RFC/Handbook.

What specific customers are we iterating on the problem and solution with?

This is an internal systems and processes optimization that will allow us to experiment and activate users

Impact on use cases

This will enable us to iterate faster and build more robust and conclusive product experiments.

Delivery plan