Define and measure time to value

Created by: malomarrec

Context

Problem to solve

Define and implement a metric that is a good enough proxy for time to value and start measuring it. What time or level of effort does it take for a new user to get value out of Batch Changes?

Proposal (so far)

Measure:

time to first batch change: t(first apply of a user) - t(first preview of a user), where first apply and first preview don't have to happen on the same batch change, cohorted by first preview month. See time to value (2) in the illustration.
batch change creation success rate: # batch changes that were applied / # batch changes that were previewed

Illustration: time to first batch change

Illustration: cohorted batch change success rate

Also see time to value playground