The Retention Metric Most AI Products Ignore
If you run an AI-native product and your retention dashboard shows DAU, WAU, and MAU, you are measuring the wrong thing.
Not because those metrics are useless. They matter. But they do not tell you whether your product is becoming more or less defensible over time.
The metric that matters
For AI products, the defensibility question is simple: when a competitor launches with a better model, do your users leave?
If the answer is yes, you do not have a product. You have a thin wrapper around someone else's API.
The metric that answers this question is what I call workflow depth: how many consecutive actions does a user take inside your product before they export the result and finish the job somewhere else?
Low workflow depth means the user generated something, copied it out, and moved on. High workflow depth means they are building, iterating, and making decisions inside your product. The deeper the workflow, the higher the switching cost.
How to measure it
You probably already have the data. Look at your event stream and count the number of product actions between session start and the first export, copy, or download event. Segment by cohort and watch the trend.
If workflow depth is flat or declining across cohorts, your product is becoming more of a utility and less of a platform. That is a problem.
If it is rising, users are building habits and workflows inside your product that a competitor with a better model cannot easily replace.
What moves the needle
The obvious answer is "add more features." That is usually wrong. More features increase surface area but rarely increase depth.
The things that actually move workflow depth:
Decision capture. When a user makes a choice inside your product — picks a variant, adjusts a parameter, overrides a suggestion — save it. Show it back to them next time. The product gets smarter as they use it. That is a switching cost no competitor can replicate by improving their model.
Context persistence. Most AI products treat every session like a blank slate. The best ones remember what you did last time and build on it. This sounds small. It is not. A user who has to re-explain their business context every session is a user who will try a competitor.
Feedback that closes the loop. If your product generates output and the user modifies it, the next generation should reflect those modifications. Not with a thumbs-up button. Through implicit feedback: the user changed the tone, shortened the copy, added a section. The product should learn from those edits automatically.
The hard part
None of this requires a better model. It requires better product thinking. That is good news for builders and bad news for companies that are just prompt-engineering their way through a thin wrapper.
The teams that win in AI are not the ones with access to the best LLM. They are the ones that build workflows so sticky that the model becomes a detail.
That has always been true in SaaS. It is more true now.
Enjoyed this? Get more like it in your inbox.
Subscribe to The Agentic Dispatch →