AI payment check, 2 products to 22: the program, in order
-
Make the business case before every build.
Server capacity, resource allocation, and usage cost went into the business justification before each build started. Nothing was built without one, and after launch the results were reported against it.
-
Start with a pilot.
I ran a feasibility experiment first, then took the tool live as a pilot on two products.
-
Set the pass bar before the build.
I ran a workshop where the product owner and knowledge owners set the OKRs and thresholds in advance. The pass criteria were adoption and a measured cut in handling time.
-
Gate every product.
Each product after the pilot had to clear its own phase gate, with kill criteria written down before it started.
-
Govern what the tool reads.
The tool read from a separate, machine-only knowledge base. I governed what went into it, with named owners, restricted write access, and a RACI.
-
Run the defect loop.
In testing I flagged suspect fields. The engineer confirmed or corrected the location and committed a fix time, and I cut the ticket and assigned it.
-
Fix cost and speed.
When it ran slow and heavy on tokens, I ran the review that found why, and it was restructured to use fewer tokens and respond faster.
-
Scale it.
The rollout reached 22 products and 15+ markets across three engineering teams and 14,000+ agents.