Operating Notes/Operating Note

A Pilot Without a Learning Question Is a Demo With a Budget

June 23, 2026·5 min readAndrew Cherry

Every AI pilot should be able to answer one question: what would this project have to show for us to expand it, and what would it have to show for us to stop.

Editorial summary

A working précis of the argument. The full note ships to Regesta Briefing subscribers.

Most AI pilots in independent agencies are not experiments. They are extended demonstrations, budgeted quarterly, evaluated on whether people liked the demo.

A pilot needs a learning question sharp enough to fail. Not a KPI dashboard. A single sentence that describes the operating change the pilot is trying to earn: reduce COI turnaround for a defined segment, or cut submission cycle time for a defined producer, or lift renewal retention for a defined book.

Without that sentence, the pilot cannot end. It can only be renewed.

A learning question sharp enough to fail is the difference between a pilot and a subscription.
The Regesta Briefing

Notes like this one, weekly, for leaders building the AI-native agency.

Join the Briefing →