Article chapter 08 of 08
Run a regular operating review
From Budgeting and governing an AI workflow after the prototype
Use a monthly or otherwise suitable cadence during early operation, then adjust it when the workflow is stable. Bring the business, technical and source owners together with the same record rather than separate cost, quality and risk reports.
Review:
- completed volume and backlog by workflow state;
- cost per completed unit and total spend against assumptions;
- model, infrastructure and supplier charges;
- review time, escalation reasons and queue age;
- failed, uncertain and corrected runs;
- evaluation results for material system changes;
- source freshness, access and processing failures;
- incidents, complaints and requested corrections;
- upcoming supplier, policy or source changes;
- decisions, owners and due dates.
Reconcile bills with internal usage records. Differences may come from retries, test environments, untagged projects or delayed supplier reporting. Every production request should carry enough metadata to assign it to a workflow and environment without putting private content into billing labels.
Check that the workflow still matches its approved purpose. Users may discover adjacent tasks and begin relying on outputs the review policy was not designed to cover. Either stop that use or assess it as a new workflow with its own boundary, evidence and owner.
End the review with operating decisions rather than a broad health rating. Continue under the current policy, change a named control, fund additional review capacity, narrow the accepted inputs, run a specific evaluation, pause one action, or retire the workflow. Record when each decision will be checked.
Before approving the next budget period, pick a sample of completed, failed and corrected cases and trace their full cost and evidence. Confirm that supplier usage, review records, source work and support activity can be connected to the same unit. If that trace cannot be completed, improve the records before making a confident savings claim.