Blog
What embedded AI delivery uncovers in the workflow
Working beside the team using an AI system exposes details the brief rarely contains: distrusted source data, exceptions handled outside the software and approvals nobody wrote down.

Working beside the team using an AI system exposes details the brief rarely contains: distrusted source data, exceptions handled outside the software and approvals nobody wrote down. These details appear while someone tries to complete ordinary work. A field is checked against a spreadsheet before anybody trusts it. A submission is held until a particular person replies. An operator copies an identifier into a private note because the application will not show it again. The patterns discussed here are composites, not a description of one engagement. Embedded delivery means staying close enough to observe and test those moments during implementation. It does not mean turning every local habit into a product requirement. A brief is usually assembled from policy, known pain points and the process people can explain in a meeting. It gives the project a starting boundary. It cannot capture every decision made under time pressure. When delivery begins, follow a small number of tasks from arrival to completion. Ask the operator to use the systems and sources they normally use. Note where they pause, switch tools, ask somebody else, repeat a check or leave a field blank until later. Do this without collecting unnecessary private data. The observation record can describe the type of source, role and decision while omitting names, record values and commercial details. If a real example must be retained for testing, store it under the project's approved controls rather than in general notes or model prompts. Compare what happens with the brief. Some differences are defects in the existing process. Others are controls that the documentation missed. The work is to distinguish them before automation makes either one faster.
When a team does not trust a field, it builds a verification routine around it. That routine may involve another system, a dated export, a manual calculation or knowledge of which source tends to be late. An AI feature that reads the official field will appear inconsistent to the operator even when it follows the documented rule. Telling people to trust the model will not resolve the source disagreement. Record the disputed field, the source people prefer, why they prefer it, how often the difference matters and what happens when the sources disagree. Then decide whether the product should change the source, display freshness and provenance, or require confirmation for decisions that depend on it. Do not let the AI combine conflicting values silently. Show which source supported the output and the time it was retrieved. If no authority has been agreed, say that the result needs review. This often produces work outside the AI feature: integration repairs, ownership decisions and better operational visibility. Those tasks belong in the delivery plan because the feature depends on them. Documented workflows tend to show the ordinary route. Operators spend much of their attention on work that did not follow it. Watch what happens with duplicates, incomplete submissions, late changes, rejected approvals, unavailable source systems and records that need to be reopened. Note where the software has a state for the exception and where people represent it through comments, labels or a separate list.
An AI assistant needs explicit limits around these cases. If it cannot tell whether a record is waiting, failed or deliberately paused, it may recommend the ordinary next step at the wrong time. Turn recurring exceptions into named states or reason codes where that improves action. Keep free text for unusual detail, but avoid making the model infer the entire control flow from notes. Define who may resolve each exception and what evidence is required before the record returns to the ordinary path. Use the examples as evaluation fixtures. The expected result may be a correct recommendation, a request for missing information or a refusal to proceed. Success does not always mean completing the task automatically. Some approvals exist because policy requires them. Others grew from a past incident, a manager's preference or uncertainty about who owns a decision. They may all look identical to someone observing the workflow for the first time. For each approval, ask what decision is being made, which risk it controls, who is authorised, what evidence they inspect and whether the approval is recorded. If nobody can explain the control, do not remove it during a software change. Give it an owner and schedule a decision. An AI system can prepare evidence, identify missing fields and route the item. It should not impersonate an approval by producing confident prose. The interface must distinguish a model recommendation from a person's decision and retain the identity and time of the actual approval.
Also check what happens when the normal approver is absent. A workflow that relies on one person's inbox has an operating dependency even if the product diagram shows a generic role. Embedded delivery can generate a pile of useful notes that never change the product. Convert each material observation into one of four things: a confirmed requirement, an open decision, a defect or an evaluation case. Attach the source and confidence. "Observed once during a delayed integration" carries a different weight from "confirmed by the process owner and operating guide". Keep disagreement visible until the relevant owner resolves it. Review observations regularly with the people doing the work. Use plain descriptions of the situation and proposed consequence. Do not present a polished future workflow that hides the questions still open. Protect the team from observation becoming surveillance. State what is being recorded, why it is needed, where it will be stored and when it will be removed. Focus on the work and system response, not individual performance. A feature can look sound during a prepared demonstration and fail during the next late file, correction or handover. Stay close through enough of the operating cycle to see the less frequent states the system is expected to handle. Before widening release, check:
- which sources users verify outside the application;
- which exceptions still rely on private lists or comments;
- which approvals lack a named rule or fallback owner;
- which AI outputs cannot be traced to current evidence;
- which observations remain unresolved decisions.
Choose one unresolved item that could cause an incorrect action and settle its owner, state and verification before adding another automated step. That is a useful next move from embedded delivery, even when the answer is a small workflow change rather than more AI.
Discussion
Continue the thinking.
Comments are public and hosted in an open-source GitHub Discussions repository.
Loading comments connects your browser to GitHub. A GitHub account is required to post.