Article chapter 01 of 08
Start with what a wrong answer actually does
Pick one plausible wrong answer and follow it into the next step of the workflow. Prototypes mostly cover the path where the request is understood, the source is there and the output looks fine. Before production I want to know what happens when somebody acts on that output, a system changes state because of it, or a customer sees information they're going to trust.
So choose one supported task and push an incorrect result forward. Who receives it? What might they do with it? How would anyone notice it was wrong, and which records would need fixing afterwards? If the output is a draft that a trained person approves, the damage is probably limited. If it changes an account, sends a message or updates another system, cleaning up gets a lot more involved.
Write the workflow as a sequence of states instead of a description of the screens: the initial request, source retrieval, model output, validation, approval, action, confirmation and any later amendment. Put the name of the responsible system next to each one. Then look for gaps, like an action being marked complete before the receiving system has confirmed it.
When you sort the wrong outcomes, sort them by what they do operationally. Some you can fix on the same screen. Others create duplicate work, disclose information, lock someone out, trigger a financial adjustment or leave two systems disagreeing with each other. You only need categories clear enough to decide approval, logging and recovery requirements. An elaborate scoring formula is optional.
For each supported task, I'd write down:
- The action a person or system might take from the output.
- The worst credible wrong outcome inside the release boundary.
- Who's likely to spot it, and how quickly.
- The records you'd need to investigate it.
- Whether the action can be reversed.
- Who has the authority to correct it.
- The condition that should stop any further processing.
The answers may shrink the first release. A workflow can support read-only research before it's allowed to update records, or prepare an action for approval while tool execution stays switched off. Set the scope around the controls the team can actually run on launch day.