Aurora Hill Advisors
Menu
← All insights

Operating model

The three ledgers an AI transformation office should keep

A practical review system that connects AI workflow redesign, adoption evidence, and realized value before a team decides what to scale.

By

Aurora Hill Advisors

Reading time

10 min

Published

An AI transformation office can have three healthy-looking dashboards and still be unable to answer a basic question: which workflows are working better?

Imagine a portfolio whose use-case tracker says 28 projects are active. The enablement dashboard shows that training completion is rising. The value slide reports thousands of hours saved. Each illustrative statement may be accurate on its own. If the project, adoption, and value records use different boundaries, none can show that a particular change in the work produced a result worth keeping.

Keep three linked ledgers for every material AI-enabled workflow:

  1. A workflow ledger records what changed in the work.
  2. An adoption ledger records whether people use the new method as intended.
  3. A value ledger records whether the result survives scrutiny.

All three use the same workflow ID, owner, baseline period, and review date. That common spine makes the records reconcilable.

Start with a workflow that can be named

“Customer service AI” is not a workflow. “Classify an inbound billing dispute, gather account evidence, draft a response, and route exceptions to a specialist” is.

A useful boundary has a trigger, an outcome, a beginning, an end, and an accountable business owner. It also identifies the points where a person makes a decision or accepts responsibility. Without that boundary, teams count unrelated activity together and call the total adoption.

Give each workflow a durable ID before collecting metrics. The ID should follow the work across pilots, tool changes, team changes, and versions. Do not use a vendor name as the identity. A workflow can outlive a product, and one product can support many workflows.

This discipline also makes ownership visible. Our companion guide on who owns an AI-enabled workflow explains why the business owner, system owner, and risk owner should be named separately rather than compressed into one vague sponsor.

The three ledgers at a glance

Ledger Question it answers Minimum evidence Decision it supports
Workflow What changed in the work? Baseline steps, new steps, human and AI responsibilities, exceptions, controls, owner Is the design ready to test or expand?
Adoption Did the new method become normal? Eligible users, repeated in-workflow use, correct handoffs, friction, support demand What behavior or condition needs attention?
Value Did the change improve a worthwhile result? Baseline, outcome, quality and risk thresholds, operating cost, credible comparison Continue, change, scale, or retire?

The ledgers are deliberately separate. A single score encourages teams to trade one kind of evidence against another. High usage should not cancel a quality failure. A good outcome from three expert users should not be presented as enterprise adoption. A compliant design should not be mistaken for a valuable one.

Ledger one: what changed in the work

The workflow ledger is a versioned operating record. It should be concrete enough that someone who does the job can challenge it.

For each workflow, record:

  • Trigger and intended outcome: What starts the work, and what has to be true when it is complete?
  • Baseline: How was the work performed before this change? Include cycle time, queue size, rework, quality, cost, or another relevant measure.
  • Changed steps: Which tasks were removed, reordered, automated, or made easier?
  • Human responsibilities: Who sets intent, supplies judgment, reviews output, handles exceptions, and accepts the result?
  • AI responsibilities: Which bounded tasks can the system perform, and what information or tools may it use?
  • Exception path: What happens when confidence is low, information is missing, a policy conflict appears, or the system fails?
  • Controls: What must be logged, tested, approved, or restricted?
  • Owner and version: Who can change the workflow, and which version is currently in use?

NIST’s voluntary AI Risk Management Framework organizes risk work around Govern, Map, Measure, and Manage. Its Core also calls for documented roles, ongoing review, and a determination of whether an AI system achieves its intended purpose. Those are useful risk-management requirements, but the workflow ledger also has to capture the operating design and result the business expects.

For a live workflow, define the handoff rules rather than leaving them in training decks or individual memory. A handoff contract for an AI workflow gives teams a compact way to record what enters a step, what constitutes acceptable output, who reviews it, and where exceptions go.

Ledger two: whether the new method became normal

Tool activity is useful early evidence. Microsoft, for example, defines its Microsoft 365 AI adoption score around active days of Copilot use over a 28-day period. That measure answers a legitimate product question: are licensed users forming a usage habit? It does not, by itself, show which workflow changed or whether the output was good.

The adoption ledger should move through a stricter sequence:

  1. Eligible: How many people should use this workflow, and in which situations?
  2. Enabled: How many have access, permission, relevant guidance, and the data they need?
  3. Tried: How many completed the workflow at least once?
  4. Repeated: How many used it again when the qualifying situation occurred?
  5. Performed correctly: How often did people follow the intended review and exception path?
  6. Sustained: Did the new method remain in use after the launch period and direct support ended?

Use the qualifying opportunity as the denominator when possible. If a team handled 200 relevant cases and used the approved workflow for 120, the adoption rate is 60 percent. Dividing by headcount or licensed seats would answer a different question.

The ledger should also hold qualitative evidence. Record why people bypass the workflow, where they abandon it, which steps cause support requests, and which exceptions are common enough to change the design. Those observations explain the number. A flat usage curve may indicate a skill gap, but it may also point to poor workflow fit, mistrust, a confusing policy, or incentives that still reward the old process. The stalled-rollout diagnostic helps distinguish those causes before a team prescribes more training.

Ledger three: whether the result survived scrutiny

The value ledger connects an observed result to the workflow boundary. It should make optimistic arithmetic difficult.

Record these fields:

  • Baseline outcome: The prior cycle time, error rate, conversion rate, cost, risk exposure, or other result, measured over a stated period.
  • Target and threshold: The expected improvement plus any quality, safety, compliance, or customer threshold that cannot be traded away.
  • Observed outcome: The result during a defined review period, including the distribution when averages hide important variation.
  • Comparison: What would likely have happened without the change? Use a parallel group, phased rollout, matched historical period, or a plainly stated weaker comparison.
  • Operating cost: Licenses, model usage, integration, review time, support, monitoring, and maintenance.
  • Capacity disposition: If time was released, what happened to it? Was work absorbed, a backlog reduced, service improved, or staffing changed?
  • Confidence and caveats: Data gaps, seasonality, concurrent changes, and assumptions.

Avoid translating every saved minute into cash. Time has financial value only when the organization can explain what capacity was removed, redeployed, or used to produce another measurable outcome. Likewise, output volume is not value if error correction, approval time, or customer harm rises.

The workflow-level adoption scorecard goes deeper on selecting leading signals, outcome measures, quality thresholds, and decision rules.

Reconcile the ledgers in one monthly review

A portfolio review should reconcile the evidence. A 45-minute review for a small portfolio can follow this order:

  1. Confirm the boundary. Has the workflow, population, version, or owner changed since the last review?
  2. Read the workflow evidence. Are the intended steps, human decisions, controls, and exception paths still accurate?
  3. Read the adoption evidence. Are eligible cases moving through the approved path repeatedly and correctly?
  4. Read the value evidence. Are the target outcome and quality threshold holding after costs and caveats?
  5. Make one decision. Continue the test, change the design, scale to a defined population, or retire the workflow.

Each decision needs an owner, a date, and the evidence required at the next review. “Monitor” is not a decision unless the team names what it will monitor and what finding would change the course.

At portfolio level, use a small set of states:

  • Continue: Evidence is incomplete, and the next test is worth running.
  • Change: The workflow or its operating conditions need a specific revision.
  • Scale: Adoption and value evidence hold for the current population, and the next population is defined.
  • Retire: The workflow does not create enough value, cannot meet a threshold, or has been superseded.

A worked example: invoice exception review

Consider an illustrative accounts-payable workflow. These figures are fictional and exist only to show how the ledgers reconcile.

The trigger is an invoice that fails an automated match. The outcome is a documented resolution: approve, return for correction, or escalate. Before the change, specialists searched three systems, wrote a case note, and routed uncertain items to a manager. Median resolution time was 2.4 business days, 11 percent of cases returned for missing evidence, and managers reviewed every case.

The redesigned workflow gathers the relevant records, proposes a case summary, cites the source fields, and recommends a route. A specialist verifies the evidence and decides. Cases with missing records, policy conflicts, or values above a threshold go to a manager.

The workflow ledger records that specialists retain the decision, the system cannot approve payment, and the exception rules are part of version 1.2.

The adoption ledger shows that 18 of 20 eligible specialists used version 1.2 for 81 percent of qualifying cases during the month. Six specialists repeatedly left the workflow to find a missing purchase-order field. That is design evidence, not a request for a reminder email.

The value ledger shows a median resolution time of 1.5 days, a 9 percent return rate, and manager review on 34 percent of cases. Operating cost includes the system, monitoring, and specialist review time. The quality sample found no unsupported approvals, but the review period was short and month-end volume was unusually low.

The evidence supports a change decision. The team will repair the purchase-order data handoff, run through a normal month-end cycle, and repeat the quality sample. All three ledgers point to the same next step.

Five reconciliation failures to catch

The project and workflow are treated as the same thing. One project may change several workflows. Each needs its own boundary, owner, adoption population, and outcome.

Training completion stands in for adoption. Completion establishes exposure to material. The adoption ledger asks whether the intended method is used in qualifying work.

Hours saved are counted twice. Several use cases may claim the same employee capacity. Reconcile the disposition of time at the team level.

Quality appears only after an incident. Define the quality and risk thresholds before launch, then sample performance at the cadence the workflow warrants.

The owner can report but cannot decide. A ledger becomes administrative overhead when nobody in the review can change, scale, or stop the workflow.

The minimum viable three-ledger worksheet

A transformation office does not need new portfolio software to begin. One table can hold the common fields:

Common fields Workflow evidence Adoption evidence Value evidence Decision
Workflow ID, version, owner, population, review date Baseline and changed steps, human decisions, AI tasks, exceptions, controls Eligible cases, repeated correct use, bypass reasons, support demand Baseline, outcome, thresholds, comparison, cost, caveats Continue, change, scale, or retire; owner; next evidence date

Start with the workflows important enough to deserve an executive claim or another round of investment. If the three evidence chains cannot be connected for one workflow, the portfolio total is not ready for an executive slide.

Sources