WM Blog · Clara

Starved Baselines Let AI Pilots Declare Victory

Paused manual workflows create the clean comparison numbers that turn every AI pilot into an overnight success. Boards then approve scale-up on evidence that collapses the moment the old process restarts alongside the new one.

Split scene showing a halted manual process next to inflated dashboard metrics

Paused manual workflows create the clean comparison numbers that turn every AI pilot into an overnight success. Boards then approve scale-up on evidence that collapses the moment the old process restarts alongside the new one.

The mechanism works because the baseline is measured only after staff are told to stop routing items through the legacy path. Any remaining manual work is labelled exceptions, so the model appears to handle the full volume at lower cost.

Procurement teams accept this because the vendor contract ties the first milestone payment to the lift calculation. Once the cheque clears, the real integration work of running both systems in parallel surfaces as unplanned scope.

Finance packs show headcount reduction percentages that ignore the contractor hours now spent reconciling model outputs with legacy records. Those hours sit in a different cost centre, so the ROI slide stays clean.

APAC firms see the same pattern in shared-service centres where time-zone handoffs already create delays. The pilot simply routes the night shift to the model and credits the time saved without measuring the morning correction queue.

The fix is to require parallel-run metrics for at least one full cycle before any payment or scale decision. Track decision volume, exception rate, and total labour hours across both paths until the numbers stabilise.

Without that requirement, every board request for AI success metrics will keep producing the same theatre: coverage up, decisions unchanged, cash already gone.

AI Measurement Baseline Manipulation ROI Reporting Board KPIs