Counting the Bandages: On measuring the time that AI saves
Author1, Author2, Author3, Author4, Author5
Abstract
The paper explores how AI assistance can save time by contrasting different views of time savings and proposing a model to measure time saved against escaped defects.
Reality Card
The study establishes a model that quantifies time saved by AI assistance and the associated defect costs, demonstrating that over-trust in AI can lead to significant time savings but at a higher cost in terms of defects.
AI helped on somewhere between 3% and 82% of the 246 issues analyzed, with a slowdown of 19% to 24% depending on the estimand.
The results are based on a specific dataset and may not generalize across different contexts or applications.
Paper to code
Verified implementation resources so builders can test the paper’s claims instead of stopping at the abstract.