Long read, May 10, 2026
how review quality is actually measured in the wild
The problem
Every review team we work with has a version of this problem. How review quality is actually measured in the wild rarely announces itself.
Volume changes the shape of the problem. At ten documents you can hold the exceptions in your head. At four hundred you need the exceptions written down and checkable.
What we do about it
Our approach is to index the document twice: once by structure, once by defined term. Findings then carry a pointer back to both, so a reviewer can confirm a conclusion without re-reading the agreement.
In the current build this runs as part of the standard pass, so it applies to every document in the set rather than only the ones someone thought to check.
Where it breaks
Scanned originals with poor image quality remain the weakest input. So do agreements that were assembled from three precedents and never reconciled, which is common in long-lived supplier relationships.
None of this removes the reviewer. It moves the reviewer to the part of the work where judgement actually pays.
Working notes from the Lawrs team. General information about legal technology and practice, not legal advice.