Benchmark, December 11, 2025
Benchmark: responsiveness review at production scale
The problem
This one comes up in almost every matter review, and the answer is less settled than the confidence around it suggests.
In testing, the gap between a fast pass and a careful pass was not accuracy on the central question. It was whether the reviewer noticed the interaction with an adjacent provision.
How we measured it
Our approach is to index the document twice: once by structure, once by defined term. Findings then carry a pointer back to both, so a reviewer can confirm a conclusion without re-reading the agreement.
In the current build this runs as part of the standard pass, so it applies to every document in the set rather than only the ones someone thought to check.
Where it breaks
Scanned originals with poor image quality remain the weakest input. So do agreements that were assembled from three precedents and never reconciled, which is common in long-lived supplier relationships.
If you take one thing from this, make it the habit of checking the adjacent provision before you sign off the clause in front of you.
Working notes from the Lawrs team. General information about legal technology and practice, not legal advice.