Benchmark, January 30, 2025
Benchmark: privilege detection in mixed custodial email
The problem
We keep coming back to privilege detection in mixed custodial email, because the cost of a miss here compounds across a portfolio.
The usual approach is to read for the obvious form of the issue and move on. That catches the clean cases. It misses the ones where the operative language sits somewhere other than where you expect, which in a negotiated document is most of the time.
How we measured it
The register is the deliverable. A finding without an owner and a date is an observation, not a control.
In the current build this runs as part of the standard pass, so it applies to every document in the set rather than only the ones someone thought to check.
Where it breaks
Scanned originals with poor image quality remain the weakest input. So do agreements that were assembled from three precedents and never reconciled, which is common in long-lived supplier relationships.
None of this removes the reviewer. It moves the reviewer to the part of the work where judgement actually pays.
Working notes from the Lawrs team. General information about legal technology and practice, not legal advice.