Benchmark, February 20, 2025
Benchmark: privilege detection in mixed custodial email
The problem
The short version: privilege detection in mixed custodial email is easier to get wrong than most teams assume, and the failure is usually silent.
Volume changes the shape of the problem. At ten documents you can hold the exceptions in your head. At four hundred you need the exceptions written down and checkable.
How we measured it
The register is the deliverable. A finding without an owner and a date is an observation, not a control.
In the current build this runs as part of the standard pass, so it applies to every document in the set rather than only the ones someone thought to check.
Where it breaks
Scanned originals with poor image quality remain the weakest input. So do agreements that were assembled from three precedents and never reconciled, which is common in long-lived supplier relationships.
If you take one thing from this, make it the habit of checking the adjacent provision before you sign off the clause in front of you.
Working notes from the Lawrs team. General information about legal technology and practice, not legal advice.