Benchmark, April 2, 2026
Benchmark: obligation extraction on long-form outsourcing contracts
Marek WojciechowskiStaff Engineer, Retrieval4 min read
The problem
This one comes up in almost every matter review, and the answer is less settled than the confidence around it suggests.
How we measured it
In the current build this runs as part of the standard pass, so it applies to every document in the set rather than only the ones someone thought to check.
Where it breaks
Scanned originals with poor image quality remain the weakest input. So do agreements that were assembled from three precedents and never reconciled, which is common in long-lived supplier relationships.
draftingdiligence
Working notes from the Lawrs team. General information about legal technology and practice, not legal advice.