Skip to content
Writing

Benchmark, July 16, 2026

Benchmark: redline generation against a firm playbook

Callum WhitfieldLitigation Practice Lead4 min read

The problem

Every review team we work with has a version of this problem. Redline generation against a firm playbook rarely announces itself.

How we measured it

In the current build this runs as part of the standard pass, so it applies to every document in the set rather than only the ones someone thought to check.

Where it breaks

Scanned originals with poor image quality remain the weakest input. So do agreements that were assembled from three precedents and never reconciled, which is common in long-lived supplier relationships.

None of this removes the reviewer. It moves the reviewer to the part of the work where judgement actually pays.

privacydiscovery

Working notes from the Lawrs team. General information about legal technology and practice, not legal advice.