Data & citation

Download the release, reproduce the results and cite LegalScope.

The public release contains 276 case prompts with scoring references, 78 Victorian Bar source excerpts with selected candidate answers, 7,728 case model responses and 34,636 individual scores.

Original judgments are excluded to protect privacy and confidentiality. The remaining 783 exam inputs are excluded because third-party rights have not been cleared for redistribution.

Case annotations use MIT. Victorian Bar excerpts retain CC BY-NC-ND 4.0 and their source notices.

Citation

AI Measurement Science Workshop
at COLM 2026

@inproceedings{wang2026legalscope,
  title = {{LegalScope}: Measuring Exam-to-Case
           Transfer in {LLM} Legal Reasoning},
  author = {Wang, Hongyu and Han, Rilyn R. and
            Zhao, Yilun and Zhao, Xuandong and
            Cohan, Arman},
  booktitle = {AI Measurement Science Workshop
               at COLM 2026},
  year = {2026},
  url = {https://openreview.net/forum?id=BNx62Wx1ej}
}