# Legal AI evaluation scorecard

Source: https://judicio.ai/blogs/ai-legal-research-tools-guide

Product / package: __________
Evaluator / date: __________
Jurisdiction / forum / material date: __________
Permitted test documents: __________

- [ ] Confirm the required primary and secondary sources and their versions.
- [ ] Test a known authority, a narrow proposition, an adverse authority and an out-of-scope question.
- [ ] Separate retrieval errors from unsupported reasoning and missing information.
- [ ] Open each authority and check the proposition and relevant treatment.
- [ ] Have another reviewer reproduce the source check.
- [ ] Record review/correction effort and actual usage charges.
- [ ] Review confidentiality, retention, access and export requirements.
- [ ] Record approved tasks, exclusions, remaining checks and the decision owner.

| Question | Source found | Proposition supported | Correction / gap | Reviewer |
| --- | --- | --- | --- | --- |
| | | | | |

This worksheet does not contain measured vendor scores or legal advice.