Role OverviewAs a Legal Research Specialist, you will review and QA AI-agent rollouts by verifying agent answers against actual dockets, ensuring accuracy in case details and outcomes. You will identify failure modes by analyzing agent performance and flagging tasks that are too simple or solvable without PACER. You will improve realism and difficulty of tasks to reflect authentic federal docket research, enhancing challenge for capable agents.
What You Will Do
Your main day-to-day responsibilities will include reviewing and verifying AI-agent rollouts, identifying failure modes, and updating grading guidance to ensure accuracy. You will also catch plausible-but-wrong answers that might be overlooked by non-expert reviewers.
Why It Might Be a Fit
To be a fit for this role, you will need to have frequent hands-on PACER/CM/ECF use for federal docket research, 2+ years in federal litigation support, and the ability to read a federal docket on sight. You will also need to have sound judgment on correct, complete answers with confidence to mark plausible answers wrong.
Requirements
- Frequent hands-on PACER/CM/ECF use for federal docket research
- 2+ years in federal litigation support
- Ability to read a federal docket on sight
- Proficiency with PACER search mechanics and name-variant traps
- Sound judgment on correct, complete answers
]]>