Role OverviewAs an Instructional Designer, you will guide research and program teams to create clear and consistent rating guidelines for AI raters across various domains. You will design and evaluate guidelines to ensure accuracy and consistency. You will collaborate with subject matter experts to ensure consistency and accuracy across guideline sets.
What You Will Do
Your main responsibilities will include designing clear rating guidelines and rubrics, evaluating and revising draft guidelines for ambiguity and contradiction, translating program specifications into precise rater instructions, and collaborating with subject matter experts to ensure consistency and accuracy.
Why It Might Be a Fit
We are looking for a candidate with 3+ years of professional experience in linguistics, instructional design, or a related field, with direct experience writing guidelines for human raters in a GenAI/RLHF context. You should have a strong track record of resolving ambiguity and contradiction in written specifications, and be able to engage reliably for at least 35 hours/week during weekdays.
Requirements
- 3+ years of professional experience in linguistics, instructional design, technical writing, or a related field
- Direct experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context
- Ability to work across multiple domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuances
- Strong track record of resolving ambiguity and contradiction in written specifications
- Ability to engage reliably for at least 35 hours/week during weekdays
- Strong written communication skills to explain complex guidance clearly
]]>