Role OverviewEvaluate AI models on visual document understanding in the Architecture domain. Author complex, grounded tasks with clear ground-truth outputs and objective rubrics. Review and improve AI model outputs for accuracy and alignment with architectural principles.
What You Will Do
Evaluate AI models, author tasks, and review AI model outputs. Collaborate with subject matter experts to ensure task relevance and coverage. Work independently and asynchronously to meet deadlines and enhance model performance.
Why It Might Be a Fit
Must have expertise in the Architecture domain and experience in authoring complex, grounded tasks.
Requirements
- Expertise in the Architecture domain
- Experience in authoring complex, grounded tasks
]]>