QA Engineer

Scaled Cognition
New York, CA
Job Description
Scaled Cognition is seeking a QA Engineer to develop and implement scalable QA plans for evaluating AI agents, collaborating with product and engineering teams, and leading a team of QA engineers.

Requirements

  • Intermediate-level proficiency in Python
  • Experience building and testing conversational AI/LLM systems
  • Background in implementing evaluation benchmarks, and production monitoring metrics
  • Experience working with libraries and tooling common in the AI/LLM ecosystem
  • Demonstrated precision in documenting test plans, test cases, and bug reports
  • Experience with leveraging AI-powered assistants/tooling to enable rapid iteration, prototyping, and accelerated delivery
]]>