QA Lead (Automation+Performance)- Dallas, TX

Photon
Dallas, TX
Job Description
We are seeking a QA Automation Lead who will design and build automation frameworks for Agentic AI products. The candidate will focus on evaluating the performance of autonomous agents and ensuring they follow logical reasoning paths.

Requirements

  • 10+ years in QA Automation with a recent focus on AI/ML or LLM-based applications
  • Expert-level Python skills and experience with testing frameworks like Pytest
  • Familiarity with AI evaluation frameworks such as LangSmith, DeepEval, RAGAS, or Promptfoo
  • Deep experience with Playwright, Selenium, or Cypress for UI, and a heavy focus on API-level testing and database validation
  • Statistical mindset and understanding of AI testing requirements
  • Ability to work with SQL and JSON to validate data retrieved by agents during RAG processes

Benefits

  • Medical, vision, and dental benefits
  • 401k retirement plan
  • Variable pay/incentives
  • Paid time off
  • Paid holidays
]]>