Role OverviewThe AI CoE Principal Software Engineer will report to the Sr. Director, AI Center of Excellence, in the Technology Department. This role is the most senior individual contributor on the team and the technical owner of the enterprise AI engineering foundation.
What You Will Do
Primary duties include designing and building the shared AI platform and semantic routing layer; product inference and personalization, partnering with AI-Ops on monitoring, evaluation, and governance guardrails; building secure, compliant AI integration patterns for a regulated financial services and health and benefits environments.
Why It Might Be a Fit
This role requires a strong track record as the most senior technical owner of an enterprise-scale platform, with a minimum of 12 years building and operating production software, including 4+ years delivering production AI/ML systems and 2+ years of LLM or agentic systems in production.
Requirements
- Bachelor of Science Degree in Computer Science
- AI Practitioner Certifications are a plus
- 12+ years building and operating production software, including 4+ years delivering production AI/ML systems and 2+ years of LLM or agentic systems in production
- Deep fluency with AI-assisted development environments such as GitHub Copilot, Claude Code, or ONA
- Semantic routing and model orchestration, including embedding-based intent analysis, deterministic fallback logic, and policy-based model selection across multiple providers on cost, latency, and privacy criteria
- Observability and AI Ops for non-deterministic systems, including distributed tracing, behavioral analysis, usage and quality metrics, drift detection, and cost and latency telemetry for executive reporting
- Security-aware engineering with demonstrated experience handling PII and sensitive data, including encryption, secrets management, least-privilege access, and audit trails in a regulated environment
- Model hosting and serving experience, including deploying and operating commercial and open-weight models behind a gateway or proxy
- Evaluation and reliability engineering for probabilistic systems, including eval harnesses, golden datasets, offline and online scoring, guardrails, red-teaming, hallucination mitigation, and human-in-the-loop review design
- Technical leadership without formal authority, including architecture decision records, design reviews, mentoring senior and staff engineers, and communicating trade-offs to executive stakeholders
]]>