Role OverviewWe are seeking a Conversational AI Data Analyst with a strong understanding of model performance metrics, ongoing monitoring, and model risk management. This role requires knowledge of NLU model performance measurement, LLM governance, and the reports and documentation needed to support model governance and risk management.
What You Will Do
Collect, clean, transform, and structure customer conversation scripts. Analyze conversational data by intent, entity, user segment, channel, fallback cases, and low-confidence predictions. Maintain and monitor intent classification machine Learning Models.
Why It Might Be a Fit
The ideal candidate will have technical expertise in Python-based data analysis, model documentation, reporting, and Tableau-based visualization. Strong analytical thinking, communication, and data storytelling skills are required.
Requirements
- Strong Python skills for data manipulation using Pandas and NumPy.
- Experience with text preprocessing, data cleaning, tokenization, normalization, and data structuring.
- Working knowledge of ML models – specifically NLP/NLU/LLM concepts.
- Ability to create model governance documents and reports
Benefits
- Medical insurance
- Dental insurance
- Vision insurance
- Pharmacy insurance
- Life insurance
- Accidental death & dismemberment insurance
- Disability insurance
- Employee assistance program
- 401(k) retirement plan
- 10 days of paid time off per year
- 10 paid holidays per year
]]>