Applied AI Data Analyst

As an Applied AI Data Analyst, you will bridge the gap between our massive, unstructured financial and operational datasets to our core R&D team. You will own the evaluation platform of our agentic workflows forecasting pipelines, as well as improve customer facing insights leading to mission-critical decisions. This role is part of the Applied AI Research department, with options to advance to senior data science and AI/ML engineering roles.

What You Will Do

You will analyze edge cases, model predictions, hallucination rates, and extraction accuracy for our LLM-driven document processing systems and agentic workflows. You will dig deep into complex datasets to determine why an extraction or time-series model succeeded or failed. You will define, curate, and maintain gold-standard evaluation datasets for automated backtesting of AI agents and demand forecasting models. You will build dashboards, data transformations, and evaluation harnesses to monitor system health, model drift, and AI performance metrics across release cycles.

Why It Might Be a Fit

We are looking for a candidate with a graduate degree in a related STEM field, 2–4 years of experience in a quantitative data analyst or AI evaluation role, and proficiency in Python and AI/ML models. You should have strong capabilities with SQL and enterprise data infrastructure. You should be able to translate noisy, unstructured document data into rigorous evaluation insights for engineers.

Requirements

• Graduate degree (M.S. or Ph.D.) in Computer Science, Data Science, Statistics, Mathematics, Physics, or a related STEM field.
• 2–4 years of experience in a quantitative data analyst or AI evaluation role, working closely alongside AI/ML R&D teams.
• Proficiency in Python and hands-on work with AI/ML models
• Strong capabilities with SQL and enterprise data infrastructure (PostgreSQL, Snowflake, dbt, AWS).
• Exceptional ability to translate noisy, unstructured document data into rigorous evaluation insights for engineers.

Benefits

• Equity — own a meaningful piece of the company you’re helping build
• Fully paid health coverage through Aetna — we cover 100% of employee premiums
• Top-tier dental and vision coverage through Guardian
• Carrot Fertility Pro — comprehensive fertility and family-forming support
• 12 weeks of paid parental leave
• Unlimited PTO — plus regular 4-day holiday weekends we actually take
• 401(k) through Vestwell
• Paid relocation support — we’ll help you make the move to NYC
• Fully equipped workspace from day one — laptop, monitor, keyboard, and a $200 stipend to personalize your setup
• Team perks — catered Friday lunches, team dinners, and unlimited coffee + snacks featuring products from the brands we work with