AI Modeling Engineer

Palona AI
New York, NY
Job Description
Role Overview

The AI Modeling Engineer will own problems across model selection and routing, prompting and context, fine-tuning or post-training when justified, speech and language quality, evaluation methodology, dataset development, and model behavior in production. Research depth matters, but success is measured by improvements that survive contact with production and create better guest, restaurant, and business outcomes.

What You Will Do

Develop modeling and experimentation strategies for high-impact agent problems in voice, language, reasoning, ordering, multilingual behavior, and multimodal understanding. Build rigorous offline and online evaluations that measure task completion, accuracy, safety, latency, cost, conversational quality, and business outcomes.

Why It Might Be a Fit

The ideal candidate will have strong machine learning foundations, hands-on experience developing or evaluating production AI systems, and experience with modern ML tooling such as PyTorch, JAX, Hugging Face, or equivalent systems. They will be able to design reliable experiments, define useful metrics, analyze noisy results, and avoid optimizing against weak proxies.

Requirements

  • 3+ years of industrial experience in relevant technical domain
  • Strong machine learning foundations
  • Hands-on experience developing or evaluating production AI systems
  • Strong Python skills and experience with modern ML tooling
  • Practical experience with LLMs, speech models, multimodal models, or agentic systems
  • Ability to design reliable experiments and define useful metrics

Benefits

  • Competitive Salary
  • Stock Option Plan
  • Medical benefits
  • Dental benefits
  • Vision benefits
  • Retirement benefits
  • Leave benefits
  • Short Term Disability benefits
  • Long Term Disability benefits
  • Paid time off
  • Company holidays
  • Learning and development support
]]>