Lead Data Engineer

Seeking a hands-on Lead Data Engineer to design, build, and lead scalable data platforms and real-time streaming solutions.

What You Will Do

Design and manage production-grade data pipelines and platforms, build real-time streaming and event-driven data solutions, develop data services supporting APIs, microservices, analytics, and ML/AI.

Why It Might Be a Fit

Must have strong Databricks, Spark, Delta Lake, Python/PySpark, SQL, and Azure experience, along with technical leadership and stakeholder management skills.

Requirements

• 10+ years of data/software engineering experience
• 7+ years building production data pipelines and platforms
• 5+ years with Databricks, Spark, Delta Lake, SQL, and Python/PySpark
• 3+ years in technical leadership or team mentoring
• Strong Azure cloud and real-time streaming experience
• Experience with CI/CD, DevOps, APIs, microservices, and data orchestration
• Strong knowledge of data quality, governance, observability, and production support