Lead Data Engineer

The Lead Data Engineer will plan and lead research and development related to advanced analytic data solutions, leveraging GenAI. They will work with business and technology leaders to understand scope and requirements, business needs, and data from across the Disney company to design and deliver data pipelines necessary for solutions.

What You Will Do

Responsibilities include planning, estimating, design, development, testing, production rollout, and sustainment activities. The Lead Data Engineer will also consult and collaborate with project team members, lead design reviews, do hands-on development, and communicate with colleagues and leaders.

Why It Might Be a Fit

The ideal candidate will have 7+ years of experience in data engineering development, experience with GenAI models, tools, and concepts, and 3+ years of experience leading and deploying code using a source control product such as GitLab/GitHub.

Requirements

• 7+ years overall experience in a data engineering development capacity using a multiple environments (Dev, QA, Prod, etc.) and DevOps procedures for code deployment/promotion
• Experience with a variety of GenAI models, tools, and concepts
• 3+ years using, designing and building relational databases (preferably Snowflake or PostgreSQL)
• 3+ years of experience leading and deploying code using a source control product such as GitLab/GitHub
• 2+ years of experience with job scheduling software like Apache Airflow, Amazon MWAA, GitLab Runners or UC4
• Multiple years of experience with ELT/ETL data pipeline development and maintenance
• Multiple years of shown experience and expertise using SQL and Python
• Experience using containerization technologies such as Docker or Kubernetes
• Knowledgeable on cloud architecture and product offerings, preferably AWS
• Understanding of Knowledge Graphs, Data Mesh, and other data sharing platforms
• Experience translating project scope and high-level requirements into technical data engineering tasks
• Experience defining solutions to sophisticated data engineering problems in support of advanced analytic processes
• Experience collaborating with multiple project teams in a fast-paced environment
• Experience with defining and estimating level-of-effort data engineering activities
• Experience with project and sprint planning
• Ability to communicate technical concepts and solutions to non-technical team members
• Experience designing and building data structures to support requirements

Benefits

• full range of medical, financial, and/or other benefits
• bonus
• long-term incentive units