Databricks Data Engineer

Inizio Partners Corp
New York, NY
Category Engineering
Job Description
We are seeking a Databricks Data Engineer to design and develop data systems, lead in designing and developing data systems, and engage with clients to evaluate their current and future needs. The candidate will have experience in architecture, design, and implementation using Databricks, designing and implementing scalable, fault-tolerant systems, and a deep understanding of one or more of the big data computing technologies such as Databricks, snowflake.

Requirements

  • 5+ years experience in architecture, design, and implementation using Databricks
  • Experience in designing and implementing scalable, fault-tolerant systems
  • Deep understanding of one or more of the big data computing technologies such as Databricks, snowflake
  • Experience in implementing solutions using Databricks
  • Experience in Insurance (P&C) is good to have
  • Programming Languages: SQL, Python
  • Technologies: Databricks, Delta Lake storage, Spark (PySpark, Spark SQL).
  • Good to have: Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
  • Project Management using Agile, Scrum
  • B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering, or other science field), Information Systems, Information Processing, or engineering.
  • Excellent communication & leadership skills, with the ability to lead and motivate team members
  • Ability to work independently with some level of ambiguity and juggle multiple demands
]]>