Databricks Architect

Inizio Partners Corp
Dublin, OH
Category Data Analyst
Job Description
Our client provides data-driven solutions to business problems through statistical data mining and cutting-edge analytics techniques. They are seeking a Databricks Architect to develop and optimize ETL pipelines using Databricks on cloud and lead data engineering projects.

Requirements

  • 8+ years' experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud
  • Some experience in the insurance domain/data is a must
  • Programming Languages: SQL, Python
  • Technologies: IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL)
  • Good to have: Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps
  • Project Management using Agile, Scrum
  • B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering
  • Excellent communication & leadership skills, with the ability to lead and motivate team members
  • Ability to work independently with some level of ambiguity and juggle multiple demands
]]>