Role OverviewThe Technical Lead - Big Data will support the Big data ETL platform built on top of Hadoop, requiring expertise in Hadoop, Spark, and Unix shell scripting technologies. The role involves understanding data warehouse, data lake, and lake house related ETL/ELT concepts, data quality, governance, and performance tuning aspects.
What You Will Do
The Technical Lead - Big Data will be responsible for supporting the Big data ETL platform, requiring strong analytical and problem-solving skills. The role also involves working with ITSM tools like Remedy, JIRA, and understanding work order, incident, problem, and change management.
Why It Might Be a Fit
The ideal candidate will have 5-8 years of experience and a strong understanding of Big Data technologies, including Hadoop, Spark, and data warehouse concepts. The role also requires a strong analytical and problem-solving skills, and the ability to work with ITSM tools.
Requirements
- Hadoop (HDFS/Ozone, Hive)
- Spark(Python/ Scala/ Java)
- SparkUI
- Unix shell scripting technologies
- Understanding of Data Warehouse/Data Lake/Lake House related ETL/ELT concepts, data quality, governance and performance tuning aspects
- Strong analytical and problem-solving skills
Benefits
- Full range of medical and dental benefits options
- Disability insurance
- Paid time off (inclusive of sick leave)
- Other paid and unpaid leave options
]]>