Role OverviewStrong experience with Spark and performance tuning in Spark, solid understanding of Hive and partitioning, and strong understanding of data structures and algorithms.
What You Will Do
Building cloud scalable, real time and high-performance data lake solutions, experience with relational SQL, scripting languages such as Shell, Python, and source control tools such as GitHub.
Why It Might Be a Fit
Able to lead others in solving complex problems by taking a broad perspective to identify innovative solutions.
Requirements
- Strong experience with Spark and performance tuning in Spark
- Solid understanding of Hive and partitioning
- Strong understanding of data structures and algorithms
- Strong understanding of solution and technical design
- Advanced experience building cloud scalable, real time and high-performance data lake solutions
- Experience with relational SQL
- Experience with scripting languages such as Shell, Python
- Experience with source control tools such as GitHub and related dev processes
- In-depth understanding of micro service architecture
- Able to lead others in solving complex problems by taking a broad perspective to identify innovative solutions
]]>