Role OverviewThe Senior Technical Specialist will design and build scalable data lakes, Lakehouse, DWH, streaming & analytics platforms, and implement data governance, security, quality, metadata & lineage frameworks. They will automate monitoring, scaling, and governance using CloudWatch, Event Bridge, and lambda. The Specialist will own end-to-end environment automation, establish development tools and infrastructure for automation, and understand the needs of stakeholders and convey this to developers.
What You Will Do
Designing scalable data lakes, Lakehouse, DWH, streaming & analytics platforms. Design, build, and manage Glue catalogs, Glue jobs. Architect and optimize AWS-based ETL/ELT, ML, and real-time data pipelines. Implement data governance, security, quality, metadata & lineage frameworks. Automate monitoring, scaling, and governance using CloudWatch, Event Bridge, and lambda.
Why It Might Be a Fit
The ideal candidate will have experience with AWS DevOps (Security), Terraform, IAC, GitLab CI/CD, Docker, Kubernetes, and knowledge of data lakes, Lakehouse, DWH, streaming & analytics platforms, Glue catalogs, Glue jobs. They will be able to work with software developers and software engineers to ensure that development follows established processes and works as intended.
Requirements
- AWS DevOps (Security)
- Terraform
- IAC
- GitLab CI/CD
- Docker
- Kubernetes
- AWS cloudwatch
- AWS Service Mesh
- API Gateway
- Kong
- Knowledge of data lakes, Lakehouse, DWH, streaming & analytics platforms, Glue catalogs, Glue jobs
Benefits
- medical
- dental
- vision
- pharmacy
- life
- accidental death & dismemberment
- disability insurance
- employee assistance program
- 401(k) retirement plan
- 10 days of paid time off per year
- 10 paid holidays per year
]]>