Role OverviewThe Senior Technical Lead will develop services to enable data ingestion from and synchronization with systems, design and implement event-driven architectures, and develop efficient Python scripts to handle and process large datasets. The role requires collaboration with the business application owner and data team to decompose business logic and data transformation patterns. The Senior Technical Lead will also transition existing pipelines to MSSQL server and design and document the target data architecture, pipelines, processing, and analytics architecture.
What You Will Do
Develop services to enable data ingestion from and synchronization with systems, design and implement event-driven architectures, develop efficient Python scripts to handle and process large datasets, transition existing pipelines to MSSQL server, and collaborate with the business application owner and data team.
Why It Might Be a Fit
The ideal candidate will have experience with AWS Glue, Kafka, or SNS/SQS, Python/PySpark, data lakes, and cloud environments. The role requires strong problem-solving skills, the ability to work in a cloud-native architecture, and experience with NoSQL databases. The Senior Technical Lead will also have opportunities for growth and development within the company.
Requirements
- AWS Glue, Kafka, or SNS/SQS
- Python/PySpark
- Data lake
- Cloudwatch
- Cloudtrail
- SNS/SQS
- DB design and SQL
- AWS IAM
- EKS
Benefits
- Medical, dental, vision, pharmacy, life, accidental death & dismemberment, and disability insurance
- Employee assistance program
- 401(k) retirement plan
- 10 days of paid time off per year
- 10 paid holidays per year
]]>