Data Engineer

Requirements

• 3+ years hands-on coding experience in Python
• 3+ years experience in designing and building Microservices
• 3+ years experience with REST API design and development using Python
• 3+ years experience with deployment/scaling of apps on containerized environment (i.e., Kubernetes, AKS)
• 3+ years experience with real-time and streaming technology (i.e., Azure Event Hubs, Azure Functions Kafka, Spark Streaming)
• 3+ years experience with cloud-based platforms (i.e., Azure, GPC, AWS)
• Experience building automated big data pipelines
• Experience performing data analysis and data exploration
• Experience working in an agile delivery environment
• Experience with Snowflake
• Experience with RDBMS and NoSQL Databases and hands-on query tuning/optimization
• Experience working in multi-developer environment, using version control (i.e., Git)
• Experience with orchestrating pipelines using tools (i.e., Airflow, Azure Data Factory)
• Experience with data modeling and system architecture design
• Experience partnering cross-functionally with other technical teams (i.e., data ingestion, data science, operational systems) to align priorities and achieve deliverable outcomes
• Experience with setting coding standards, performing code reviews, and mentoring junior developers
• Exposure/understanding DevOps best practice and CICD (i.e., Jenkins)
• Ability to understand complex systems and solve challenging analytical problems
• Strong critical thinking, communication, and problem-solving skills and a quick learner