Role OverviewWe are seeking a part-time Big Data Engineer to contribute technical expertise to an advanced AI development project. The selected professional will apply practical big-data engineering experience to complex data problems involving pipeline architecture, integration, transformation, distributed processing, storage, and system reliability.
What You Will Do
Design, build, and maintain scalable data pipelines and big-data architectures, develop reliable workflows for ingesting, transforming, processing, and delivering large volumes of data, and translate technical and business requirements into robust data-engineering solutions.
Why It Might Be a Fit
The ideal candidate will have proven professional experience in big-data engineering, advanced proficiency in Python, and a deep understanding of relational and NoSQL databases.
Requirements
- Proven professional experience in big-data engineering
- Advanced proficiency in Python
- Deep understanding of relational and NoSQL databases
- Practical experience with distributed data-processing frameworks
- Strong foundation in data modelling, ETL processes, data integration, and data-warehousing principles
- Ability to troubleshoot distributed systems, database performance, pipeline failures, and data-quality issues
]]>