Remote | Big Data Engineer

24-MAG
New York, NY
Job Description
Role Overview

We are seeking a part-time Big Data Engineer to contribute technical expertise to an advanced AI development project. The selected professional will apply practical big-data engineering experience to complex data problems involving pipeline architecture, integration, transformation, distributed processing, storage, and system reliability.

What You Will Do

Design, build, and maintain scalable data pipelines and big-data architectures, develop reliable workflows for ingesting, transforming, processing, and delivering large volumes of data, and translate technical and business requirements into robust data-engineering solutions.

Why It Might Be a Fit

The ideal candidate will have proven professional experience in big-data engineering, advanced proficiency in Python, and a deep understanding of relational and NoSQL databases.

Requirements

  • Proven professional experience in big-data engineering
  • Advanced proficiency in Python
  • Deep understanding of relational and NoSQL databases
  • Practical experience with distributed data-processing frameworks
  • Strong foundation in data modelling, ETL processes, data integration, and data-warehousing principles
  • Ability to troubleshoot distributed systems, database performance, pipeline failures, and data-quality issues
]]>