Data Engineer

24-MAG
New York, NY
Job Description
Role Overview

We are seeking an experienced Data Engineer to design and scale distributed data pipelines, manage large datasets across cloud environments, and build reliable systems for analytics, experimentation, and model development.

What You Will Do

Design and build large-scale pipelines for structured and unstructured data, develop distributed processing workflows using Apache Spark, and optimize transformations, partitioning strategies, and computational workloads.

Why It Might Be a Fit

Ideal candidate has strong professional experience in data engineering or distributed data systems, advanced proficiency in Python and SQL, and hands-on experience with Apache Spark or comparable distributed-processing frameworks.

Requirements

  • Strong professional experience in data engineering or distributed data systems
  • Advanced proficiency in Python and SQL
  • Hands-on experience with Apache Spark or comparable distributed-processing frameworks
  • Strong experience with AWS data services and cloud-native architecture
  • Experience with SQL and NoSQL databases
  • Demonstrated experience processing large-scale datasets
  • Strong understanding of partitioning, performance optimisation, and scalable architecture
  • Familiarity with orchestration, automation, monitoring, and data-quality workflows

Benefits

  • Full-time engagement
  • Fully remote
]]>