Data Engineer SME

Iron EagleX
Arlington, VA
Job Description
We are seeking an Data Engineering SME to design, build, and operate data pipelines that ingest, store, and process high-volume, multi-source data primarily for modern AI/ML processes.

Requirements

  • Design, develop, and implement scalable data pipelines and ETL processes using Apache Airflow, with a focus on data for AI applications.
  • Develop messaging solutions utilizing Kafka to support real-time data streaming and event-driven architectures.
  • Build and maintain high-performance data retrieval solutions using ElasticSearch/OpenSearch.
  • Implement and optimize Python-based data processing solutions.
  • Integrate batch and streaming data processing techniques to enhance data availability and accessibility.
  • Ensure adherence to security and compliance requirements when working with classified data.
  • Work closely with cross-functional teams to define data strategies and develop technical solutions aligned with mission objectives.
  • Deploy and manage cloud-based infrastructure to support scalable and resilient data solutions.
  • Optimize data storage, retrieval, and processing efficiency.

Benefits

  • 401k Matching
  • Generous Paid Time Off
  • Retirement Plan
  • Visa Sponsorship
  • Four Day Work Week
  • Generous Parental Leave
  • Tuition Reimbursement
  • Relocation Assistance
]]>