PySpark Developer

Inizio Partners Corp
Hartford, CT
Job Description
We are seeking a highly skilled and experienced Python and PySpark Developer to join our team.

Requirements

  • Design and implement scalable data pipelines using PySpark and other big data frameworks.
  • Develop reusable and efficient code for data extraction, transformation, and loading (ETL).
  • Optimize data workflows for performance and cost efficiency.
  • Process and analyze structured and unstructured datasets.
  • Build and maintain data lakes, data warehouses, and other storage solutions.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Troubleshoot and resolve performance bottlenecks in big data pipelines.
  • Write clean, maintainable, and well-documented code.
  • Ensure compliance with data governance and security policies.
]]>