Data Ops Engineer

Shamrock Trading Corporation
Overland Park, KS
Category Data Analyst
Job Description
Shamrock Trading Corporation is seeking a DataOps Engineer who is passionate about data automation and lifecycle management. The role involves implementing cutting-edge DataOps methodologies to optimize data engineering and analytics frameworks, ensuring high-quality data solutions and contributing to the overall robustness and reliability of data systems.

Requirements

  • Bachelor's degree in Computer Science, Engineering, Analytics or a related field
  • Experience with Databricks, including Unity Catalog, Delta Lake, and Spark Streaming
  • Experience in build and deployment technologies such as Docker, AWS Code Build, Code Deploy, ECR, ECS
  • Experience with star schema data warehouse
  • Proficient in automated testing frameworks and tools
  • Skilled in cloud data technologies and modern programming languages including Python, SQL, Java, and Spark
  • Experience using CLI tools and familiarity with linux
  • Demonstrated ability to work collaboratively in a dynamic team environment with a proactive, positive attitude

Benefits

  • Training and Development
  • Medical: Fully paid healthcare, dental and vision premiums for employees and eligible dependents, and gym benefits
  • Financial: One-time sign-on bonus, generous company 401(k) contributions and employee stock ownership after one year
  • Work-Life Balance: Competitive PTO and work from home opportunities after an introductory period
]]>