Role OverviewDesign, build, and operate reliable, scalable data pipelines on PowerSecure's Azure data platform to enable trusted analytics and self-service BI. Partner with BI Developers, Data Architect, and business stakeholders to ingest, model, and deliver high-quality data.
What You Will Do
Design and implement end-to-end ELT pipelines, implement data quality checks, build curated Delta tables, implement CDC and deletion-flag patterns, and operationalize jobs with monitoring, logging, and alerting.
Why It Might Be a Fit
Strong SQL, PySpark/Spark SQL, and data modeling fundamentals, proficiency with SQL and Python, experience with Azure Databricks, Delta Lake, and Azure Data Factory, and excellent communication, documentation, and cross-functional collaboration skills.
Requirements
- 2+ years of hands-on data engineering or comparable software engineering with significant data work
- 2+ years building pipelines on Azure and Databricks
- Strong SQL (analytical queries, window functions), PySpark/Spark SQL, and data modeling fundamentals
- Bachelor's degree in MIS, Computer Science, Engineering, or equivalent experience
- Proficiency with SQL and Python (PySpark)
- Experience with Azure Databricks, Delta Lake, Delta Live Tables, Azure Data Factory, ADLS Gen2, and Azure DevOps/Git for CI/CD
- Working knowledge of Unity Catalog and/or Microsoft Purview for governance, lineage, and security
- Familiarity with data ingestion patterns, schema evolution, CDC, and deletion detection patterns
- Understanding of dimensional modeling to produce analytics-ready datasets for Power BI
- Exposure to orchestration/monitoring, cost optimization, alerting, and runbook-driven operations
- Data pipeline design (batch & streaming), DLT expectations for data quality, and robust error handling
- Source control, branching strategies, and CI/CD for data assets (notebooks, jobs, workflows)
- Practical understanding of privacy, security, and RBAC in cloud data platforms
- Excellent communication, documentation, and cross-functional collaboration skills
- Analytical mindset; bias toward automation and measurable reliability
Benefits
- Medical, dental, vision and life insurance coverage
- Competitive pay and a matching 401(k) plan
- Vacation, Company Holidays, Paid Time Off (PTO - personal and sick days)
- Flexible spending accounts/Health savings account
- Wellness Incentive Programs
- Employee Referral Program
- Tuition Reimbursement
]]>