Data Engineer with Databricks Expertise
Posted
Summary
Intermediate-to-senior data engineer for a North American utility, placed via staffing firm S.I. Systems. Day to day: build scalable Databricks pipelines with PySpark/SQL and medallion (bronze/silver/gold) architecture, integrate SAP and Azure data, and enable automated Power BI reporting while collaborating in Agile sprints.
Elevate your career as an Intermediate to Senior Data Engineer with a North American utility. This role focuses on building scalable Databricks pipelines to enable automated Power BI reporting.
Our client is seeking a Data Engineer to help transform their data analytics capabilities. The position requires developing reliable data models and metrics within a medallion architecture framework. You will collaborate in Agile sprints with data architects, analysts, and business partners, enhancing data quality and pipeline reliability to deliver impactful insights.
Key Responsibilities: • Design and build data pipelines in Databricks • Develop bronze, silver, and gold layer data architecture • Translate business needs into reusable data models • Enable automated reporting in Power BI • Integrate data from sources like SAP and Azure
Requirements: • 5 to 10+ years in data engineering • Proficient with Databricks, PySpark, SQL • Experience with medallion architecture • Ability to work within Agile frameworks • Familiarity with Azure environment
Transform data engineering for automated reporting with your expertise in Databricks and a focus on quality.
Our client is seeking a Data Engineer to help transform their data analytics capabilities. The position requires developing reliable data models and metrics within a medallion architecture framework. You will collaborate in Agile sprints with data architects, analysts, and business partners, enhancing data quality and pipeline reliability to deliver impactful insights.
Key Responsibilities: • Design and build data pipelines in Databricks • Develop bronze, silver, and gold layer data architecture • Translate business needs into reusable data models • Enable automated reporting in Power BI • Integrate data from sources like SAP and Azure
Requirements: • 5 to 10+ years in data engineering • Proficient with Databricks, PySpark, SQL • Experience with medallion architecture • Ability to work within Agile frameworks • Familiarity with Azure environment
Transform data engineering for automated reporting with your expertise in Databricks and a focus on quality.