Middle Data Engineer (Azure Databricks)
Posted Updated 10
views
Summary
Builds and optimizes data pipelines and transformations using PySpark, Spark SQL, and Azure Databricks to integrate data from multiple sources, design cloud-based architectures, and support analytics for BI teams.
- Build and optimize data transformations using PySpark and Spark SQL
- Collaborate with BI teams to support Power BI reporting
- Design and develop data pipelines using Azure Databricks
- Design cloud-based data architectures
- Design data models and data warehouse structures for analytics
- Develop ETL/ELT pipelines using Azure Data Factory
- Ensure data quality, scalability, and performance
- Implement Lakehouse architectures using Delta Lake
- Integrate data from multiple sources into data platform
- Support and evolve SQL Server data platforms and SSIS ETL solutions
Perks/Benefits:
- Certification programs
- Competitive benefits package
- Health insurance
- Internal mobility
- Internship opportunities
- Mentorship
- Professional development
- Relocation program
- Work from anywhere