Middle Data Engineer (Azure Databricks)
Summary
Builds and optimizes data pipelines and transformations using PySpark, Spark SQL, and Azure Databricks to integrate data from multiple sources, design cloud-based architectures, and support analytics for BI teams.
- Build and optimize data transformations using PySpark and Spark SQL
- Collaborate with BI teams to support Power BI reporting
- Design and develop data pipelines using Azure Databricks
- Design cloud-based data architectures
- Design data models and data warehouse structures for analytics
- Develop ETL/ELT pipelines using Azure Data Factory
- Ensure data quality, scalability, and performance
- Implement Lakehouse architectures using Delta Lake
- Integrate data from multiple sources into data platform
- Support and evolve SQL Server data platforms and SSIS ETL solutions
Perks/Benefits:
- Certification programs
- Competitive benefits package
- Health insurance
- Internal mobility
- Internship opportunities
- Mentorship
- Professional development
- Relocation program
- Work from anywhere