Databricks Data Engineer
Summary
The Data Engineer will design, implement, and maintain scalable data pipelines and ETL processes within Azure and Databricks environments. The role involves collaborating with cross-functional teams to build big data solutions and ensure high-quality data standards.
Nasze wymagania:
- Minimum 3 years of experience in a Data Engineer role or similar position
- Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake)
- Extensive experience with Databricks and Apache Spark
- Proficiency in SQL and experience with relational databases
- Experience in creating and optimizing data pipelines (ETL/ELT) in cloud environments
- Strong programming skills in Python, Scala, or Java
- Experience with Delta Lake architecture and optimization techniques
- Knowledge of data modeling and schema design
Mile widziane:
- Experience with Azure DevOps and CI/CD pipelines for data solutions
- Knowledge of Databricks Delta Live Tables and Databricks workflows
- Experience with real-time data processing using Azure Event Hubs or Kafka
- Familiarity with Azure Purview or other data governance tools
- Databricks or Azure certifications
O projekcie:
We are looking for an experienced Data Engineer responsible for planning, developing, and maintaining cloud environments for our clients.
Zakres obowiązków:
- Design, implement, and maintain scalable and efficient data pipelines in Azure and Databricks
- Develop and optimize ETL processes using Azure Data Factory and Databricks
- Build Big Data solutions aligned with business requirements
- Collaborate with Data Science, BI, and development teams to ensure high-quality data
- Monitor performance of data processing systems and implement improvements
- Implement data security standards and practices
- Research and evaluate new technologies in the data engineering space
Oferujemy:
- Salary: 100 - 140 zł/h+ VAT (B2B contract)
- Co-financing for training and certifications, as well as guaranteed time for learning during working hours
- Private medical care and a Multisport card
- Language classes (English)
- Flexible working hours
- Team integration meetings and company events
- Employee referral program with a bonus
- An individually tailored career development path