Data Engineer / ROR
Summary
Builds and maintains scalable data pipelines and workflows using Databricks, Apache Spark, and Azure cloud services to process large datasets, ensuring data quality and collaboration with cross-functional teams.
For our client, we are looking for experienced Data Engineer. If you have a strong background in data engineering, Big Data technologies, and cloud-based data solutions, we'd be happy to hear from you.
Main Responsibilities:
- Design, develop, and maintain scalable data solutions and data pipelines.
- Build and optimize data processing workflows.
- Work with Databricks and Apache Spark to process large volumes of data.
- Develop and maintain data solutions within the Microsoft Azure ecosystem.
- Collaborate with data analysts, architects, and other stakeholders to deliver business value.
- Ensure data quality, performance, and security across data platforms.
Must Have
- Proven experience as a Data Engineer.
- Hands-on experience with Databricks.
- Experience with Azure Data Processing and Storage Services.
- Practical experience working with Apache Spark.
- Strong knowledge of SQL.
- Experience developing solutions in Python.
- Good understanding of Big Data processing standards, tools, and best practices.
- Proficiency in Polish language.
- English language skills at B2 level or higher.
Nice to Have
- Bachelor's or Master's degree in Computer Science, Data Engineering, Mathematics, or a related field.
- Experience working on Big Data projects utilizing Databricks and Spark.