Senior Databricks Engineer
Summary
Senior Databricks Engineer builds and maintains scalable data pipelines and ETL processes on Azure using Databricks, PySpark, and Python.
We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland.
Avanade website; Privacy policy
This role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).
Position:
As Senior Databricks Engineer, you will be working in projects for various domains and industries, focused mostly around Databricks and Azure cloud. Among your tasks there will be:
Designing, building, and maintaining scalable, efficient, and reliable data pipelines
End-to-end development of data architectures and ETL processes
Collaborating with data scientists, analysts, and other engineering teams to ensure data integration and optimization
Implementing best engineering practices across data systems
Optimizing performance of data workflows and ensuring the reliability of data solutions
Staying up-to-date with the latest developments in data engineering world
Acting as a Team Lead in the project if needed
Possibility to develop yourself in AI engineering
Required skills:
For this role, we require commercial experience with:
Databricks
Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks)
Python and PySpark
SQL
Data Engineering concepts such as ETL, data modeling, data warehousing, data governance
Docker and Kubernetes
English (B2)
Nice to have:
Knowledge of OCR and corresponding libraries (e.g. easyOCR)
Any experience in data science area
If you want to ask any questions before applying, feel free to reach out via LinkedIn!