Senior Databricks Data Engineer
Summary
Senior Databricks Data Engineer based in Warsaw: design and implement large-scale data processing solutions on Databricks, build data pipelines with Python and cloud-native tools, and ensure consistency, security, and scalability across AWS, Azure, or GCP within a 400+ strong Insights & Data team following SDLC and DevOps best practices.
Insights & Data is a thriving team of over 400 professionals focused on delivering advanced data-driven solutions. Our expertise lies in Cloud & Big Data engineering, where we build scalable architectures for processing large and complex datasets across AWS, Azure, and GCP. We manage the entire Software Development Life Cycle (SDLC), leveraging modern data frameworks, programming methodologies, and DevOps best practices to create impactful and efficient solutions.
- Design and implement data processing solutions using Databricks for large-scale and diverse datasets.
- Design, build, and enhance data pipelines with Python and cloud-native tools.
- Work closely with solution architects to define and uphold best practices in data engineering.
- Ensure data consistency, security, and scalability within cloud-based environments.
- Experience in data engineering, with hands-on Databricks expertise.
- Strong experience in Python for automation and data transformation.
- Experience working with at least one major cloud platform (AWS, Azure, or GCP).
- Strong communication skills and strong English language skills.