Databricks Data Engineer (ICH Europe)
Summary
Build and maintain scalable data pipelines and Lakehouse models on Databricks, using PySpark, Delta Lake, and Medallion architecture to deliver analytics-ready datasets for enterprise clients.
Databricks Community of Practice
Join our Databricks Community of Practice in Poland, where delivery excellence is at the core of everything we do. We design and build modern data products as well as advanced GenAI and agentic solutions powered by Databricks. As part of a global network of 9,000+ AI experts and data scientists, we collaborate with leading technology partners—including Databricks, AWS, Google Cloud, Microsoft, Snowflake, and SAS to deliver scalable, enterprise-grade data solutions that generate measurable business impact.
Responsibilities
- Design and implement scalable end-to-end data pipelines (ETL/ELT) using Databricks (batch and streaming), including modern orchestration patterns such as Delta Live Tables.
- Develop and maintain data models using Lakehouse and Medallion architecture (Bronze, Silver, Gold layers).
- Build robust data transformations using PySpark, Spark SQL, and Delta Lake.
- Integrate diverse cloud and enterprise data sources into unified, high-quality, analytics-ready datasets.
- Collaborate with architects, analysts, and data scientists to deliver production‑grade data products.
- Implement DevOps and DataOps practices, including Git‑based version control, CI/CD pipelines, and testing of data workflows.
Experience Requirements (Cumulative)
- At least 2 years of hands-on experience working with relational or analytical databases, applying SQL, Python or Spark for development, testing, debugging, and performance optimisation in production environments.
- Within that experience, at least 1 year practical experience designing or implementing ETL/ELT processes using Databricks and Apache Spark in cloud-based environments.
- Exposure to data modelling and architecture: practical experience creating conceptual, logical and physical data models using dimensional, relational or Data Vault techniques in analytical environments.
Technical Skills
Databricks & Spark- Hands‑on experience working with Databricks platform, including Delta Lake and Lakehouse architecture concepts.
- Practical knowledge of Apache Spark (PySpark, Spark SQL), including batch and streaming processing.
- Understanding of Medallion architecture design patterns.
- Strong hands‑on SQL skills in analytical and distributed data environments (e.g., Spark SQL).
- Ability to profile, tune, and optimise SQL queries for large‑scale data processing workloads.
- Solid understanding of dimensional modelling; ability to translate business requirements into conceptual, logical and physical models.
- Hands‑on experience building scalable ELT/ETL pipelines in modern cloud‑native environments.
- Experience with, or strong interest in, processing and integrating data on major cloud platforms (GCP, Azure, AWS).
- Familiarity with cloud storage, managed databases and serverless / data pipeline services is desirable.
- Understanding of CI/CD pipelines and version control (Git) in data engineering projects.
Nice to Have
- Experience with Databricks Workflows, Unity Catalog, Auto Loader, Structured Streaming.
- Knowledge of streaming technologies (e.g., Kafka).
- Experience with dbt, MLflow, Feature Stores, or Infrastructure as Code (e.g., Terraform).
- Exposure to data quality frameworks and monitoring solutions.
- Experience supporting AI/GenAI use cases (e.g., LLM data pipelines, vector databases, AI‑ready data preparation).
Programming & Analytics
- Practical scripting or programming skills (SQL, Python, Spark) to support data transformation, automation and basic analytics.
- Ability to translate complex business requirements into robust, scalable data solutions.
Soft Skills & Language
- Strong analytical thinking, problem‑solving and attention to detail.
- Professional working proficiency in English and effective communication with technical and non‑technical stakeholders.
- Willingness to travel to client locations across Europe as required.
What We Offer
- Individual support of a People Lead and a specific path of professional development, as well as the possibility of a session with a Coach.
- A wide training package (soft, technical, and language training, access to e‑learning platforms, Gallup test, GenAI training, possibility of co‑financing courses, and certification).
- Employee Assistance Programme – legal, financial, and psychological consultations.
- Accenture employees eligible for the Employee Share Purchase Plan automatically become eligible for quarterly dividends if they own company shares.
- Paid employee referral programme.
- Private medical care and life insurance.
- Access to the WorkSmile benefits platform (possibility of using a wide range of products and services, including the Multisport card).
Working Conditions
- Employment contract (umowa o pracę).
- Headquarters in Warsaw.
- Travel required to work with prestigious clients and deliver large‑scale transformational change. Work is hybrid—remote, office, and client locations, with some in‑person time for collaboration, learning and relationship building.
- Work location may include a mix of working remotely, onsite at a client, or in an Accenture office—depending on specific project circumstances.
Equal Employment Opportunity Statement
Accenture does not discriminate employment candidates on the basis of race, religion, colour, gender, age, disability, national origin, political beliefs, trade union membership, ethnicity, denomination, orientation or any other basis impermissible under Polish law. All our leaders are committed to building a better, stronger and more durable company for future generations to create positive, long‑lasting change. Inclusion and diversity are fundamental to our culture and core values.