Azure Data Engineer with Databricks (AI&Data)
Summary
Accenture Technology in Warsaw is hiring an Azure Data Engineer to design, build, and maintain scalable data pipelines and lakehouse solutions on Azure, working hands-on with Databricks, Azure Data Factory, PySpark, and SQL alongside cross-functional delivery teams.
Nasze wymagania:
- Hands‑on experience with implementing solutions with data lakes and pipelines (Databricks, Azure Data Factory).
- Proven experience in designing and implementing solutions in Azure cloud (knowledge of AWS, GCP will be an additional advantage).
- Proficiency in SQL, PySpark, data modeling (3NF, star/snowflake schemas) and ELT/ETL design patterns (including Azure Data Factory).
- Experience with Python or similar scripting languages for data transformation, orchestration, and automation.
- Familiarity with advanced Databricks features (Unity Catalog, MLflow, Jobs & Pipelines).
- Understanding of cloud data architecture principles including data Lakehouse concepts, Medallion architecture, API integration, and event‑driven architecture.
- Experience with CI/CD and DevOps practices for data workflows (Git, Azure DevOps) and analytics integration (e.g., Power BI).
- Excellent communication and client‑facing skills with the ability to explain technical concepts clearly.
- Strong collaboration skills across multidisciplinary teams.
Mile widziane:
- Knowledge of modern data stack tools (e.g., dbt, Power BI, Tableau, Looker).
- Experience with infrastructure‑as‑code tools (e.g., Databricks Asset Bundles, Terraform, ARM templates).
- Experience with cost optimization and FinOps principles for cloud data solutions.
- Familiarity with machine learning or GenAI integration — operationalizing AI/ML models or leveraging LLMs within Databricks/Azure.
- Databricks Associate or Professional certifications.
- Microsoft Certifications in the areas of Microsoft Fabric and Azure.
Zakres obowiązków:
- Develop and implement scalable data processing solutions on Azure, transforming and cleaning large structured and unstructured datasets efficiently.
- Design, build, and maintain robust data pipelines integrating data from diverse sources (databases, APIs, streaming platforms).
- Collaborate with cross‑functional teams including data engineers, data scientists, and cloud architects to deliver end‑to‑end data platform solutions.
- Engage at all critical stages of project development with business analysts, source system experts, data architects, engineers, and product owners.
- Clearly communicate and document technical work, factoring in performance and cost considerations in all design decisions
Oferujemy:
- A permanent employment contract.
- Individual support of a People Lead and a defined path for professional development, with the possibility of coaching sessions.
- A wide training package (soft, technical, language training; access to e‑learning platforms; Gallup test; GenAI training; possibility of co‑financing certifications).
- Employee Assistance Program – legal, financial, and psychological consultations.
- Eligibility for the Employee Share Purchase Plan and quarterly dividends if owning company shares.
- Paid employee referral program.
- Private medical care and life insurance.
- Access to the Worksmile platform, including Multisport and a broad portfolio of benefits.
Skills
- AI
- Analytics
- API
- Automation
- AWS
- Azure
- Azure Data Factory
- Azure DevOps
- CI/CD
- Cloud
- Data Modeling
- Data Pipelines
- Databricks
- dbt
- Design Patterns
- DevOps
- ELT
- ETL
- FinOps
- GCP
- Generative AI
- Git
- Lakehouse
- LLM
- Looker
- Machine Learning
- Microsoft Fabric
- MLflow
- Power BI
- PySpark
- Python
- Snowflake
- SQL
- Tableau
- Terraform
- Unity