Senior Azure Databricks Engineer
Posted Updated
- Performing tasks related to the position.
- 5+ years of experience as a data engineer or similar role with exposure to cloud-based data platforms and modern data architectures
- Hands-on experience building and managing data pipelines using Azure Databricks (PySpark + SQL) in production environments
- Strong understanding and practical experience with data modeling, data warehousing / lakehouse architecture including dimensional modeling and star/snowflake schemas
- Proven track record in data governance, metadata management, and ensuring data quality at scale
- Experience in performance optimization and troubleshooting of data processing jobs / pipelines (Spark/Databricks)
- Excellent programming and query skills in SQL and Python or another relevant language
- Strong analytical and problem-solving skills
- Excellent communication skills for explaining complex technical issues to non-technical stakeholders and collaborating across teams
- Self-motivation, responsibility, and capability of working independently and as a technical leader in a structured data platform environment
- Prior experience working in regulated domains or sectors with strong compliance requirements such as Finance, Asset Management, Pensions
- Previous involvement in platform modernization or cloud migration projects
- Familiarity with additional big data / data-engineering tools and patterns beyond Spark / Databricks including streaming, real-time data ingestion, advanced orchestration, metadata tooling, monitoring and alerting
- Experience mentoring or leading smaller data engineering teams or peers and championing best practices, code reviews, architecture governance
- Familiarity with CI/CD for data workflows, preferably with Azure DevOps or similar, including infrastructure-as-code such as Terraform or ARM templates
- Experience with Azure Data Services such as ADF, ADLS, Synapse or comparable cloud data services
- Employment of infrastructure-as-code to provision, manage, and version cloud infrastructure and data platform resources
- Participation in full-cycle and diverse international projects
- Opportunity to work as a specialist or manager/team lead
- Constant career development with internal mentorship
- Access to a whole set of learning platforms and paid certifications
- Flexible working conditions including home working
- Attractive base salary
- Wide range of benefits including cafeteria, bonuses, private health insurance package, life insurance, AYCM sport card, referral bonus, family-oriented benefits, company shares on a discount price