Data Engineer – Azure Databricks
Summary
Build and optimize scalable HR data pipelines on Azure Databricks using Spark, SQL, and DevOps practices to power analytics and employee-facing products.
Are you a hands-on Azure Databricks expert who loves turning complex data challenges into elegant, scalable solutions? We're looking for an experienced Data Engineer to join our team and help shape the future of HR technology across the entire employee lifecycle.
What You'll Do
- Design, develop, and continuously improve digital products and technology services for our clients and employees
- Apply modern software engineering practices — from understanding user needs to building automated tests and deployment pipelines
- Ensure the quality, security, reliability, and compliance of every solution you build
- Build observability into your solutions to monitor production health and drive down risk
- Keep learning — new tools, new practices, and smarter ways of building for the long term
What You Bring
- 8-10 years of hands-on data engineering experience, with a track record of delivering production-grade solutions on Azure
- Solid understanding of Azure identity models (SPN, SAMI, UAMI)
- Experience designing large-scale data distribution, data mesh, data lake, and analytics architectures
- Strong coding skills in Spark (Python/Scala) and SQL
- Scripting proficiency in Linux or PowerShell
- ETL background with tools like Informatica, SSIS, or Talend (Kafka streaming knowledge a plus)
- Comfort working in an agile SDLC with modern DevOps and test-driven development practices
- Familiarity with Docker, Git, and orchestration tools such as Apache Airflow (preferred), Autosys, or Control-M
- Experience managing complex codebases via GitLab/GitHub using fork/pull models and CI/CD
- Bonus points for GitLab CI/CD, YAML, Terraform, ARM, Puppet, Azure Functions, or Logic Apps