Senior Python Software Engineer (Databricks)
Posted 4
views
Summary
Contract role (8+ months, 36h/week) in Amsterdam placed via staffing firm Gazelle Global at a financial client. The engineer designs and builds end-to-end data solutions, leading the team and building/optimizing data pipelines with Python, PySpark, SQL, and Databricks, with IaC in Bicep and CI/CD on Azure DevOps.
Senior Python Software Engineer (Databricks)
As a preferred supplier to one of our biggest Financial Clients, I am seeking for a Senior Python Software Engineer (Databricks) for a position in Amsterdam, Netherlands.
Requirements
- Experience with E2E system/application (re)design and development.
- Translate requirement into architecture/technical solution.
- Demonstrated experience in designing and developing system components and building/delivery Proofs of Concept (PoCs) to validate technical approaches.
- Experience in building and optimizing data processing pipelines using Python, PySpark, and SQL.
- Guide/lead the technical team to build a robust solution.
- Experience in Performance tuning, debugging, logging and monitoring on Python programming with PySpark.
- Hands on with Databricks, including cluster management, notebooks, job orchestration, and optimization.
- Familiarity with Infrastructure as Code using Bicep.
Generic Engineering Competencies
- Overall extensive hands-on experience with leading the E2E design and implementation of solutions/application and collaborating with / mentoring the technical team
- Strong grasp of Object-Oriented Programming and design patterns.
- Understanding of testing (unit, integration, regression).
- Experience with CI/CD pipelines (Azure DevOps preferred).
Soft Skills
- Strong team player.
- Planning and coordination across team/domain.
- Proactive with a strong sense of ownership.
- Analytical and problem-solving skills.
Nice to have
- Experience with advanced Azure services and security hardening.
- Familiarity with financial risk systems/risk management.
Contract: 8+ months
Hours: 36 hours/week
Interview: 2 stages, 1 technical + 1 assessment