Senior Python Backend Engineer – Data / GCP
Posted
Summary
Senior Python backend engineer focused on data workloads on Google Cloud: designing and maintaining Airflow DAGs and Cloud Composer environments, building Python REST API services with Pydantic, integrating pipelines with backend services, and handling auth, monitoring and production troubleshooting across BigQuery, GCS, Pub/Sub, IAM and Cloud Functions.
- Design, implement and maintainApache Airflow DAGs
- Manage and optimizeGoogle Cloud Composerenvironments
- Develop Python backend services andREST APIs
- UsePydanticfor schema modelling, validation and type enforcement
- Build integrations between pipelines and backend services through APIs
- Handle authentication, retries, idempotency and standardized response models
- Develop reusable Airflow operators, hooks and utilities
- Work withBigQuery, GCS, Pub/Sub, IAM and Cloud Functions
- Implement logging, monitoring, alerting and testing
- Troubleshoot production issues and perform root-cause analysis
- Collaborate with Data Engineering, Platform and Product teams
Our requirements
- Hands-on Apache Airflow + Google Cloud Composer experience
- Hands-onPydanticexperience
- Airflow: DAGs, operators, sensors, hooks and XComs
- GCP: BigQuery, GCS, Pub/Sub, IAM and Cloud Functions
- OAuth2, JWT and API-key authentication
Optional
- GraphQL
- Development of reusable Airflow components/frameworks
- Strong production troubleshooting and observability experience
- At Square One Poland we link IT experts with the business. With over 25 years of experience, we specialize in recruitment processes on a global scale. Despite years of experience, we still have a startup DNA and this is our advantage. Our offices are located in London and Warsaw, however, we can reach clients from all over the world, from start-ups to big worldwide corporations.
Senior Python Backend Engineer – Data / GCP, Warszawa