Senior Data Platform Engineer: Python, GCP & Orchestration
Posted Updated
Description
Confiz Limited in Mexico is seeking a Data Platform Engineer to design, develop, and maintain scalable data orchestration platforms using Python, GCP, Airflow, and Terraform. You will build self-service capabilities and integrate diverse data sources for batch and real-time processing.
The role emphasizes IaC, CI/CD, data governance, and data cataloging, with exposure to BigQuery, GCS, Dataproc Serverless, Kafka, and Kubernetes. Collaboration across engineering and business teams is essential.
Design, evolve, and maintain scalable data orchestration platforms for ETL/ELT operations. Build self-service platform capabilities for engineers, data scientists, and analysts. Develop integrations with data sources/destinations (Kafka, GCS, BigQuery, Postgres, S3) for batch and real-time processing. Provision and manage cloud data infrastructure using Terraform with IaC pipelines. Build and orchestrate data pipelines using Airflow and Kubernetes. Develop platform tooling and CLIs using Python and CI/CD workflows. Bachelor's or Master's degree in Computer Science, Engineering, or equivalent practical experience. 5–7 years of professional experience in Data Engineering or related roles. Strong Python programming experience for automation, services, and CLI tools. Strong SQL skills, especially in BigQuery and modern cloud data environments.Skills
Sign in to read and join the discussion.