Senior Data Engineer — Airflow, GCP, & CI/CD
Posted Updated
Description
Cover Genius is seeking a Senior Data Engineer to design, develop and maintain scalable data pipelines powering analytics and ML. Strong Python and software engineering skills, and hands-on Airflow experience are essential.
You’ll build on cloud platforms (GCP) with BigQuery, Dataflow and Pub/Sub, and own CI/CD workflows with Kubernetes and Terraform. You will collaborate with ML and Analytics Engineers, implement data governance and security, and help deliver robust, reliable data platforms in
Design, build and own Airflow orchestration, scalable pipelines and reusable frameworks. Develop data pipelines and platform services in Python with best practices and tests. Own CI/CD for the data platform across environments. Operate and scale GCP methods including BigQuery, Dataflow and Pub/Sub. Build observability, alerting and data governance to meet KPIs and privacy standards. 5+ years of experience in data engineering, platform engineering or software engineering for data-intensive systems. Hands-on Airflow production experience, DAG design and reusable components. Strong Python and production-grade code practices with testing and modular design. Experience with Kubernetes, Terraform and CI/CD pipelines; SQL and cloud data warehouses. Degree in CS/SE/DS/Math or related STEM field, or equivalent practical experience. Hybrid work model Flexible scheduleSkills
Sign in to read and join the discussion.