Data Engineer
Posted
Description
Primary skills
- Python / PySpark and SQL
- GCP data engineering: BigQuery, Dataflow, Dataproc, GCS and Pub/Sub
- dbt, Data Fusion and Composer / Airflow
- Production-grade ETL/data pipelines, including batch and streaming patterns
- CI/CD using Jenkins or Harness, with Terraform for infrastructure as code
Secondary skills
- Dynatrace, AppDynamics, Splunk and Google Cloud Logging
- Unix / Linux
- AWS: Lambda, Glue and EMR
- Azure Data Factory
- Snowflake, CockroachDB, DynamoDB and RDS Oracle
The role should ideally have strong hands-on data engineering experience with the ability to own solution design and end-to-end delivery, while providing technical leadership across the team.