Data Engineer: GCP Data Pipelines & Streaming
Posted
Summary
Data Engineer building and optimizing Fireart's data infrastructure on Databricks and GCP: architecting scalable ETL/ELT pipelines with BigQuery, Airflow, dbt, Dataflow, and Pub/Sub, plus CI/CD, Docker/Kubernetes microservices, and GDPR/CCPA data governance.
Fireart is seeking a Data Engineer to design, develop, and optimize our data infrastructure on Databricks and GCP. You will architect scalable ETL/ELT pipelines using BigQuery, Airflow, dbt, Dataflow, and Pub/Sub, ensuring high availability and data quality.
You will collaborate with Data Science, Analytics, and Product teams; implement CI/CD for data components; use Docker and Kubernetes for microservices; and uphold governance with GDPR/CCPA compliance.