Senior Data Engineer ID82548
Posted Updated 6
views
Summary
Designs and optimizes data pipelines using dbt, Airflow, and Snowflake, enforcing governance and ensuring reliable, low-cost data delivery for BI tools.
- Audit dbt code for performance and cost optimization
- Build automated testing for pipelines
- Build dynamic Airflow DAGs from dbt dependencies
- Enforce data governance and access controls for PII data
- Ensure zero downtime for downstream BI tools
- Implement Medallion architecture in Snowflake
- Maintain integrations between Paradime and Airflow
- Migrate ETL jobs to orchestrated Airflow DAGs
- Set up failure alerting and error recovery
- Tune pipeline execution paths to reduce compute runtime and cost
Perks/Benefits:
- Annual learning budget
- Collaborative culture
- Flexible hours
- Internal tech talks
- Mentorship
- People focused support
- Remote work
- Well-being programs