Data Engineer - Vehicle Configuration Optimization
Summary
The Data Engineer will build and maintain data pipelines between Snowflake and Databricks to support analytics and machine learning. The role involves designing ETL/ELT workflows using Python and SQL while ensuring data quality and pipeline performance.
- Build and maintain data pipelines ingesting data from Snowflake into Databricks
- Create curated datasets for analytics simulation and machine learning
- Design and implement data transformations using medallion architecture
- Develop ETL/ELT workflows using Python and SQL
- Ensure pipeline health stability monitoring and performance optimization
- Implement data quality checks validation and governance standards
Perks/Benefits:
- Company Vehicle Lease Program
- Dental insurance
- Disability insurance
- Family building benefit
- Health insurance
- Life insurance
- Paid parental leave
- Paid time off
- Paid volunteer hours
- Prescription Drug Coverage
- Retirement savings plan
- Student loan refinancing programs
- Tuition reimbursement
- Vision insurance