Lead Software Engineer- Data Engineer
Posted Updated 4
views
Summary
Lead a team to design and build scalable AWS and Snowflake data platforms, automate pipelines, and operationalize ML models for Caterpillar’s climate-tech initiatives.
- Architect AWS data platforms
- Build and optimize Snowflake pipelines
- Collaborate with product managers SMEs and stakeholders
- Define CI/CD standards
- Design data ingestion frameworks
- Drive agile execution
- Drive automation continuous improvement
- Enable ingestion from databases APIs files streaming
- Enforce modular design code quality testing version control
- Ensure scalability resiliency operational readiness
- Establish engineering best practices
- Implement CI/CD pipelines
- Implement data modeling governance metadata management
- Lead and mentor data engineering team
- Leverage AWS services for end to end pipelines
- Operationalize ML models and analytics workflows
- Promote reusable ingestion transformation frameworks
- Translate business needs into data solutions
Perks/Benefits:
- Onsite work five days per week
- Relocation available