Sr. Data Engineer
Summary
Designs and builds scalable data warehouses and lakes using Redshift/Snowflake and Spark, develops ETL/ELT pipelines, and optimizes distributed processing for analytics.
- Build data warehouses with Amazon Redshift or Snowflake
- Coordinate with teams across SDLC
- Design data lake and lakehouse architecture
- Design develop and evaluate data warehouse solutions
- Develop ETL/ELT pipelines
- Develop and optimize distributed data processing with Apache Spark and PySpark
- Manage cloud data platform for scalability reliability and cost efficiency
- Mentor junior engineers and promote engineering best practices
- Participate in technical and architectural design decisions
- Troubleshoot and debug data engineering solutions
- Use SQL for data transformation and performance tuning