Lead Data Engineer — AWS Data Platform | PySpark & Redshift
Summary
Lead a team building and optimizing AWS-based data pipelines with PySpark, Glue, EMR, and Redshift to move and transform large datasets efficiently.
NorthBay Solutions is seeking a Lead Data Engineer (AWS Data Platform) with 5–8+ years of experience to design, develop, and optimize large-scale data platforms and ETL/ELT pipelines. You will lead technical initiatives, mentor teammates, and collaborate with distributed teams across time zones.
The role requires hands-on expertise in PySpark, AWS Glue, Amazon EMR, Amazon Redshift, and SQL-based data warehousing, plus performance tuning, data quality, governance, and strong communication with