Data BAU Lead- Data Engineering
Summary
Lead a team maintaining cloud data pipelines, warehouses, and lakes; migrate legacy systems to Snowflake and AWS Glue/Spark while improving data quality and automation.
We are looking for an experienced Data BAU Lead to lead data engineering operations, production support, and continuous improvement in a cloud-first environment.
Key Responsibilities- Lead a team of Data Engineers managing BAU operations, production support, incidents, and platform stability.
- Design, develop and support scalable data pipelines, data feeds, data lakes and data warehouses.
- Drive migration of legacy Oracle, MS-SQL, Hive and Impala workloads to Snowflake, Spark and AWS Glue.
- Work closely with business, architects, Data Scientists and DevOps teams to deliver data solutions.
- Improve data quality, performance, monitoring, automation and operational efficiency.
- Support data strategy, architecture, security and governance initiatives.
- 7+ years of Data Engineering experience, including 2+ years in hands-on Lead/Production Support roles.
- Strong expertise in AWS – S3, Glue, DMS, MWAA/Airflow, IAM, Lambda, RDS, Kinesis and Step Functions.
- Strong Snowflake expertise and data warehouse/data lake experience.
- Hands-on programming skills in SQL, Python, PySpark, Spark and Unix Shell.
- Experience with ETL, data ingestion, data integration, distributed systems and large-scale datasets.
- Strong understanding of CI/CD, Git, Agile/SDLC and cloud optimization.
- Proven experience in team leadership, stakeholder management and production/BAU environments.
- Bachelor’s degree in computer science, Engineering, STEM or related field