Data Engineering Lead: Spark on AWS, ML Ops Mentor
Summary
Lead a team building an AWS-based data platform that powers ML workloads: run Spark-on-EMR pipelines, design streaming APIs, and enable self-serve governed data products while mentoring engineers, shaping architecture, and exposing the team to GenAI initiatives.
Infosight Consulting Limited is seeking a Data Engineering Lead to guide a team building an AWS-based data platform that powers ML workloads. You will mentor engineers, shape architecture, and ensure high-quality delivery while exposing the team to GenAI initiatives.
You will lead Spark-on-EMR pipelines, design streaming APIs, and enable data scientists to self-serve through governed data products. Strong leadership and communication are essential.