Lead Data Engineer
Description
ey Responsibilities
1. Architectural Strategy & Design
- Architect and scale modern data solutions (ETL/ELT pipelines, data lakes, and data warehouses) across multiple major cloud platforms like Databricks, Snowflake, BigQuery, or Microsoft Fabric.
- Define standard patterns for integrating operational application layers with analytical data systems seamlessly.
2. Hands-on Execution & Engineering Excellence
- Maintain a hybrid approach by remaining hands-on with architecture blueprints, system design, prototyping, and high-impact code reviews.
- Lead by example to champion clean code, robust CI/CD pipelines, containerization (Kubernetes/Docker), and reliable distributed systems.
- Troubleshoot complex architectural bottlenecks across application and data layers.
3. AI & Intelligent Automation
- Drive the production deployment of Agentic AI frameworks, autonomous workflows, and sophisticated prompt engineering protocols.
- Architect robust Retrieval-Augmented Generation (RAG) pipelines that bridge enterprise application microservices with large-scale analytical data stores safely and securely.
4. Technical Leadership & Calibration
- Mentor, guide, and upskill senior engineers, tech leads, and software architects.
- Collaborate closely with Practice Owners and Business Leaders to align engineering capabilities with client demands and emerging technology trends.