Lead Data Engineer - R01571409
Summary
Lead Data Engineer who designs, builds, and optimizes dbt models and scalable ETL/ELT pipelines on Snowflake and AWS (S3, Lambda, Secret Manager, IAM, CloudWatch), administering the warehouse, CI/CD deployments, data quality monitoring, and production support in Bangalore.
Job requirements
- Develop, maintain, and optimize dbt models, macros, and tests to support scalable ETL/ELT data pipelines
- Administer and manage Snowflake data warehouses, including databases, schemas, roles, and security configurations to ensure robust data governance
- Optimize complex SQL queries and warehouse performance, reducing processing times and improving storage utilization
- Manage and integrate AWS services such as S3, Lambda, Secret Manager, IAM, and CloudWatch to build and maintain reliable cloud data infrastructure
- Implement and maintain CI/CD pipelines for automated deployment and release management of data solutions
- Configure and monitor data quality checks, alerting systems, and performance monitoring to ensure high data reliability and integrity
- Troubleshoot and resolve production issues, conducting thorough root cause analysis to minimize downtime and prevent recurrence
- Collaborate closely with analytics, business intelligence, and engineering teams to deliver high-impact, scalable data solutions aligned with business objectives
- Medallion modeling: Design, build, and maintain dbt models across Bronze → Silver → Gold layers for the assigned domain.
- Governance alignment: Partner with the Data Governance team so models meet certification and quality-gate standards before promotion.
- Downstream support: Support data modeling for downstream analytics platform consumers (dashboards and data products)
- Troubleshooting & support: Diagnose and resolve pipeline issues; participate in on-call/support rotation as needed.
- Documentation: Document data lineage, model logic, and key technical decisions so the work is maintainable by the internal team.
- Maintain and Develop APIs
- Advanced proficiency in SQL (basic and advanced)
- Expertise in developing and managing dbt models, macros, and tests
- Hands-on experience with Snowflake data warehousing, including Time Travel and Fail Safe features
- Strong understanding of ETL/ELT fundamentals and best practices
- Proficiency in Python for data engineering and automation tasks
- Administration of Snowflake warehouses, databases, schemas, and role-based security
- Management of AWS services such as S3, Lambda, Secret Manager, IAM, and CloudWatch
- Implementation and maintenance of CI/CD pipelines for data deployments
- Configuration of monitoring, alerting, and data quality checks in cloud data platforms
- Experience with modern data platform fundamentals and architecture
- Expertise in optimizing large-scale data pipelines for performance and cost efficiency
- Familiarity with data governance and compliance best practices in cloud environments
- Knowledge of infrastructure-as-code tools for cloud resource management
- Exposure to advanced Snowflake features such as data sharing and secure data exchange
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field
- Relevant industry certifications in AWS, Snowflake, or dbt are highly desirable
Skills
As published by lever
Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL, Other website, What is your age range?, I identify my ethnicity asSelect all that apply, What gender do you identify as?