Lead Data Engineer
NewBe an early applicantSummary
Lead Data Engineer at Coforge building and maintaining scalable ETL/ELT pipelines, DBT models, and cloud-based data workloads (GCP preferred). Core stack is DBT, Python, PySpark, SQL, and data modeling; requires 8-10 years of experience on-site in Greater Noida, Pune, or Hyderabad.
Core skills : DBT + Python + Pyspark + SQL + Data Modelling Concepts + any Cloud
Nice to have: GCP
Experience: 8-10 Years
Location: Greater Noida, Pune and Hyderabad
We are looking for a lead profile with strong Data Engineer background, with hands-on experience in building data pipelines, performing transformations, and working with cloud-based data tools. The ideal candidate must have solid SQL skills, good understanding of data modeling, and hands-on exposure to DBT and cloud platforms (preferably GCP).
Key Responsibilities:
- Build and maintain scalable ETL/ELT pipelines. Develop and enhance DBT models and transformations.
- Perform data cleansing, validation, and quality checks. Support cloud-based data engineering workloads (preferably GCP).
- Write optimized SQL queries for analytics and data processing. Collaborate with Data Engineers, Analysts, and Architects for requirement understanding.
- Monitor pipeline health, troubleshoot issues, and ensure data reliability.
- Document workflows, models, and mappings.
Required Skills (Must Have):
- Data Modeling understanding (Star/Snowflake).
- Strong SQL skills.
- Hands-on experience with DBT.
- Experience with at least one major cloud platform: GCP (BigQuery, Dataflow, Dataproc, Composer, GCS preferred) OR AWS / Azure equivalent services.
- Experience with data transformation and loading technologies. Good knowledge of Python for data tasks.