Lead Data Engineer
Position: Lead Data Engineer
Experience: 7-8 Years
Job Summary
We are looking for a Lead Data Engineer to design, develop, and manage scalable data platforms and data pipelines that support enterprise analytics and reporting requirements. The ideal candidate should possess strong data engineering expertise and hands-on experience with at least one of the following technologies: Informatica IDMC, Microsoft Fabric with Purview, or Databricks.
Must Have
- 7-8 years of experience in Data Engineering.
- Strong experience in ETL/ELT development and data integration.
- Proficiency in SQL and data warehousing concepts.
- Experience with cloud-based data platforms, data lakes, and data warehouses.
- Hands-on experience with at least one of the following technologies: Informatica IDMC, Microsoft Fabric with Purview, or Databricks.
- Knowledge of Data Governance and Data Quality principles.
Good to Have
- Experience with Python, PySpark, or Spark.
- Exposure to Azure Data Factory, Snowflake, or similar cloud technologies.
- Understanding of CI/CD, DataOps, and Agile methodologies.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and integration solutions.
- Lead data engineering initiatives and provide technical guidance to team members.
- Optimize data processing, storage, and performance.
- Collaborate with business and technical stakeholders to define data requirements.
- Ensure implementation of data governance, security, and quality standards.
Preferred Certifications
- Microsoft Certified: Fabric Analytics Engineer Associate
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Data Engineer Associate/Professional
- Informatica IDMC Certification