Data Engineer
Posted Updated 2
views
Description
EduRun Group is seeking a Data Engineer in India to design, build, and maintain data pipelines and Lakehouse-based data models for analytics and BI initiatives.
You will collaborate with data scientists, analysts, and stakeholders, employing Microsoft Fabric, Dataflow Gen2, Azure Data Factory, Python, PySpark, SQL, and Power BI to ensure data quality and actionable insights. This role emphasizes performance, reliability, and clear data storytelling.
Design and implement data pipelines using Microsoft Fabric, Dataflow Gen2, and Azure Data Factory (ADF). Develop and maintain data models and structures in Lakehouse environments. Utilize Python and PySpark for data processing and transformation tasks. Write efficient SQL queries to extract and manipulate data from various sources. Collaborate with business intelligence teams to integrate data into Power BI dashboards and reports. Ensure data quality and integrity throughout the data lifecycle. Troubleshoot and optimize data workflows for performance and reliability. Proficiency in Microsoft Fabric and its components. Experience with Dataflow Gen2 and Lakehouse architecture. Strong knowledge of Azure Data Factory (ADF) and data pipeline development. Proficient in Python and PySpark for data manipulation and analysis. Solid understanding of SQL for database querying and management. Familiarity with Power BI and DAX for data visualization. Excellent problem-solving skills and attention to detail. Ability to work collaboratively in a fast-paced environment.Skills
Sign in to read and join the discussion.