Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team in Maharashtra. The ideal candidate will have a strong background in data engineering, particularly with Azure Databricks and related technologies. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines that support our data analytics and business intelligence initiatives. Key Responsibilities: - Develop and implement data pipelines using Azure Databricks, PySpark, and Spark SQL to process large datasets efficiently. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions. - Utilize Azure Data Factory (ADF) and Azure Data Lake Storage Gen2 (ADLS Gen2) for data integration and storage solutions. - Implement Delta Lake for reliable data lakes and ensure data quality and integrity. - Monitor and optimize data workflows for performance and reliability. - Document data processes and maintain best practices for data engineering. Required Skills: - Proficiency in Azure Databricks and experience with PySpark and Spark SQL. - Familiarity with Azure Data Factory and Azure Data Lake Storage Gen2. - Knowledge of Delta Lake and its implementation in data engineering workflows. - Strong analytical and problem-solving skills. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. If you are passionate about data engineering and eager to work with cutting-edge technologies, we encourage you to apply for this exciting opportunity.