Azure Data Engineer

We are seeking an experienced Azure Data Engineer to join our dynamic team in Karnataka. The ideal candidate will have a strong background in data engineering, particularly with Azure Databricks, and will be responsible for designing, building, and maintaining data pipelines that support our data analytics initiatives. As an Azure Data Engineer, you will work closely with data scientists and analysts to ensure that data is accessible, reliable, and optimized for analysis. You will be tasked with developing ETL processes, integrating data from various sources, and ensuring data quality and integrity. Your expertise in Python, PySpark, SQL, and Scala will be crucial in implementing efficient data processing solutions. Key Responsibilities: - Design and implement scalable data pipelines using Azure Databricks. - Develop ETL processes to extract, transform, and load data from various sources. - Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet their needs. - Monitor and optimize data pipelines for performance and reliability. - Ensure data quality and integrity throughout the data lifecycle. - Stay updated with the latest trends and technologies in data engineering and Azure services. Required Skills: - Proficiency in Azure Databricks and Azure Data Engineering tools. - Strong programming skills in Python and PySpark. - Experience with SQL and Scala for data manipulation and analysis. - Knowledge of ETL processes and data pipeline architecture. - Familiarity with data warehousing concepts and best practices. - Excellent problem-solving skills and attention to detail. If you are passionate about data engineering and want to work in a collaborative environment, we encourage you to apply for this exciting opportunity.