Data Engineer

We are seeking a skilled Data Engineer to join our team in Tamil Nadu. The ideal candidate will have extensive experience in designing and implementing data solutions using modern data engineering tools and frameworks. As a Data Engineer, you will be responsible for building and maintaining scalable data pipelines, ensuring data quality, and optimizing data storage solutions. You will work closely with data scientists and analysts to provide them with the necessary data infrastructure to support their analytics and machine learning initiatives. Key Responsibilities: - Design, develop, and maintain robust data pipelines using Python, PySpark, and Databricks. - Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. - Implement data integration solutions using Azure services, including Azure Synapse and Databricks. - Monitor and optimize data workflows for performance and reliability. - Ensure data quality and integrity through rigorous testing and validation processes. - Stay updated with the latest trends and technologies in data engineering and cloud computing. Required Skills: - Proficiency in Python and PySpark for data processing and transformation. - Experience with Databricks and Azure Synapse for data analytics and storage. - Strong understanding of data modeling and ETL processes. - Familiarity with cloud-based data solutions and architectures. - Excellent problem-solving skills and attention to detail. - Ability to work collaboratively in a fast-paced environment. If you are passionate about data engineering and have the required skills and experience, we encourage you to apply for this exciting opportunity to contribute to our data-driven initiatives.