Senior Data Engineer
Posted Updated
Description
We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and implementing data solutions using Databricks, PySpark, SQL, and Python. As a Senior Data Engineer, you will play a crucial role in managing and optimizing our data pipelines, ensuring data quality, and enabling data-driven decision-making across the organization.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks and PySpark.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Optimize SQL queries for performance and efficiency.
- Implement data governance and quality assurance processes to ensure data integrity.
- Monitor and troubleshoot data pipeline performance issues, providing timely resolutions.
- Stay updated with the latest industry trends and technologies related to data engineering.
Required Skills:
- Strong proficiency in Databricks and PySpark for big data processing.
- Expertise in SQL for data manipulation and querying.
- Proficient in Python for data engineering tasks.
- Experience with data modeling and ETL processes.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills to collaborate effectively with cross-functional teams.
If you are passionate about data engineering and have a proven track record of delivering high-quality data solutions, we would love to hear from you. Join us in our mission to leverage data for impactful business decisions.