Senior Data Engineer
QBrainX Senior Data Engineer
Summary
Senior Data Engineer at QBrainX in Coimbatore, India, who designs, builds, and maintains data pipelines ingesting large volumes of structured and unstructured data. Day-to-day work includes optimizing data processing and storage, ensuring data quality, and mentoring junior engineers.
Responsibilities:
- Design, implement, and maintain robust data pipelines to ingest, process, and analyze large volumes of structured and unstructured data from diverse sources.
- Collaborate with cross-functional teams to understand data requirements and develop solutions that meet business needs.
- Optimize data processing and storage systems for performance, scalability, and reliability.
- Ensure data quality and integrity throughout the data lifecycle by implementing data validation and monitoring mechanisms.
- Continuously evaluate and adopt emerging technologies and best practices in data engineering and analytics.
- Provide technical leadership and mentorship to junior team members.
- Participate in code reviews, architecture discussions, and sprint planning sessions.