Senior Data Engineer - Scalable Pipelines & Data Governance
Posted Updated
Description
Spin - Job Board External seeks a Data Engineer to lead the design, development, and optimization of advanced data solutions with scalability and governance in mind. You will mentor team members and drive best practices across the data engineering lifecycle.
You will build robust data pipelines, model data for analytics and AI, implement real-time processing, and collaborate with cross-functional teams to align data architectures with business goals while upholding security and privacy standards.
Lead design and implementation of scalable data pipelines for ingestion, processing, and storage of diverse data types. Collaborate with cross-functional teams to align data architectures with business needs. Develop and optimize data models to support analytics, reporting, and AI. Implement advanced data processing workflows for various latency needs. Drive data governance and privacy compliance across the data lifecycle. Design and maintain architectures for data lakes, warehouses, and streaming platforms. Develop monitoring and data quality metrics for reliability and integrity. Contribute to all phases of the data engineering lifecycle using Agile methods. Mentor junior and mid-level engineers and promote collaborative culture. Document data architectures, processes, and workflows for continuity. Lead API integration with external data sources and ensure compatibility. 5+ years of data engineering experience with scalable solutions. Advanced knowledge of SDLC methodologies. Advanced understanding of design patterns. Ability to work autonomously and mentor others. Proficiency in Python and Java. Advanced knowledge of data storage (NoSQL) and ETL/ELT. Expertise in data processing: batch, microbatch, near real-time, real-time. Experience with data privacy and governance strategies.Skills
Sign in to read and join the discussion.