Senior Data Engineer & Architect — Real-Time Pipelines
Posted Updated
Description
Spin - Job Board External is seeking a senior Data Engineer to lead the design, development, and optimization of scalable data solutions. You will mentor engineers, define architectures, and advance data governance, ensuring performance, security, and business value.
Responsibilities include building robust pipelines, collaborating with cross-functional teams, and delivering high-quality data platforms for analytics, reporting, and AI workflows.
Lead design and rollout of scalable data pipelines for diverse data types. Partner with cross-functional teams to align data architectures with business needs. Develop and optimize data models to support analytics, reporting, and AI apps. Implement batch, micro-batch, near real-time, and real-time workflows. Drive data governance, privacy, and security across data lifecycles. Maintain data lake/warehouse architectures and streaming platforms. Build data quality metrics and monitoring processes. Contribute to all data engineering lifecycle phases with Agile methods. Mentor junior and mid-level engineers and foster collaboration. Document architectures, processes, and workflows for continuity. Integrate APIs and external data sources into existing pipelines. Ensure clean, maintainable code via version control and best practices. Promote autonomous work culture with proactive problem solving. Minimum 5–6 years of data engineering experience with scalable data solutions. Advanced SDLC and design pattern knowledge. Proven ability to work autonomously and mentor junior staff. Strong Python, Java, and data framework expertise. Deep knowledge of dimensional modeling and data storage (SQL/NoSQL). Experience with batch, near real-time, and real-time pipelines. Proficient in data governance, privacy, and security practices. Familiarity with API integration and data architectures (Datalake/warehouse). Experience with GCP and AWS data services; strong SQL skills. Agile project delivery experience (Scrum/Kanban).Skills
Sign in to read and join the discussion.