Full Stack/Data Engineer (Consultant / Senior Consultant)
Summary
Full Stack/Data Engineer building high-throughput cloud data ingestion pipelines and API layers, designing scalable real-time systems for telemetry data. Core technologies include cloud platforms (AWS, Azure, GCP), real-time streaming, API development (REST/gRPC), and languages like Python/Java/Scala.
Role Overview
We are seeking an experienced Full Stack/Data Engineer with deep expertise in building high-throughput, cloud-based data ingestion pipelines and programmatic API layers. The role focuses on designing scalable, real-time data systems and enabling reliable, low-latency access to large-scale telemetry data.
Key Responsibilities • Design and implement high-throughput cloud-based data ingestion pipelines • Architect real-time ingestion systems capable of handling high-velocity telemetry data at scale • Develop and maintain streaming quality control frameworks with sub-second anomaly detection • Design and build low-latency RESTful or gRPC APIs for high-frequency data ingestion and large-scale retrieval • Optimize system performance for scalability, reliability, and low latency • Collaborate with cross-functional teams including data scientists, engineers, and platform teams Required Skills & Qualifications • Strong experience in building data pipelines and distributed systems • Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) • Proficiency in API development (RESTful and/or gRPC) • Experience with real-time streaming technologies and frameworks • Strong programming skills in languages such as Python, Java, or Scala
Preferred Qualifications • Experience with data governance and access control frameworks • Familiarity with non-proprietary time-series schema design • Experience working with telemetry or IoT data at scale
Key Responsibilities • Design and implement high-throughput cloud-based data ingestion pipelines • Architect real-time ingestion systems capable of handling high-velocity telemetry data at scale • Develop and maintain streaming quality control frameworks with sub-second anomaly detection • Design and build low-latency RESTful or gRPC APIs for high-frequency data ingestion and large-scale retrieval • Optimize system performance for scalability, reliability, and low latency • Collaborate with cross-functional teams including data scientists, engineers, and platform teams Required Skills & Qualifications • Strong experience in building data pipelines and distributed systems • Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) • Proficiency in API development (RESTful and/or gRPC) • Experience with real-time streaming technologies and frameworks • Strong programming skills in languages such as Python, Java, or Scala
Preferred Qualifications • Experience with data governance and access control frameworks • Familiarity with non-proprietary time-series schema design • Experience working with telemetry or IoT data at scale