Senior Data Engineer
Description
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer based in Canada.
As a Senior Data Engineer, you will design and scale the data infrastructure behind advanced autonomous vehicle operations. You will build robust systems capable of ingesting, processing, and storing large volumes of telemetry, sensor, and operational data generated by autonomous ground support equipment. Working across cloud infrastructure, distributed systems, and data engineering, you will transform complex real-world vehicle data into reliable insights for engineering and operations teams. You will take ownership of the full data infrastructure lifecycle, from architecture and development to deployment, monitoring, and optimization. Collaborating closely with software, autonomy, infrastructure, and fleet operations specialists, you will help improve system performance and reliability. This is a hands-on opportunity to shape scalable data platforms in a fast-growing, remote-first technology environment.
Accountabilities:
You will lead the development and operation of scalable data pipelines and cloud-based infrastructure that support autonomous vehicle fleets. Your work will ensure that data is reliable, accessible, and efficiently processed, enabling teams to monitor fleet performance, investigate technical issues, and continuously improve autonomous systems.
-
Design, build, and maintain scalable data pipelines to ingest, process, and store large volumes of autonomous vehicle telemetry, sensor, and operational data.
-
Develop and operate reliable batch and streaming pipelines to support near-real-time monitoring and historical data analysis.
-
Build and optimize cloud-based data infrastructure using AWS and modern distributed data processing technologies.
-
Develop reliable data transfer systems connecting edge devices and on-premises infrastructure with cloud storage and processing environments.
-
Design and maintain data models, schemas, and storage architectures that support efficient querying, analytics, and downstream engineering workflows.
-
Ensure data quality, consistency, availability, and observability across production pipelines.
-
Optimize processing performance, storage efficiency, and infrastructure costs as fleet size and data volumes grow.
-
Collaborate with autonomy, software, and infrastructure engineers to support debugging, performance analysis, and continuous improvement of autonomous vehicle systems.
-
Develop tools and infrastructure that make data accessible to engineering, product, and fleet operations teams.
-
Take end-to-end ownership of data infrastructure, including architecture, implementation, deployment, monitoring, and production troubleshooting.
Requirements:
The ideal candidate has a strong background in data engineering, software engineering, or distributed systems, with proven experience building and operating production-grade data infrastructure. You should combine excellent programming skills with practical cloud expertise and a solid understanding of reliability, scalability, and distributed data processing.
-
At least 5 years of experience in data engineering, software engineering, or distributed systems, with a focus on production-grade data infrastructure.
-
Strong programming proficiency in Python and SQL.
-
Hands-on experience designing and operating large-scale batch and streaming data pipelines.
-
Extensive experience with AWS services such as S3, Kinesis, Lambda, Glue, Redshift, or comparable cloud-native data infrastructure.
-
Experience designing data architectures, storage solutions, and data models for high-volume, complex datasets.
-
Strong understanding of distributed systems, data reliability, fault tolerance, and performance optimization.
-
Experience deploying, monitoring, and troubleshooting data pipelines in production environments.
-
Familiarity with Terraform and Kubernetes is preferred.
-
Ability to work independently, navigate ambiguity, and take ownership of complex technical challenges.
-
Strong communication and collaboration skills, with experience working across engineering teams.
Preferred Qualifications:
-
Experience with autonomous vehicles, robotics, automotive telemetry, IoT, or other sensor-intensive systems.
-
Experience processing large-scale time-series, image, video, or other unstructured datasets.
-
Familiarity with edge-to-cloud data ingestion architectures and environments with intermittent connectivity.
-
Experience with data lake architectures, Google Cloud BigQuery, and AWS Athena.
-
Background building data infrastructure for machine learning, simulation, or robotics development workflows.
-
Knowledge of ROS, ROS bags, or autonomous vehicle data formats.
-
Experience building data platforms from the ground up within a startup or rapidly scaling engineering organization.
Benefits:
-
Fully remote work arrangement, with the role open to candidates in Canada.
-
Full-time employment.
-
Opportunity to work on advanced autonomous vehicle technology and real-world operational systems.
-
Significant ownership over data architecture, infrastructure scalability, and engineering decisions.
-
Close collaboration with multidisciplinary teams across software, autonomy, infrastructure, and operations.
-
Opportunity to contribute to the development of data platforms in a growing technology company.
Skills
As published by lever
Resume/CV, Full name, Email, Phone, Current location, Current company
Sign in to read and join the discussion.