Senior Data Engineer (AV) Hybrid - Full Time - Technology United Arab Emirates
Posted Updated
Description
InDrive Group is seeking a Senior Data Engineer to build and scale data pipelines for autonomous driving research in the UAE. You will own sensor data storage, validation, and data delivery to ML teams, starting with imagery and GPS tracks and expanding to full sensor platforms.
You will collaborate on geodata pipelines, leverage BigQuery, and keep PostGIS/GeoParquet datasets fast for large-scale analysis. Strong Python/SQL and cloud skills are essential.
Build the pipelines that move multi-sensor data from vehicles into cloud storage, synchronize and geo-reference streams. Own the storage layout and lifecycle for sensor data: partitioning, hot and archival tiers, cost control as volume grows. Build validation and monitoring on the ingest path: incomplete uploads, missing or unsynchronized streams, vehicles that stopped producing usable data. Prepare training datasets for autonomous-driving models: select data by location, route, and conditions, version datasets, and deliver them in the formats ML teams need. Develop current imagery and GPS-track pipelines from vehicle cameras, and contribute to geodata pipelines (ingestion, conflation, validation, publication). Work with company data in BigQuery and keep spatial queries fast on large PostGIS and GeoParquet tables. 4+ years in data engineering. Experience with multi-sensor data from vehicles or robots: cameras, IMU or LiDAR, and keeping streams in sync. Experience preparing training datasets for computer vision or autonomous-driving models. Large volumes of binary or media data in object storage (S3 or GCS); distributed processing (Spark or equivalent). Hands-on experience with spatial data: PostGIS, GeoPandas/Shapely, coordinate reference systems, GPS tracks. Strong Python and SQL; AWS or GCP, Docker, Kubernetes.Skills
Sign in to read and join the discussion.