Senior Data Engineer - AI/ML DataOps
Posted 2
views
Summary
Designs and maintains data pipelines, workflow automation and internal tooling for Sonitec's sensor AI engine, profiling and optimising performance-critical code while running CI/CD, DataOps and MLOps workflows. Day to day involves Python/Java development on Linux/Docker and processing in-field sensor test data.
Job Description
About the role
The company is seeking a Senior Data Engineer with focus on AI/ML DataOps pipelines to join the Sensor Fusion AI Team in Sydney CBD.
Responsibilities, Duties and Expectations
- Design, develop, maintain and/or refine internal software tools used for processing data, workflow automation, benchmarking and testing the a Sensor AI engine
- Profile, benchmark and optimise both new and existing performance-critical code focusing on high availability and reliability, low latency, and scalability
- Implement and maintain existing and new automated workflows and pipelines (e.g., Git, CI/CD, MLOps, DataOps) to uphold the highest performance and quality standards
- Collaborate with field service engineers and drone pilots to collect in-field test data from our sensors for analysis
- Manage and enhance data-engineering workflows for processing collected data
- Work in close collaboration with relevant stakeholders to troubleshoot and resolve bug/issue reports
- Maintain software quality/stability (e.g. refactoring, testing, documentation)
- Collaborate closely with other engineers and become a valued member of an autonomous, cross-functional team
- Support the Sensor Fusion AI team to make informed decisions about the future direction of complex deployed system design
Qualifications, Experience and Skills
- BS degree in Computer Science, Mathematics or similar technical field of study or equivalent practical experience
- Minimum 5 years of experience in a professional Data / Software Engineering environment
- Demonstrated experience in creating automated workflows (CI/CD, DataOps) and AI/ML pipelines (MLOps)
- Proficiency in an object-oriented programming language with strong expertise in one or more general purpose programming languages (ideally Python/Java)
- Advanced understanding of data structures, algorithms, and the application of mathematics and physics in software development
- Familiarity with Linux and containerisation (Docker)
Nice to have
- Experience in Data Engineering, AI, or Machine Learning projects
- Proficiency in C++ and tools for building (CMake) and testing
- Experience developing data intensive real-time applications and/or GPU based processing systems (TensorRT, CUDA…)
- Knowledge of sensor fusion and object tracking algorithms