Senior AI Data Engineer
Summary
A Senior AI Data Engineer in Singapore who designs, builds, and operates production-grade batch/streaming data pipelines and platform components, including RAG/knowledge-base solutions for agentic AI. Core stack: Python, SQL, and PySpark, plus CI/CD, cloud security, and production data-ops practices.
Bachelor’s degree in Computer Science, Engineering, or a related field
5–8 years of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery, with demonstrated ownership of production pipelines and platform components.
Proven ability to independently design, build, optimise, and operate production-grade batch or streaming data pipelines, including orchestration, observability, error handling, performance tuning, and operational support.
Hands-on experience with Python and SQL for data transformation and validation
Familiarity with Apache Spark (especially PySpark) and large-scale data processing concepts
Experience with implementing knowledge base and RAG solutions for agentic AI use cases
Self-starter with strong problem-solving skills and a keen attention to detail
Able to work independently and lead technical discussions with engineers, architects, product owners, source-system teams, and business stakeholders to translate requirements into secure and maintainable platform solutions.
Strong documentation and communication skills
Strong understanding of enterprise data architecture, cloud security, access control, CI/CD, release management, and production operations for data and AI platform solutions.