Senior AI Data Engineer
Posted Updated 5
views
Summary
Senior data engineer in Singapore designing, building, and operating production batch/streaming data pipelines and platform components for agentic AI, including knowledge base and RAG solutions. Core stack: Python, SQL, Apache Spark/PySpark, plus cloud security, CI/CD, and production data platform operations.
Bachelor's degree in Computer Science, Engineering, or a related field
5-8 years of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery, with demonstrated ownership of production pipelines and platform components.
Proven ability to independently design, build, optimise, and operate production-grade batch or streaming data pipelines, including orchestration, observability, error handling, performance tuning, and operational support.
Hands-on experience with Python and SQL for data transformation and validation
Familiarity with Apache Spark (especially PySpark) and large-scale data processing concepts
Experience with implementing knowledge base and RAG solutions for agentic AI use cases
Self-starter with strong problem-solving skills and a keen attention to detail
Able to work independently and lead technical discussions with engineers, architects, product owners, source-system teams, and business stakeholders to translate requirements into secure and maintainable platform solutions.
Strong documentation and communication skills
Strong understanding of enterprise data architecture, cloud security, access control, CI/CD, release management, and production operations for data and AI platform solutions.