Data Engineer Lead

About the role

DT One is seeking a highly driven, self-motivated Data Engineer Lead based in Singapore or Manila. Designing, developing, and maintaining a data and AI platform that works at scale. Collaborate with Engineering Leads, Engineers, Data Scientists, Business Analysts, and other teams within DTOne to deliver a high-performing system that addresses daily operational challenges and supports organizational scalability.

Key responsibilities

• Design and build a highly reliable data lake operating at scale with a strong emphasis on data quality, integrity, and availability.
• Build complex new data pipelines to continuously expand capabilities with new data sources.
• Develop tools, internal libraries, automated ETL creation, and data exploration frameworks to empower Data Scientists, Business Analysts, and Engineers.
• Migrate Machine Learning and Data Applications from POC/MVP stage to production grade (ensuring high availability, scalability, and security).
• Architect and scale infrastructure for Generative AI, LLM deployment, model fine-tuning, and vector retrieval (RAG).
• Monitor and maintain all data systems, including ETLs, Data Warehouses, and Data Applications.
• Provide actionable insights on Data Governance, industry best practices, and large-scale processing.
• Support cross-functional teams with guidance on data usage, processing, and platform adoption.

Qualifications and Experience

• Expertise in medium- to large-scale data processing systems, preferably based on open-source systems or AWS services.
• Strong software development skills in one or more languages such as Python, Java, or Scala.
• Advanced knowledge of SQL and SQL Database administration.
• Hands-on experience with AWS infrastructure and Docker frameworks.
• Experience with distributed processing systems such as Spark, Presto, or Hadoop.
• Solid background in Data Warehousing and Data Modeling.
• Experience with MLOps frameworks, LLM orchestration tools (e.g., LangChain, LlamaIndex), and vector databases (e.g., Pinecone, Milvus, Qdrant).

The ideal candidate is someone who:

• Has a bias towards action and shipping, starting small and growing iteratively.
• Is obsessed with data compliance, security, quality, and integrity.
• Is passionate about learning new technologies, languages, infrastructure, and data analysis to drive meaningful impact.
• Stays creative and generates fresh ideas leveraging technical expertise.
• Enjoys sharing knowledge through coaching, events, and collaboration.

Sound like you? Apply now!