Data Engineer: AI-Driven Pipelines & Cloud Data Mastery
Posted Updated
Description
Thakral One Pte. Ltd. is seeking a Data Engineer to design, build, and maintain modular data pipelines that support efficient refresh cycles and can integrate AI/ML models. You will collaborate with cross-functional teams to deliver reliable, scalable data solutions for business and operational needs.
The role emphasizes Python, SQL, Airflow, and experience with Azure and AWS data ecosystems, ensuring data quality, governance, and performance across production environments.
Design, develop, and maintain pipelines using Airflow. Build modular and incremental data flows to optimise refresh cycles and minimise redundant runs. Develop ETL/ELT workflows to ingest and transform data from telecom and operational systems. Integrate APIs and external data sources into pipelines. Collaborate with cross‑functional teams to integrate AI/ML models into production environments. Ensure data quality, version control, and governance through documentation and reusable components. Contribute to domain logic validation with business and analytics teams. Participate in troubleshooting and optimisation of data processes. Ensure reliability, scalability, and performance of data workflows. Implement best practices for access management and governance. 3–7 years of hands-on experience in data engineering or related roles. Experience designing incremental and modular pipelines. Experience integrating APIs and external data sources.Skills
Sign in to read and join the discussion.