Data Engineer
Posted Updated
Description
Collinson (Singapore) is seeking a Data Engineer to design and maintain data pipelines using Python, SQL, Snowflake and dbt. You will manage Snowflake objects, optimize performance, and ensure secure access across distributed teams.
You will work with Kafka for real-time data, deploy AWS resources with Terraform, and automate CI/CD with GitHub Actions. The role requires hands-on engineering, on-call readiness and strong collaboration across departments.
Build, maintain and troubleshoot data pipelines using Python and SQL. Manage Snowflake objects, including tables, views and access permissions. Work with Kafka topics, schemas and connectors for real-time data movement. Use Terraform to deploy and maintain AWS resources and other cloud services. Write Python scripts, create automated tests and manage CI/CD with GitHub Actions. Monitor pipelines and production services, investigate failures and participate in on-call support. Ensure security, access controls and platform reliability while managing costs. Contribute to incident response, runbooks and post-incident actions across distributed teams. A university degree in computer science, engineering or a related discipline, or equivalent practical experience. At least 4-5 years of hands‑on Data Engineering. Strong Python and SQL skills, with experience writing production code. Practical experience with Snowflake and confluent for data transformation. Hands‑on experience with AWS and Terraform. Understanding of Kafka, including topics, consumers and data streaming. Experience with Git, CI/CD and automated testing. Ability to troubleshoot data pipelines and production issues independently. Understanding of cloud security, monitoring and access management. Good communication, problem‑solving and teamwork skills.Skills
Sign in to read and join the discussion.