Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD.

Senior Data Engineer – AWS / Databricks / PySpark

Posted Updated

Description

Astek Singapore Innovation Technology Pte. Ltd. is seeking a Senior Data Engineer to design and maintain scalable data pipelines on AWS and Databricks.

You will lead data lakehouse architecture, ensure data quality and governance, and collaborate with data scientists and analysts to deliver reliable data products. The role requires strong Python/PySpark/SQL skills, Celestial cloud service experience, and leadership to mentor junior engineers.

Design, develop and optimise scalable batch and streaming pipelines on AWS, Databricks, Python, PySpark and SQL. Build lakehouse architectures with Bronze-Silver-Gold layers and reusable data products. Ingest data from databases, APIs, files and event streams; support CDC and backfills. Establish automated data quality checks, schema validation, lineage and metadata management. Develop workflows with Databricks Workflows, Lakeflow and AWS services; implement CI/CD and IaC. Enforce data governance, access controls and security using Unity Catalog and Lake Formation. Monitor performance, troubleshoot production issues and optimise Spark/SQL workloads. Provide technical leadership, code reviews and mentoring to engineers. Collaborate with data scientists, analysts and stakeholders to deliver reliable data solutions. Maintain technical documentation and knowledge transfer materials. 6–10 years of data/software engineering experience, incl. 2+ years on cloud data platforms. Hands-on with Python, PySpark, SQL, Spark, Databricks and Delta Lake. Experience with AWS data services: S3, Glue, Lake Formation, IAM, KMS, Redshift, MSK/Kinesis. Design of data lake/lakehouse architectures and data models. Strong ETL/ELT, CDC, data quality, metadata and lineage skills. Automation, CI/CD, testing and infrastructure as code (Terraform). Data pipeline monitoring, observability and performance tuning. Cloud security, encryption, access management and governance. Proven ability to mentor engineers and lead code reviews.

Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →