Senior Data Engineer
Posted Updated
Description
Exceltech Computers Pte. Ltd. is seeking a Senior Data Engineer based at Paya Lebar to design, build and operate trusted data pipelines and reusable data products on our data platform using AWS and Databricks.
The role requires 6–10 years of data or software engineering experience, with hands-on production data pipelines and at least 2 years on cloud-based data platforms. You will work within the DSAD Platform and Architecture Team to drive scalable data solutions.
Design, build, productionise and operate trusted data pipelines and reusable data products on the data platform using AWS and Databricks. 6–10 years of relevant data or software engineering experience. Hands-on experience with production data pipelines. At least 2 years working with cloud-based data platforms. Strong Python, PySpark and SQL capability. Databricks, Apache Spark and Delta Lake in production-scale data engineering. Experience with AWS data engineering including S3, Glue, Lake Formation, IAM, KMS, Lambda, Step Functions, EventBridge, CloudWatch, Redshift and MSK/Kinesis. Experience designing lakehouse/data-lake architectures with dimensional or domain data modelling. Experience implementing data quality, metadata and lineage in production pipelines.Skills
Sign in to read and join the discussion.