Data Engineer (AWS)
Summary
Design and build an AWS-based Data Lake and Lakehouse platform, including pipelines, storage, and governance using AWS Glue, S3, Redshift, Lambda, and Step Functions.
About the Role
We are looking for an AWS Data Engineer / Data Architect to design, build and maintain a modern AWS Data Lake and Lakehouse platform.
You will work on data ingestion, transformation, storage, security and governance, while ensuring data pipelines are reliable, scalable and cost-effective.
Key Responsibilities
- Design and develop AWS Data Lake and Lakehouse solutions.
- Build data pipelines using APIs, databases, files and SaaS platforms.
- Develop data ingestion and transformation workflows.
- Work with AWS Glue, S3, Redshift, Lambda and Step Functions.
- Manage data processing for both batch and streaming data.
- Maintain the AWS Glue Data Catalogue and data metadata.
- Implement data security and access controls.
- Monitor and troubleshoot data pipelines and data quality issues.
- Maintain technical documentation.
- Improve platform performance, reliability and AWS cost efficiency.
Requirements
Must have:
- 3–5 years of experience in Data Engineering, Data Architecture, Cloud Infrastructure or a related role.
- Strong hands-on experience with: Amazon S3 | AWS Glue | Amazon Redshift | AWS Lambda | AWS Step Functions | Amazon Kinesis | Amazon EventBridge | AWS AppFlow | AWS Lake Formation
- Strong SQL skills.
- Experience with Python or Scala.
- Experience designing and implementing Data Lake or Lakehouse architectures.
- Experience with data governance, data cataloguing and metadata management.
- Experience with batch and streaming data processing.
- AWS Certified Data Engineer – Associate, AWS Certified Solutions Architect or equivalent certification.
Good to Have
- Experience with Tableau or other BI tools.
- Experience with AWS SageMaker or MLOps.
- Experience integrating Salesforce using AWS AppFlow.
- Knowledge of Change Data Capture (CDC) and incremental data loads.
- Government or public sector data experience.
Interested candidates are encouraged to submit their resumes outlining their relevant experience and achievements to sherriyang(@)talentvis.com or click apply!
**We regret to inform that only shortlisted candidates would be notified**
EA License No: 04C3537
EA Personnel No: R22106683
EA Personnel Name: Yang Hui Shan, Sherri