Data Engineer: PySpark on AWS | ETL & Serverless Pipelines
Summary
Data engineer building and maintaining scalable ETL/ELT pipelines on AWS using PySpark, Python, AWS Glue, Step Functions, Lambda, and Terraform with CI/CD and DevOps practices.
Vui Systems Pte Ltd is seeking a data engineer to design, develop, and maintain scalable data pipelines on AWS using PySpark and Python. You will build ETL/ELT workflows with AWS Glue and Step Functions, develop serverless applications with Lambda, and manage cloud infrastructure with Terraform.
You will implement CI/CD pipelines, monitor pipelines for performance and cost, and collaborate with stakeholders to deliver data solutions while upholding DevOps and security standards.