Data Engineer (AWS + Databricks)
Summary
Build and optimize scalable data pipelines on AWS and Databricks using PySpark, Spark SQL, and Delta Lake for ETL/ELT workflows.
Position: Data Engineer (AWS + Databricks)
Location: Singapore
Experience: 4 to 8 Years
Key Skills Required
- Strong hands-on experience with Databricks
- Expertise in PySpark and Spark SQL
- Good experience with AWS Cloud Services , including:
- S3
- Glue
- Lambda
- Redshift
- Athena
- IAM
- Experience with Delta Lake and Lakehouse Architecture
- Strong SQL and Data Modeling skills
- Experience designing and developing scalable ETL/ELT pipelines
- Knowledge of CI/CD, Git, and cloud-based data engineering best practices
Responsibilities
- Design, build, and optimize scalable data pipelines using AWS and Databricks.
- Develop ETL/ELT workflows for processing large-scale data.
- Implement and maintain Delta Lake/Lakehouse solutions.
- Collaborate with business and technical stakeholders to deliver data solutions.
- Monitor, troubleshoot, and optimize data processing workloads.
Preferred Certifications
- AWS Certified Data Engineer / Solutions Architect
Databricks Certified Data Engineer