Data Engineer
Posted
Summary
Data engineer in Singapore designing, building, and maintaining scalable ETL/ELT pipelines, data warehouses, and data lakes on cloud platforms, using Python, SQL, Scala, Spark, Kafka, Airflow, and Databricks. Requires 8+ years of data engineering experience.
Job Description & Requirements
Key Responsibilities
Design, develop, and maintain scalable data pipelines. Build and optimize ETL/ELT workflows. Develop and manage data warehouses and data lakes. Integrate data from multiple sources. Optimize database performance and data quality. Collaborate with data scientists, analysts, and application teams. Implement data governance and security best practices. Monitor and troubleshoot data pipeline issues. Automate data processing workflows. Maintain technical documentation. Technical Skills
Python, SQL, Scala Apache Spark, Hadoop, Kafka ETL/ELT Development Data Warehousing Snowflake, Redshift, BigQuery AWS, Azure, Google Cloud Platform Airflow, Databricks SQL Server, PostgreSQL, MySQL Git, Docker, Kubernetes Mandatory Requirements
8+ years of Data Engineering experience. Strong SQL and Python programming skills. Experience with Spark and ETL frameworks. Hands-on experience with cloud data platforms. Knowledge of data warehousing concepts. Experience with workflow orchestration tools. Understanding of data modeling and optimization. Familiarity with Agile methodologies. Core Competencies
Data Engineering ETL/ELT Development Data Warehousing Cloud Platforms Big Data Technologies Database Management Performance Optimization Data Modeling
Design, develop, and maintain scalable data pipelines. Build and optimize ETL/ELT workflows. Develop and manage data warehouses and data lakes. Integrate data from multiple sources. Optimize database performance and data quality. Collaborate with data scientists, analysts, and application teams. Implement data governance and security best practices. Monitor and troubleshoot data pipeline issues. Automate data processing workflows. Maintain technical documentation. Technical Skills
Python, SQL, Scala Apache Spark, Hadoop, Kafka ETL/ELT Development Data Warehousing Snowflake, Redshift, BigQuery AWS, Azure, Google Cloud Platform Airflow, Databricks SQL Server, PostgreSQL, MySQL Git, Docker, Kubernetes Mandatory Requirements
8+ years of Data Engineering experience. Strong SQL and Python programming skills. Experience with Spark and ETL frameworks. Hands-on experience with cloud data platforms. Knowledge of data warehousing concepts. Experience with workflow orchestration tools. Understanding of data modeling and optimization. Familiarity with Agile methodologies. Core Competencies
Data Engineering ETL/ELT Development Data Warehousing Cloud Platforms Big Data Technologies Database Management Performance Optimization Data Modeling
Skills
- Agile
- Airflow
- AWS
- Azure
- Big Data
- BigQuery
- Cloud
- Data Engineering
- Data Governance
- Data Lake
- Data Modeling
- Data Pipelines
- Data Quality
- Data Warehousing
- Databricks
- Docker
- ELT
- ETL
- GCP
- Git
- Hadoop
- Kafka
- Kubernetes
- MySQL
- PostgreSQL
- Python
- Redshift
- Scala
- Snowflake
- Spark
- SQL
- SQL Server
- Workflow Orchestration