Data Engineer (Spark)
Summary
Migrate and optimize data pipelines from Talend to Spark, building scalable PySpark/Scala workflows and integrating them with cloud platforms and orchestration tools.
Data Engineer – Talend to Spark Migration
Singapore
We are looking for a
Data Engineer
with strong experience in
Talend ETL workflows
and
Apache Spark
to lead the migration of our data pipelines from Talend to Spark. This role involves re-engineering existing ETL processes, optimizing performance, and ensuring seamless integration with modern big data platforms.
Analyze existing
Talend ETL jobs
and design equivalent
Spark-based pipelines . Migrate and optimize data workflows from Talend to Spark (PySpark/Scala). Collaborate with data architects to define scalable data lake/lakehouse solutions. Implement best practices for
data quality, governance, and security . Integrate Spark pipelines with cloud platforms (AWS, Azure, GCP). Work with orchestration tools (Airflow, Databricks Jobs, etc.) to schedule and monitor workflows.
Required Skills:
Bachelor's/Master's degree in Computer Science, Engineering, or related field. Hands-on experience with
Talend ETL development
(tMap, tJoin, tFilter, etc.). Strong expertise in
Apache Spark
(PySpark, Spark SQL, Spark Streaming). Proficiency in
Python, Scala, or Java . Solid understanding of
data warehousing concepts
and
SQL . Experience with
big data ecosystems
(Hadoop, Hive, Kafka). Familiarity with
cloud services
(AWS EMR, Azure Databricks, GCP DataProc).
Interested candidates, who wish to apply for the above position, please send in your resume to: (HIDDEN TEXT)
Current Sal: Expected Sal: Notice Period:
PERSOL Singapore Pte Ltd
EA License No. 01C4394 EA Reg No: R23118975 (ABDUL RAHMAN ANSARI RAJA)
We regret to inform you that only shortlisted candidates will be contacted.
We are looking for a
Data Engineer
with strong experience in
Talend ETL workflows
and
Apache Spark
to lead the migration of our data pipelines from Talend to Spark. This role involves re-engineering existing ETL processes, optimizing performance, and ensuring seamless integration with modern big data platforms.
Analyze existing
Talend ETL jobs
and design equivalent
Spark-based pipelines . Migrate and optimize data workflows from Talend to Spark (PySpark/Scala). Collaborate with data architects to define scalable data lake/lakehouse solutions. Implement best practices for
data quality, governance, and security . Integrate Spark pipelines with cloud platforms (AWS, Azure, GCP). Work with orchestration tools (Airflow, Databricks Jobs, etc.) to schedule and monitor workflows.
Required Skills:
Bachelor's/Master's degree in Computer Science, Engineering, or related field. Hands-on experience with
Talend ETL development
(tMap, tJoin, tFilter, etc.). Strong expertise in
Apache Spark
(PySpark, Spark SQL, Spark Streaming). Proficiency in
Python, Scala, or Java . Solid understanding of
data warehousing concepts
and
SQL . Experience with
big data ecosystems
(Hadoop, Hive, Kafka). Familiarity with
cloud services
(AWS EMR, Azure Databricks, GCP DataProc).
Interested candidates, who wish to apply for the above position, please send in your resume to: (HIDDEN TEXT)
Current Sal: Expected Sal: Notice Period:
PERSOL Singapore Pte Ltd
EA License No. 01C4394 EA Reg No: R23118975 (ABDUL RAHMAN ANSARI RAJA)
We regret to inform you that only shortlisted candidates will be contacted.