Data Engineer (Big Data)
Posted 8
views
Summary
A data engineer in Toronto building big-data pipelines, working with streaming and batch data. Core technologies are PySpark/Apache Spark, Kafka, the Hadoop ecosystem (HDFS, Hive, YARN), Apache NiFi, SQL, and Python.
- Strong hands-on experience with PySpark and Apache Spark, including Spark SQL and DataFrames.
- Proficiency in Apache Kafka for real-time data streaming and integration.
- Strong knowledge of the Hadoop ecosystem, including HDFS, Hive, and YARN.
- Hands-on experience with Apache NiFi for data flow and integration.
- Strong SQL and Python programming skills.
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.