Lead Data Engineer: Big Data & Spark
Posted 2
views
Summary
Leads the design and operation of large-scale data pipelines on Hadoop and cloud platforms, writing and tuning PySpark jobs and building new data modules with Databricks in collaboration with product teams.
HCL Technologies Limited seeks a data engineer to design and run large-scale data pipelines on Hadoop ecosystems and cloud platforms. You will implement PySpark jobs, optimize performance, and collaborate with product teams to shape new modules using Databricks and other modern data tools.
The role emphasizes scalable ETL/ELT development, cost-aware tuning, and strong DevOps practices in a fast-paced tech environment in Canada.