Data Engineer
Posted 1
view
Summary
PySpark Data Engineer (5-10 yrs) at TCS who builds and tunes big-data ETL pipelines using Hive, Spark and SQL on a Cloudera stack, creates data-quality rules with an in-house framework, and supports dev/test teams — with Tech Lead tracks also owning offshore delivery and technical oversight. Openings in Chennai, Kolkata, Hyderabad and Pune.
Job Title- Pyspark (Data Engineer)
Location- Chennai / Kolkata / Hyderabad / Pune
Experience Required- 5-10 years.
Job Description:
We are looking for a skilled and experienced professional to join our team. The ideal candidate should have 5-10 year of relevant experience and to be comfortable working in dynamic, fast-paced environment.
Key Responsibilities:
- Lead the team from offshore by owning project deliverables & provide technical oversight (For Tech Lead)
- Experienced in architecting & Developing Big Data solutions (For Tech Lead)
- Strong understanding of Big Data tools and Apache projects (For Tech Lead, Sr. Developer)
- Good understanding on performance tuning on Big data technologies (For Tech Lead, Sr. Developer)
- Good to have Python and Java background (For Tech Lead, Sr. Developer)
- Experience in relational database and data warehousing concept
- Well versed in Hive QL, Spark QL
- Create ETL transformation using Hive, Spark
- Support development team and testing team in implementing and testing the ETL respectively
- Build data quality rule and orchestrate using in house framework
- Work with Cloudera/Big Data support for root cause analysis and resolutions
- Good team player and collaborate with other team