Python Data Engineer - Cloudera
Summary
Build and maintain secure, scalable data pipelines for a bank using Python, Spark, Hadoop, and Cloudera tools like CDP and CDSW.
Client: Bank Sector Technology Operations
Hands-on techno-functional role working with technology teams across infrastructure and other divisions to deliver system solutions for the business
Involve in development and system integration relevant systems with CDP / CDSW
Strong understanding of Cloudera framework including CDP (Cloudera Data Platform) and CDSW (Cloudera Data Science Workbench)
Hands-on experience in Big Data solution and development based on Python technologies stack
Design and implement secure, scalable and high-performance data processing pipelines
Key technologies: Python, SQL, Spark, PySpark, Hadoop, Hive, Impala, Kafka, Zookeeper, Ranger, Atlas, Cloudera Manager, Django, Red Hat Linux, Shell Script, ETL, data pipelines, Parquet, ORC, JSON, basic Java / Scala
Good to have financial industry experience, especially global market products, market data analytics, data science projects, and identifying risk factors affecting pricing of products