Data Engineer (Contract)

Our client, one of Asia-Pacific's leading organizations is looking for:

Data Engineer

Responsibilities:

• Performdataextraction, cleaning, transformation, and flow. Web scraping may be also a part of the workscopeindataextraction.
• Design, build, launch and maintain efficient and reliable large-scale batch and real-timedatapipelines withdataprocessing frameworks
• Collaborate with Project Manager, Visualisation Developer,DataScientist, UX Designers andDataAnalyst to build scalabledata-driven products
• Work in an Agile Environment that practices Continuous Integration and Delivery
• Support and advise best practices indatamanagement standards, policies and procedures
• Work closely with fellow developers through pair programming and code review process

Requirements:

• Interest in being the bridge between engineering and analytics
• Knowledge about system design,datastructure and algorithms
• Familiar withdatamodelling,dataaccess, anddatastorage infrastructure likeDataMart,DataLake, andDataWarehouse
• Proficient in generaldatacleaning and transformation (e.g. SQL, pandas, R, etc)
• Familiar with rest API and web requests/protocols in general
• Proficient with processingdatafrom open-standard file format ordatainterchange format (e.g. XML, JSON)
• Good in building ETL pipeline (eg. TalendDataIntegration, Informatica PowerCenter, IBM DataStage, SASDataIntegration)
• Good in database design and various databases (e.g. MS SQL Server, Oracle RDBMS, IBM DB2, Postgres etc)
• Comfortable in at least one scripting language (eg. Python)

Only shortlisted candidates will be notified.