Data Engineer
Posted Updated
Description
WHR Global Consulting is seeking an experienced data engineer in Quezon City to develop ingest- cleanse- and processing scripts, maintain data pipelines, and build scalable Web APIs. You will work with data analysts, data scientists, and DevOps to ensure robust data infrastructure.
The role requires 3-5 years in data warehousing/architecture, expertise in ETL, SQL optimization, and Python with Databricks and AWS, plus familiarity with Linux and security considerations. On-site in Quezon City.
Develop data ingestion, summarization, processing, and cleansing scripts Maintenance of data pipeline Development of Web APIs Identify, mine, and assemble large, complex data sets from different data sources that meet functional/non-functional business requirements Maintain and optimize the performance of the data warehouse (schemas, indexes, etc.) Design, implement and maintain ETL scripts Optimize SQL queries, tables, views, and procedures Collaborate with data analysts, data scientists, DevOps, and other teams Coordinate with the IT team to maintain the data systems University degree in Computer Science or related discipline 3-5 years of experience in data warehousing, data architecture, and/or data engineering at enterprise scale Must have experience in ETL design, implementation, and maintenance Experience writing, maintaining, and optimizing complex SQL queries, tables, views, and procedures Knowledge in data warehousing, including mapping and transformations, data dependencies, data source analysis and profiling, OLTP, OLAP, and the different schema. Comfortable using CLI and working in a Linux environment Must have experience in Python, Databrick and AWS Knowledgeable on web security and performance Can handle semi-structured data formats – JSON, XML, HTML, etc. Experience in using Git Knowledgeable on statistics and machine learning is a plus Experience working with AWS services is a plus Natural problem solver and critical thinker Detail oriented and highly adaptive Fast learnerSkills
Sign in to read and join the discussion.