Data Engineer
Summary
Designs and builds data pipelines, warehouses, and analytics systems using Python, Spark, and cloud platforms like Databricks or Snowflake.
JBW Managed Services and Consulting Corp.
Hybrid - Quezon City 5-10 Yrs Exp Bachelor Full-time
Share
Job Description
-6+ years of experience in the software development area;
-Proven expertise in Data Warehousing and Data Analytics projects, encompassing data acquisition, transformation, and data science initiatives
-Exposure with modern data file formats such as Delta Tables, Apache Iceberg, and Parquet
-Proficiency in Python, Spark, DBT, and other data transformation tools and frameworks
Job Responsibilities:
- Expertise in data modelling, with familiarity in conceptual, logical, and physical data models, following methodologies like Data Vault 2.0 and Dimensional Modelling
- Experience with cloud data services such as Microsoft Intelligent Data Platform, AWS Data Services, or Google Cloud Data Analytics
- Hands-on experience with cloud data platforms like Databricks and/or Snowflake; certifications
- Skilled in data pipeline orchestration tools, including Azure Data Factory, AWS Glue, Apache Airflow, or Prefect
- Experience with CI/CD and MLOps pipelines to streamline development and deployment processes
- Proficient in Infrastructure as Code (IaC) for efficient infrastructure management
- Expertise in data migration, performance tuning, and optimisation of databases and SQL queries queries
- Understanding of Data Governance and Data Management concepts
- Understanding of design patterns, clean architecture, and clean coding principles
- Familiarity with unit, regression and E2E testing.