Data Platform Engineer
Posted Updated
Description
Role Overview
We are looking for an experienced
Data Platform Engineer
to support the development and operations of
Data Warehouse . The role will focus on building and maintaining scalable data pipelines, ETL/ELT workflows, data platforms, and analytics engineering solutions, while providing ongoing production and application support. Key Responsibilities
Develop and maintain
data pipelines, ETL/ELT processes, and analytics engineering workflows
to support advanced data search and retrieval. Collaborate with data and engineering teams to understand requirements and automate
deployment, monitoring, and operational processes . Optimise data storage, processing, and query performance while troubleshooting technical issues. Coordinate with data engineers and stakeholders to support
sprint planning and timely delivery . Perform
BAU monitoring, investigation, troubleshooting, and incident resolution . Support
data governance and data management
initiatives. Provide day-to-day
production and application support , ensuring platform stability and reliability. Develop and maintain
unit and integration tests
to ensure data and application quality. Requirements
Degree in
Computer Science, Information Technology , or a related discipline. At least
5 years of hands-on Software Engineering or Data Engineering experience . Strong programming experience in
Python and ETL Strong experience with
unit and integration testing . Experience with
AWS and Kubernetes (K8s) . Familiarity with modern data platforms and technologies such as
Snowflake, Databricks, Apache Spark, Apache Hive, Delta Lake, Apache Iceberg, and vector databases . Experience with workflow/orchestration technologies such as
Apache Airflow, Dagster, Prefect, or Temporal . Familiarity with
GitHub workflows, Datadog, DevOps practices, and Agile methodologies . Good analytical, troubleshooting, communication, and collaboration skills. Key Technologies
Python | AWS | Kubernetes | Snowflake | Databricks | Apache Spark | Apache Hive | Delta Lake | Apache Iceberg | Vector Databases | Airflow | Dagster | Prefect | Temporal | GitHub | Datadog | ETL/ELT
We are looking for an experienced
Data Platform Engineer
to support the development and operations of
Data Warehouse . The role will focus on building and maintaining scalable data pipelines, ETL/ELT workflows, data platforms, and analytics engineering solutions, while providing ongoing production and application support. Key Responsibilities
Develop and maintain
data pipelines, ETL/ELT processes, and analytics engineering workflows
to support advanced data search and retrieval. Collaborate with data and engineering teams to understand requirements and automate
deployment, monitoring, and operational processes . Optimise data storage, processing, and query performance while troubleshooting technical issues. Coordinate with data engineers and stakeholders to support
sprint planning and timely delivery . Perform
BAU monitoring, investigation, troubleshooting, and incident resolution . Support
data governance and data management
initiatives. Provide day-to-day
production and application support , ensuring platform stability and reliability. Develop and maintain
unit and integration tests
to ensure data and application quality. Requirements
Degree in
Computer Science, Information Technology , or a related discipline. At least
5 years of hands-on Software Engineering or Data Engineering experience . Strong programming experience in
Python and ETL Strong experience with
unit and integration testing . Experience with
AWS and Kubernetes (K8s) . Familiarity with modern data platforms and technologies such as
Snowflake, Databricks, Apache Spark, Apache Hive, Delta Lake, Apache Iceberg, and vector databases . Experience with workflow/orchestration technologies such as
Apache Airflow, Dagster, Prefect, or Temporal . Familiarity with
GitHub workflows, Datadog, DevOps practices, and Agile methodologies . Good analytical, troubleshooting, communication, and collaboration skills. Key Technologies
Python | AWS | Kubernetes | Snowflake | Databricks | Apache Spark | Apache Hive | Delta Lake | Apache Iceberg | Vector Databases | Airflow | Dagster | Prefect | Temporal | GitHub | Datadog | ETL/ELT
Skills
Sign in to read and join the discussion.