Data Platform Engineer
Posted
Summary
Builds, deploys, and operates the company's data platform — handling deployments, upgrades, migrations, CI/CD automation, monitoring, and incident root-cause analysis across data ingestion, storage, and compute. Core stack: Databricks, dbt, Kafka, Airflow, Python/SQL, GitLab, Docker/Kubernetes, in a banking-compliance context.
- Implement, configure, and enhance data platform solutions based on established architectures and technical standards.
- Support cloud infrastructure provisioning, platform deployments, upgrades, migrations, and CI/CD automation.
- Collaborate with Cloud Infrastructure, Network, Security, and DevOps teams to ensure smooth and secure platform operations.
- Manage platform access, user provisioning, service requests, and operational tickets within agreed SLAs.
- Monitor platform performance, availability, and health while troubleshooting issues related to data ingestion, storage, compute, and system integrations.
- Investigate incidents, perform root cause analysis, and coordinate with internal teams and vendors to resolve technical issues.
- Maintain platform documentation, operational procedures, and compliance with security and governance standards.
- Drive continuous improvement through scripting, automation, enhanced monitoring, and platform reliability initiatives.
Qualifications:
- 3–8 years of experience in data engineering roles using CI/CD and modern orchestration tools.
- Proficient in DBT, Databricks, Kafka, and orchestration tools (Airflow, dbt Cloud).
- Hands-on experience in CI/CD using GitLab or similar. Strong Python and SQL skills.
- Good understanding of DataOps/MLOps principles, infrastructure-as-code, and containerization (Docker, Kubernetes).
- Familiarity with banking data governance, metadata, and risk compliance frameworks (e.g., BSP, ISO 27001).