Data Platform Engineer
Posted 1
view
About the Role
We are seeking an experienced Data Platform Engineer to design, build, secure, and optimise large‑scale data environments across AWS. This role is ideal for someone who has worked in large organisations, managed high‑volume datasets, and brings deep expertise in RDS, Redshift, Python, SQL, and AWS security best practices. You will play a key role in ensuring our data platforms are scalable, resilient, and compliant with enterprise security standards.
Key Responsibilities
Data Platform Engineering
Essential
We are seeking an experienced Data Platform Engineer to design, build, secure, and optimise large‑scale data environments across AWS. This role is ideal for someone who has worked in large organisations, managed high‑volume datasets, and brings deep expertise in RDS, Redshift, Python, SQL, and AWS security best practices. You will play a key role in ensuring our data platforms are scalable, resilient, and compliant with enterprise security standards.
Key Responsibilities
Data Platform Engineering
- Architect, build, and optimise data solutions using AWS RDS (Postgres/MySQL) and Amazon Redshift.
- Design scalable data models, schemas, and ingestion patterns for high‑volume structured datasets.
- Develop robust ETL/ELT pipelines using Python and SQL.
- Implement performance tuning, workload management, and query optimisation across Redshift and RDS.
- Support data availability, reliability, and operational excellence across production environments.
- Act as an AWS security specialist, ensuring compliance with enterprise security frameworks.
- Implement and maintain IAM, encryption (KMS), network segmentation, VPC security, and audit logging.
- Apply best practices for data protection, access control, secrets management, and governance.
- Work closely with security teams to manage risk, conduct reviews, and maintain secure data operations.
- Manage and optimise large datasets, high‑volume ingestion, and complex data transformations.
- Support distributed data workflows, multi‑team access patterns, and enterprise‑wide data consumption.
- Troubleshoot production issues, resolve performance bottlenecks, and ensure platform stability.
- Partner with data engineers, analysts, architects, and business teams across a large organisation.
- Contribute to platform roadmaps, standards, and continuous improvement initiatives.
- Maintain documentation, runbooks, and operational guidelines for data platform components.
Essential
- Strong experience as a Data Platform Engineer or Data Engineer in large organisations.
- Deep expertise with AWS RDS (Postgres/MySQL) and Amazon Redshift.
- Advanced Python and SQL skills for data engineering and automation.
- Proven experience handling large datasets, high‑volume pipelines, and enterprise data workloads.
- Strong background in AWS security, including IAM, KMS, VPC, encryption, and compliance controls.
- Experience with ETL/ELT frameworks, data modelling, and performance optimisation.
- Experience with AWS Glue, Lambda, Step Functions, or orchestration tools.
- Familiarity with Terraform/CloudFormation for infrastructure automation.
- Knowledge of data governance, metadata management, and lineage tools.
- Exposure to event‑driven architectures (Kinesis, Kafka)