Data Engineer
Posted 1
view
We are looking for an experienced Data Engineer to join a team focused on building and supporting scalable, cloud-native data platforms.
What you’ll be doing
- Design, develop and support cloud-native data platforms and data pipelines.
- Build and maintain ETL/ELT pipelines using AWS services.
- Work extensively with SQL, Python and Spark/PySpark for data processing and transformation.
- Develop solutions using AWS S3, Glue, EMR, Athena and Aurora PostgreSQL.
- Apply data modelling and database design principles to support scalable data solutions.
- Work with Change Data Capture (CDC) and operational databases.
- Contribute to data governance, monitoring and CI/CD processes.
- Work with GitHub Actions to support automated deployments and delivery.
- Collaborate with stakeholders and delivery teams in an Agile environment.
- Troubleshoot data pipeline and platform issues and contribute to continuous improvement.
What we’re looking for
- Strong commercial experience as a Data Engineer.
- Hands-on expertise in SQL and Python.
- Strong experience with AWS, particularly S3, Glue, EMR, Athena and Aurora PostgreSQL.
- Strong knowledge of data modelling.
- Hands-on experience with Spark/PySpark.
- Experience with CDC, data governance, CI/CD and monitoring.
- Experience working with operational databases.
- Strong problem-solving and stakeholder engagement skills.
- Experience working in Agile delivery environments.
Nice to have
- Kafka / Amazon MSK
- Terraform
- Event-driven architectures
- Snowflake
- dbt