Senior Data Engineer
Posted Updated
Key Responsibilities
- Design data pipelines, architectures, models and reusable data capabilities.
- Apply engineering practices to improve reliability, security, observability and performance.
- Evaluate technologies and contribute to data architecture and engineering standards.
- Promote automated testing, code review, CI/CD and infrastructure-as-code.
- Work with engineers, Product Managers, Data Scientists, analysts and users.
- Provide technical leadership through design reviews, mentoring and knowledge sharing.
Requirements
- Strong software engineering skills with Python and SQL.
- Experience building and operating complex production data systems.
- Strong enterprise data architecture and engineering experience.
- Experience with data pipelines, data modelling, data warehouses, data lakes and lakehouse architectures.
- Experience with AWS and modern data platforms such as Redshift, Snowflake, Databricks or BigQuery.
- Experience with data orchestration, transformation and modelling.
- Strong understanding of testing, CI/CD, monitoring, troubleshooting and data quality.
Good to Have
- Apache Airflow or equivalent.
- Apache Spark.
- AWS data services and cloud infrastructure.
- Tableau, Power BI or equivalent.
- Infrastructure-as-code, data observability, metadata, catalogue or lineage.