Principal Data Engineer
Operational Efficiency
.... operational efficiency through CI/CD, containerisation (e.g. Docker/ECS), and infrastructure as code.
Skills
Python, SQL, PySpark, Scala, Java
- AWS (S3, Glue, Redshift, Lambda, EMR, IAM, ECS, SageMaker)
- Databricks, Delta Lake
- Apache Spark, Airflow, Dagster, Rundeck