Senior Data Engineer
Summary
Builds and optimizes data pipelines using Java/Scala, AWS services, and Spark to process and transform large datasets for analytics.
Job Description of Senior Data Engineer for Melbourne:
Languages Java, Scala, SQL & Shell scripting (Must have) Javascript/Python/Kotlin (Good to have)
Frameworks - Spring Boot, Akka (Must have) Spark & NodeJS (Good to have)
AWS Services Lambda, Cloudwatch, Cloudformation, S3, SQS, SNS, Athena, Glue, ECR, CodePipeline, CodeBuild (Must Have)
Tools - Git, Docker, Redis
Skills set required: Stored Procs Data Transformation Python Airflow Kafka PostgreSQL Lambda Graph DB/ AWS Neptune (optional) AWS Glue (optional)