Senior Data Scientist
Posted Updated
Summary
Senior Data Scientist builds and maintains scalable AI/ML data pipelines on GCP using Airflow, Spark, and Terraform to power user experience features.
Our client, a leading global SaaS organisation is looking for a Senior Data Analyst to work on exciting AI/ML user experience projects for a 12 month contract. Hybrid with 3 days on site. Responsibilities; Providing data sources that help build the AI/ML user experience Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow. Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliab…
What they ask for
Required
- 5+ years data analysis experience with Scala/Java and/or Python
- Experience managing batching/streaming data pipelines with GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt
- SQL and shell scripting
- Docker/k8s and infrastructure-as-code tools (Terraform, Salt, etc.)
- Cloud Composer and Airflow for data pipeline orchestration
- Monte Carlo and Looker for observability and monitoring
- NewRelic and Splunk for operational tools
Preferred
- Technical Design Documents for articulating complex technical content