Databricks Data Architect & Engineer for ML Pipelines
Posted Updated
Description
NTT Data Europe & Latam seeks a Databricks Expert to bridge Data Science and Data Engineering, delivering data acquisition, transformations and loading into data lakes for analytics and ML.
You will work across cloud-native environments (GCP/AWS/Azure), build proofs-of-concept, and migrate workloads to the cloud while monitoring distributed infra using Grafana/Prometheus; strong Java/Scala/Python skills are required.
Support customers in Big Data projects working with analysts and solution architects to understand use cases and data needs. Deliver data acquisition, transformations, cleansing, conversion, and loading of data into data lakes for analytics and ML models. 5+ years experience in cloud native environments with Databricks preferred. Experience with Big Data architectures, cloud and on premise. Azure infrastructure and networking experience. Proven ability to deliver proofs-of-concept to address business needs. Experience migrating workloads from on premise to cloud. Experience monitoring distributed infrastructure (Grafana/Prometheus). Proficiency in Java, Scala, Python, and shell scripting. SQL language knowledge. Experience leading medium teams. Experience with Spark, Databricks, Azure Data Factory, and Azure Synapse. Microsoft Certification on Azure or Databricks.