Data Engineer: Build Fast Data Pipelines with Databricks
Posted Updated 12
views
Summary
MSC Technology Italy is hiring a Data Engineer for the EDMA Data Hub, building and maintaining data ingestion and transformation pipelines with Databricks, Spark, SQL and Python, orchestrating scheduling, fault-tolerance and monitoring, and enforcing data quality to meet SLAs across business domains.
MSC Mediterranean Shipping Company is seeking a Data Engineer to join MSC Technology Italy and contribute to the EDMA Data Hub, delivering an interconnected data platform for multiple business domains.
The role focuses on building ingestion and transformation pipelines using Databricks, Spark, and SQL, ensuring quality, performance, and on-call support as needed within an international team.
Build data ingestion, transformation pipelines and ensure performance. Orchestrate pipeline scheduling, fault-tolerance, retries and monitoring. Impose data quality measures to meet SLAs across domains. Expert in big data technologies and data platforms. Proficient in SQL, Python, Spark and Databricks. Experience with data lakehouse architectures and large-scale data processing. Learning opportunities Welfare system Life and health insurance Modern workstation MSC employee discounts Meetups Tech and general events Sustainability program