Big Data Engineer - Azure Databricks, Spark, Scala
Posted Updated
Description
This role is perfect for those with a strong foundation in big data technologies and a passion for leveraging cloud platforms, specifically Azure. As a Big Data Engineer, you will take the lead in creating and managing data solutions that drive business success. You will work directly with cross-functional teams to ensure our data architecture supports robust analytics.
In this position, you will focus on:
- Designing and implementing data processing frameworks utilizing Azure Databricks, Spark, and Scala.
- Collaborating with data scientists and analysts to clarify data requirements and deliver high-quality solutions.
- Building and maintaining data integration workflows through Azure Data Factory and Kafka.
- Enhancing data storage methods to facilitate quick access and efficient processing of large datasets.
- Monitoring data pipeline performance, identifying issues, and optimizing for scalability without compromising reliability.
This role offers the chance to deepen your expertise in cutting-edge big data technologies while working on significant projects that influence decision-making within the organization. You will continually learn and grow as you navigate the evolving landscape of big data and cloud solutions.
Skills
Sign in to read and join the discussion.