Senior Data Engineer / Scala, Spark
Posted Updated 1
view
Summary
Senior Data Engineer who designs, builds, and maintains large-scale distributed data systems and Spark-based processing and streaming pipelines, working on knowledge-graph quality and data-intensive analytics in a cross-functional Budapest team. Core stack: Scala/Java, Spark, Kafka, Cassandra.
- Design, build, and maintain large-scale distributed data systems
- Develop data processing pipelines using technologies such as Spark and streaming solutions
- Work on systems that evaluate and ensure the quality and integrity of large-scale knowledge graphs
- Contribute to data-intensive projects involving analytics, data discovery, and algorithm development
- Collaborate with cross-functional teams across multiple locations and product areas
- Participate in architecture and design decisions for scalable, multi-datacenter solutions
- Continuously improve system performance, scalability, and reliability
- Challenge existing assumptions and propose innovative data engineering solutions
- Hands-on professional software development experience of 5+ years
- Strong programming skills in Scala and/or Java
- Experience working with Big Data technologies such as Spark and distributed systems
- Hands-on experience with data streaming such as Kafka
- Hands-on experience with distributed data storage such as Cassandra
- Strong problem-solving mindset
- Excellent written and verbal communication skills
- Ability to work effectively in distributed, cross-functional teams
- Proactive and self-driven approach to engineering challenges
- Experience with Knowledge Graphs or graph-based data systems
- Background in machine learning or data science
- Experience in music information retrieval
- Exposure to advanced data modeling and algorithm development