Data Engineer – Real-time
Posted 6
views
Summary
Designs and builds Betsson's real-time, event-driven data platform in Budapest (hybrid, 3 days on-site): creating scalable ingestion, transformation and orchestration frameworks, data-quality and schema tools, and evolving the architecture on AWS using Kafka, Spark, and Python/Scala/Java.
- Design and build scalable, reusable frameworks and services for data ingestion, transformation, and processing
- Develop and maintain the platform’s core capabilities, such as orchestration, data quality validation, and schema management tools
- Evolve the platform’s architecture to incorporate new technologies that improve scalability, reliability, and cost-effectiveness
- Collaborate with Data DevOps Engineers to ensure platform features are automated, observable, and deployed via CI/CD
- Act as a key contributor to the platform’s roadmap, identifying and prioritizing features that unlock the most value for its users
- University degree in Computer Science, Engineering or equivalent
- At least 3 years of hands-on experience building and operating real-time or event-driven data platforms and streaming applications
- Strong software engineering fundamentals with experience in a language like Python, Scala or Java
- Experience building reusable frameworks, libraries, or internal tools
- Deep knowledge of SQL and data integration patterns
- Experience with data streaming technologies such as Kafka
- Strong experience building distributed data processing workloads using Apache Spark (PySpark and/or Scala)
- Hands-on experience designing and operating event-driven architectures on AWS, including services such as MSK, Kinesis Data Streams, EKS, EMR, Lambda, and EventBridge
- Experience in NoSQL databases such as HBase, Cassandra, and DynamoDB
- Excellent verbal and writing English communication skills
- Familiarity with real time reporting tools like Grafana or Datadog
- Familiarity with Data Modelling Concepts like Inmon, Kimball and Data Vault
- Knowledge of AWS services like Glue, Lambda, Step Functions and S3
- Experience with orchestrating data pipelines using tools like Airflow
- Experience building or managing APIs and microservices
- Familiarity with infrastructure scripting like Terraform and CI/CD practices
- Fitness-wellness allowance
- Company mobile phone for private use with 100 GB
- Annual HUF devaluation compensation
- Hybrid model: 3 days in the office and 2 days from home
- Private Health Insurance
- Career development
- Technical and soft-skill training opportunities
- Breakfast, fruits & lunch
- Team building events