Big Data Engineer for HL-LHC Data Systems (Hybrid)
Posted Updated
Description
CERN is seeking a software engineer to contribute to the NXCALS core components for HL-LHC data workflows. You will work on ingestion pipelines, metadata services, data compaction, and APIs, improving data access performance for LHC operations and machine protection analyses.
You will collaborate with accelerator users and equipment groups to tailor applications on NXCALS, while evaluating technologies like Hadoop, HDFS, HBase, ClickHouse, Spark or Kafka to meet future HL-LHC needs.
Contribute to the development of NXCALS core components, focusing on HL-LHC use cases: ingestion pipelines (ETL), metadata services, data compaction, data extraction and APIs. Improve the performance and reliability of data access for LHC operations, machine protection analyses and commissioning activities. Work with accelerator users in the CERN Control Centre and equipment groups to understand their needs and help them build applications and analyses on NXCALS. Help evaluate big-data technologies (such as HDFS, Apache Ozone or ClickHouse) and their fit for future HL-LHC data requirements. Follow modern engineering practices in a team that values code quality, testing and automation. Solid experience in Java development; familiarity with the Spring ecosystem is an advantage. Experience with, or strong interest in, big-data technologies such as Hadoop, HDFS, HBase, ClickHouse, Apache Spark or Kafka. Working knowledge of Python; experience with PySpark is a plus. Familiarity with software quality practices, CI/CD and DevOps. Curiosity about particle accelerators and enthusiasm for working with diverse user communities. Stipend 6,372 CHF Stipend 7,004 CHF Health insurance Pension fund Relocation support Annual leave 30 days Language trainingSkills
Sign in to read and join the discussion.