Data Engineer
Posted 6
views
Summary
Data engineer working on a cyber defence platform (CDP) and SIEM, leading log source onboarding, building log ingestion pipelines and providing 2nd/3rd line support during cyber incidents. Core stack includes Kafka, Logstash, Elastic Agent/Beats, Kubernetes, Python and Ansible.
- Work in a high performing team of engineers delivering state of the art security tools.
- Be an active member of the CDP log onboarding team, delivering CDP functionality in line with the requirements.
- Lead on log source onboarding for CDP & SIEM.
- Technical leadership/liaison with log source platform owners/ASGs.
- Close collaboration with wider CDP and SIEM team
- Contribute to CDP design activities such as design aspects that aid log source ingestion activities
- Proactively drive forward continuous improvement within the team
- Where required to provide 2nd and 3rd line support to maintain service availability during cyber attack.
- Keeping informed of new and updated log integration technologies
What you'll need:
- Experienced in log ingestion, streaming and reliability
- Experienced in Core Kafka, CI/CD and ETL/ELTL.
- Experienced in data collection and performance tuning using Logstash
- Experienced in handling Syslog, Elastic agent/ Beats.
- Experienced in Access Control and encryption, IAM and Network Security
- Experienced in Kubernetes
- Experienced in scripting languages - Python, Ansible as a minimum
- Experience in OpenStack or cloud technologies