Senior Data Platform Engineer - Welwyn Garden City, United Kingdom of Great Britain and Northern Ireland
Summary
Senior engineer at Tesco building and running a scalable security data platform that powers analytics, ML and GenAI for threat detection and incident response. Day to day: designing realtime and batch pipelines into a security data lake, automating deployments with Kubernetes, Terraform and CI/CD, and mentoring junior engineers using Python, SQL, Databricks/BigQuery, Spark, Airflow and dbt.
In this role you will build and maintain a scalable data platform to empower advanced analytics, ML, and GenAI for strengthening security defences. You will work closely with cross‑functional data teams to ensure secure, scalable delivery aligned with cybersecurity goals. You will contribute to the data platform architecture and mentor junior engineers to deliver high‑quality data services. This position offers the opportunity to shape security data capabilities in a collaborative, flexible environment with a clear impact on threat detection and incident response.
Pay / Benefits- bonus up to 20% of base salary
- 25+ days holiday + personal day + bank holidays
- private medical insurance
- maternity/adoption leave
- paternity leave
- 24/7 virtual GP and EAP
- Data Architecture: design, build and manage realtime, near realtime and batch data architectures for threat detection, incident response and reporting using advanced analytics, ML and GenAI
- Data Integration and Transformation: implement automated frameworks for data ingestion from security sources into the security data lake; manage data flows across raw, trusted and curated layers
- Coding: produce high‑quality code, perform thorough peer reviews, and provide constructive feedback to teammates
- Automation and DevOps: implement automations and DevOps practices to streamline deployment, configuration and management of data platform components
- Collaboration and Communication: work with multiple departments and explain technical concepts to non‑technical stakeholders
- Proficiency in Python and SQL
- Experience building data platforms on cloud services (Databricks on Azure or GCP BigQuery) and big data tech (Spark, Flink)
- Strong knowledge of Kubernetes, CI/CD and Terraform
- Experience with ETL/ELT frameworks and orchestration tools (Airflow and dbt)
- Ability to guide and empower junior team members
- Familiarity with ML/AI tools; cybersecurity knowledge
- collaborative communication
- mentoring and coaching
- problem solving
- Python
- SQL
- Databricks (Azure) or GCP BigQuery