Principal Data Engineer
Posted Updated
Description
Overview
In this Principal Data Engineer role, you will design and maintain data pipelines to enable analytical use across diverse data sources. You’ll join a cross-functional Agile software team within Raytheon UK’s Defence and Cyber business, shaping data-driven solutions for mission-critical challenges. You will optimize data processing and contribute to technical direction and continuous improvement. The role offers exposure to cutting-edge analytics in a high-security environment with a strong emphasis on collaboration and delivery.
Pay / Benefits- Competitive salary
- Contributory Pension Scheme (up to 10.5% company contribution)
- 25 days holiday + holidays
- Discretionary company bonus
- Flexible Benefits with salary sacrifice schemes
- Enhanced sick pay
- Build data pipelines to clean, transform, and aggregate data from disparate sources
- Collaborate with stakeholders and other engineers
- Contribute to project milestones and team continuous improvement
- Shape technical direction within the team
- Experience in an Agile delivery team
- Strong analytics with unstructured data
- Python (PySpark, Pandas, PyArrow)
- Distributed data processing (Apache Spark)
- Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi)
- Cloud services (AWS, Azure or GCP)
- Messaging/Streaming (Kafka, AWS SQS)
- SQL and NoSQL
- Storage (HDFS, Iceberg, Elastic, S3, Data Lake)
- Containerisation and orchestration (Docker / Kubernetes / Openshift)
- Testing frameworks and best practices
- Code repositories and PR/merge processes
- Collaborative
- Detail-oriented
- Problem-solving
- Python (PySpark, Pandas, PyArrow)
- Apache Spark
- Apache Airflow