Senior Data Engineer (Fulfillment)

The Data Engineering department at Tesco Technology is at the forefront of data processing within the retail and technology industry. This vital department handles a range of responsibilities, including:

• Analyzing order and delivery data to optimize logistics processes and enhance delivery efficiency.
• Managing critical data related to customer orders, suppliers, and products to ensure the seamless flow of our fulfillment operations.
• Upholding data integrity and security during the processing of order and delivery-related information.

As we continue to expand, we are actively seeking a skilled Senior Data Engineer to join our team of analytics experts. In this role, you will lead the evolution of our data platform and data pipeline architecture, driving the design of scalable, reliable, and high-performing data solutions. Beyond implementation, you will influence architectural decisions, establish engineering best practices, and help shape the technical direction of our data ecosystem. You will also play a key role in optimizing data flow, accessibility, and governance to meet the growing needs of cross-functional teams across the organization.

Our ideal candidate is an experienced data engineering professional who thrives on solving complex technical challenges and building robust data systems at scale. As a Senior Data Engineer, you will work closely with software engineers, database architects, data analysts, data scientists, and product teams to deliver impactful data-driven solutions. You will provide technical leadership across initiatives, mentor fellow engineers, and ensure that our data architecture remains scalable, resilient, and aligned with business objectives. You will be expected to balance hands-on engineering with architectural ownership, driving consistency and engineering excellence across multiple projects and teams.

• Leading the design, development, and evolution of scalable, reliable, and secure data pipeline architectures.
• Building and optimizing large-scale data solutions that meet business, performance, and operational requirements.
• Driving platform improvements through automation, infrastructure modernization, and continuous optimization.
• Designing and maintaining robust data ingestion, transformation, and delivery frameworks across diverse data sources.
• Partnering with Product, Engineering, Analytics, and Business stakeholders to deliver scalable data solutions and influence technical direction.
• Championing data quality, security, observability, and operational excellence across the data platform.
• Building data products and self-service capabilities that empower analysts and data scientists.
• Mentoring engineers, promoting best practices, and contributing to the long-term technical strategy of the data platform.

Mandatory skills:

• Data Processing: Apache Spark - Scala or Python
• Data Storage: Apache HDFS, CEPH S3 or respective cloud alternative
• Resource Manager: Apache Yarn or respective cloud alternative
• Lakehouse: Apache Hive/Kyuubi or alternative
• Workflow Scheduler: Airflow or alternative

Nice to have skills:

• Functional programming
• Apache Kafka
• Kubernetes
• Stream processing
• CI/CD

Our colleagues work with one goal in mind, helping to make every day a little better for our customers, colleagues and communities all over the world. No two customers are the same, neither are our colleagues.

At Tesco, we champion a balance that lets you thrive both in and out of work. Spend 60% of your week collaborating with colleagues at our office locations or local sites and the rest remotely. Whether you're just kicking off your career, juggling passions, or navigating big life events, we're here to support you.

Tesco is committed to celebrating diversity and everyone is welcome at Tesco. As a Disability Confident Employer, we’re committed to providing a fully inclusive and accessible recruitment process, allowing candidates the opportunity to thrive and inform us of any reasonable adjustments they may require.

What our colleagues like the most at Tesco:

• We develop our own products
• We make an impact; large scale of operation
• Accountability and respect are given to us
• We cooperate and support each other
• There are great colleagues who are divided into small teams here
• We can develop and learn new things