Data Engineer

Job Description

Job Title: Data Engineer
Department & Team Technology Location:
Job Level: Reporting To: Big Data Manager
Role Purpose:
We are undertaking a Data Transformation at Lebara and as data becomes fundamental to what
we are doing, the ability to have the right data in the right place at the right time, that is accurate
and consistent is essential.
The purpose of this job is to have a QA resource that can participate in day-to-day QA activities
like, testing sprint tickets, providing the updates on the assigned tickets, to improve your knowledge
on the relevant domain. You need to be passionate enough to think & perform out of the box, to
add innovation to improve your daily task and work SMART (Specific, Measurable, Achievable,
Relevant and Time bound). You will be the part of Lebara QA Team. Need to have the clarity on
the domain to understand the testing requirement to test in an efficient manner.
Responsibilities:
 Designing and implementing data pipelines to collect, clean, and transform data from
various sources
 Building and maintaining data storage and processing systems, such as databases, data
warehouses, and data lakes
 Ensuring data is properly secured and protected
 Developing and implementing data governance policies and procedures
 Collaborating with data analysts, data scientists, and other stakeholders to understand
their data needs and ensure they have access to the data they need
 Sharing knowledge with the wider business, working with other BA’s and technology teams
to make sure processes and ways of working is documented.
 Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize
data ingestion pipelines so that data is shared effectively across various business systems.
 Ensure the design, code and procedural aspects of solution are production ready, in terms
of operational, security and compliance standards.
 Participate in day-to-day project and agile meetings and provide technical support for faster
resolution of issues.
 Clearly and concisely communicating to the business, on status of items and blockers.
 Have an end-to-end knowledge of the data landscape within Lebara.
Skills & Experience:
 8+ years of design & development experience with big data technologies
 Proficient in Python, PySpark, Azure Data Brickes/AWS, Kubernetes and Terraform
 2+ years of development experience in cloud technologies like Azure, AWS or GCP
 Proficient in querying and manipulating data from various DB (relational and big data).
 Experience of writing effective and maintainable unit and integration tests for ingestion
pipelines.
 Experience of using static analysis and code quality tools and building CI/CD pipelines.
 Excellent communication, problem-solving, and leadership skills, and be able to work well
in a fast-paced, dynamic environment.
 Experience of working on high-traffic and large-scale Software Products
Behavioural Fit:

 Technical with a keen eye for detail.
 Self-Driven, self-motivated and results oriented.
 Confident and an ability to challenge if necessary.
 Process driven, organised & well-structured
 Ability to work in a cross-functional, multi-cultural team and in a collaborative environment
with minimal supervision.
 Ability to multi-task and plan, organize and prioritize multiple projects.
Role Key Performance Indicators:
 Data Pipeline reliability & resiliency
 Data processing efficiency & Release quality
 Defect Analysis & Data Quality maintained with the development done
 Time to market & resource utilisation
 Business & Stakeholder satisfaction