Data Engineer
Summary
Builds and maintains data pipelines, dashboards, and DevOps tooling for clients, using Python, SQL, and visualization tools like Tableau.
Responsibilities
- Investigating and troubleshooting reported incidents relating to technical configurations, such as connectivity failures, API timeouts, and service failures.
- Documenting changes made to existing configurations, including data sources, pipelines, and user accounts.
- Researching, proposing, and documenting technical requirements.
- Reviewing reported security vulnerabilities and implementing the necessary fixes.
- Collaborating with the infrastructure team to support requests from the data team.
- Supporting product managers throughout the cloud transformation journey for data products.
- Providing technical support and consultancy services to business users.
- Developing reports to monitor usage, performance, and security events.
- Generating mock-up data and creating unit tests.
- Setting up DevOps pipelines.
- Optimising the performance of data pipelines.
- Reviewing data pipelines to ensure compliance with data management standards, policies, and procedures.
Qualifications
- A minimum of a Bachelor's Degree in Computer Science, Computer Engineering, or a related discipline.
- At least 4 years of work experience in Data Engineering, Data Science, Software Engineering, or IT Infrastructure.
Required Skills
- Proficient in developing dashboards, preferably using QuickSight or Tableau.
- Proficient in dashboard UX design.
- Proficient in SQL scripting for analysing, transforming, and integrating data sources.
- Proficient in Python.