Data Engineer
Posted 3
views
Summary
A 4-month contract Data Engineer role in London (hybrid, 3 days onsite) placed by staffing firm Mackin Talent. Day to day the engineer builds and maintains batch ETL pipelines, writes and tunes SQL on large datasets, adds data quality checks, and produces prototypes using Python, Airflow, and a distributed query engine like Spark or Presto.
Our client is looking for a Data Engineer to join their team.
Duration - 4 months
Location - Hybrid (3 days onsite)
Responsibilities :
The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization’s data assets.
Job Responsibilities:
- Design, construct, install, test and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices.
- Design, implement, automate and maintain large scale enterprise data ETL processes.
- Build high-performance algorithms, prototypes, predictive models and proof of concepts.
- Build, test and maintain batch ETL pipelines for assigned datasets, following existing team
patterns and standards.
- Implement changes to existing pipelines and tables in response to defined requirements,
including backfills and schema updates.
- Write and optimise SQL for large-scale datasets; investigate and fix data quality issues raised
through monitoring or stakeholder reports.
- Add and maintain data quality checks, tests and documentation for the pipelines in scope.
- Produce prototypes and exploratory analyses where requested, with direction from the FTE
owner on scope and success criteria.
- Participate in code review and follow team conventions for version control, deployment and
change management
Requirements
- Bachelor's degree in computer science, engineering, or a related technical field, or equivalent
practical experience.
- 5+ years building production data pipelines.
- Strong SQL, including performance tuning on large tables.
- Python for data transformation and pipeline orchestration.
- Experience with a distributed query engine (Presto, Spark, Hive or similar) and a workflow
scheduler (Airflow or similar).
- Comfortable working in a code review based workflow with Git.
- Ability to work as part of a team, as well as work independently or with minimal direction.
- Excellent written, presentation, and verbal communication skills.
- Collaborate with data architects, modelers and IT team members on project goals.
- Strong PC skills including knowledge of Microsoft SharePoint.
Nice to have:
- Experience with data modelling for analytics (dimensional or wide-table patterns).
- Experience building dashboards or working with BI tooling.
- Experience with data quality frameworks and pipeline observability.
Education/Experience:
- Bachelor's degree in a technical field such as computer science, computer engineering or related field required.
- Process certification, such as, Six Sigma, CBPP, BPM, ISO 20000, ITIL, CMMI."
Benefits
- Competitive salary
- Healthcare contribution and inclusion in company pension scheme
- Work laptop and phone
- 25 days annual leave (pro-rata) plus paid bank holidays
- Expanding workforce with potential for career progression for top performers.