Senior/Data Engineer
Posted
Summary
Senior data engineer who designs and builds data warehouses/lakes and scalable ETL/ELT pipelines, ingesting structured and unstructured data while ensuring quality, governance, and performance. Works with SQL, Python/Java/Scala, big data tools like Hadoop/Spark, and cloud platforms (AWS/Azure/GCP); the project requires security clearance.
Role:
- Design, lead and implement a data warehouse/lake/store.
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
- Manage data ingestion from multiple structured and unstructured sources.
- Build and maintain data warehouse/data lake infrastructure.
- Ensure data quality, integrity, and availability across systems.
- Optimize data processing jobs for performance and reliability.
- Collaborate with data analysts, data scientists, and application teams.
- Implement data security, access control, and data governance practices.
- Monitor, troubleshoot, and resolve data pipeline issues.
- Maintain documentation for data architectures, pipelines, and processes.
- Support operational and maintenance activities.
- Degree in Computer Science, Information Technology, Data Engineering, or related field.
- Experience in data engineering or related data roles.
- Proficient in SQL and programming languages such as Python, Java, or Scala.
- Experience with ETL tools and data pipeline frameworks.
- Experience with relational databases and big data technologies (e.g., Hadoop, Spark).
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP).
- Knowledge of data warehousing concepts and data modelling.
- Strong problem-solving and analytical skills.
- Good communication and teamwork skills.
- This role will need to secure a clearance, due to the sensitivity of the project.
Appreciate the interest of all applicants; however only shortlisted candidates will be notified.
EA Licence No: 20S0237