Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Ats Client

NewBe an early applicant

Expert Data Engineer

Posted

Description

Job Description

About the Role: The Data Engineer will work on enterprise-wide data provisioning, spanning multiple data governance domains and data assets. Responsibilities include ensuring secure data sharing, adhering to protection and compliance requirements, supporting enterprise Data & Analytics initiatives (including high-priority use cases), and enabling data provisioning for operational processes.

Role Responsibilities
  • Building and maintaining large-scale Big Data pipelines on cloud-based data platforms
  • Ensuring secure and compliant data sharing aligned with information classification standards
  • Supporting enterprise Data & Analytics initiatives and high-priority use cases
  • Continuously improving and automating data engineering processes
  • Evaluating emerging tools and technologies to drive innovation
  • Mentoring and upskilling team members
  • Maintaining high-quality technical documentation
Requirements Essential Skills Cloud & Infrastructure
  • Terraform
  • Docker
  • Linux / Unix
  • Cloud Formation
  • Code Build / Code Pipeline
  • Cloud Watch
  • SNS
  • S3
  • Kinesis Streams (Kinesis, Firehose)
  • Lambda
  • Dynamo DB
  • Step Functions
  • Parameter Store
  • Secrets Manager
Programming & Data Engineering
  • Python 3.x
  • SQL (Oracle / Postgre SQL)
  • Py Spark
  • Boto3
  • ETL development
  • Big Data platforms
  • Power Shell / Bash
Data Platforms & Tools
  • Glue
  • Athena
  • Technical data modelling & schema design (hands-on, not drag-and-drop)
  • Kafka
  • AWS EMR
  • Redshift
Business & Analytics
  • Business Intelligence (BI) experience
  • Strong data governance and security understanding
Advantageous Skills
  • Advanced data modelling expertise, especially in Oracle SQL
  • Strong analytical skills for large, complex datasets
  • Experience with testing, data validation, and transformation accuracy
  • Excellent documentation, written, and verbal communication skills
  • Ability to work independently, multitask, and collaborate within teams
  • Experience building data pipelines using AWS Glue, Data Pipeline, or similar
  • Familiarity with AWS S3, RDS, and Dynamo DB
  • Solid understanding of software design patterns
  • Experience preparing technical specifications, designing, coding, testing, and debugging solutions
  • Strong organisational abilities
  • Knowledge of Parquet, AVRO, JSON, XML, CSV
  • Experience with Data Quality tools such as Great Expectations
  • Experience working with REST APIs
  • Basic networking knowledge and troubleshooting skills
  • Understanding of Agile methodologies
  • Experience with documentation tools such as Confluence and JIRA
Qualifications & Experience
  • Relevant IT, Business, or Engineering Degree
  • Experience developing technical documentation and artefacts
  • Experience with enterprise collaboration tools
Preferred Certifications
  • AWS Cloud Practitioner
  • AWS Sys Ops Associate
  • AWS Developer Associate
  • AWS Architect Associate
  • AWS Architect Professional
  • Hashi Corp Terraform Associate

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →