Big Data Platform Engineer

About the job

This is a leading organization investing in a modern enterprise data platform to support business-critical analytics, AI, and data-driven decision-making. As part of the continued evolution of its data engineering capabilities, the organization is seeking to appoint a Big Data Platform Engineer to operate, automate, and enhance its enterprise big data platform.

This is an excellent opportunity to join a high-performing technology team responsible for ensuring the reliability, scalability, and operational excellence of mission-critical data infrastructure.

Responsibilities

You will be responsible for the administration, maintenance, and continuous improvement of the organization's enterprise big data platform, ensuring high availability, performance, and security across production environments. You will manage platform operations, monitor system health, troubleshoot complex technical issues, and implement best practices for platform reliability and resilience.

Working closely with data engineers, platform engineers, infrastructure teams, and architects, you will automate platform provisioning, deployment, configuration, and operational processes using scripting and Infrastructure as Code (IaC). You will contribute to DevOps initiatives by building automated deployment pipelines, improving operational efficiency, and reducing manual intervention across the platform lifecycle.

You will also support platform upgrades, capacity planning, patch management, disaster recovery, and performance tuning while ensuring the platform remains secure, stable, and scalable to support enterprise data and AI workloads.

Requirements

We are looking for a System Engineer with 5 years of experience supporting enterprise data platforms or big data environments. Strong DevOps experience is a prerequisite, with proven expertise in automation, scripting, CI/CD practices, and Infrastructure as Code using tools such as Terraform, Ansible, or similar technologies.

Hands-on experience managing enterprise big data platforms is essential. Candidates with experience administering Cloudera Data Platform (CDP) on-premises will be highly preferred. Experience with Hadoop ecosystem technologies is advantageous but not essential. You should enjoy solving complex infrastructure challenges and working collaboratively within an enterprise platform engineering environment. Hands-on technical consulting candidates can be considered.

To apply, please apply directly or submit your resume to Claudia at cd@kerryconsulting.com. We regret that only shortlisted candidates will be notified.

License No: 16S8060 / Registration No: R26161178