Big Data Administrator
Summary
Maintains and secures Hadoop clusters and related big-data infrastructure for a banking client, handling upgrades, monitoring, and on-call support during Europe business hours.
Job Description
We are seeking an experienced Big Data Administrator to provide Level 3 production support for enterprise Big Data platforms in a banking environment. You will be responsible for maintaining the availability, performance, security, and stability of Hadoop infrastructure while supporting production incidents, platform upgrades, capacity planning, and infrastructure improvements.
The role requires close collaboration with architects, development teams, infrastructure teams, and project stakeholders to ensure production readiness and operational excellence. Candidates should be comfortable supporting mission-critical systems and participating in rotational on-call support aligned with Europe business hours.
Key Responsibilities
- Administer and maintain Hadoop clusters and related Big Data platforms.
- Perform installation, upgrades, patching, and cluster expansion.
- Manage HDFS, YARN, Kafka, Kerberos, and Linux administration.
- Monitor system performance, capacity, security, and availability.
- Troubleshoot complex production incidents and perform root cause analysis.
- Automate administrative tasks using Shell, Python, or Perl scripting.
- Collaborate with development and infrastructure teams to deliver production-ready solutions.
- Maintain technical documentation and operational best practices.