Hadoop Administrator - Big Data Platform

Professional Summary :

Experienced Hadoop Administrator with 8+ years of expertise in designing, implementing, administering, monitoring, troubleshooting, and supporting enterprise Big Data platforms.

Strong hands-on experience with Cloudera CDP, Cloudera Manager, HDFS, YARN, Hive, Spark, Impala, ZooKeeper, JournalNodes, Kerberos, and Apache Ranger.

Key Responsibilities :

- Administer and support Cloudera CDP Hadoop clusters using Cloudera Manager.

- Manage HDFS, YARN, Hive, Spark, Impala, ZooKeeper, and JournalNodes.

- Configure and troubleshoot HDFS HA, NameNode, DataNode, and JournalNode quorum issues.

- Manage YARN resources, queues, applications, and capacity planning.

- Perform DataNode decommission/recommission, node addition/removal, and cluster expansion.

- Configure and troubleshoot Kerberos authentication and Apache Ranger authorization.

- Monitor cluster health, capacity, performance, and service availability.

- Perform Hadoop service restarts, rolling restarts, patching, upgrades, and maintenance.

- Troubleshoot HDFS, YARN, Hive, Spark, Impala, and Kerberos production issues.

- Perform Spark-on-YARN performance and resource tuning.

- Analyze Hadoop application/service logs and perform RCA for production incidents.

- Manage HDFS replication, snapshots, quotas, balancing, and storage utilization.

- Support backup, disaster recovery, HA/failover, and recovery activities.

- Integrate Hadoop/Spark logs with Splunk and enterprise monitoring tools.

- Automate routine administration tasks using Linux Shell scripting.

- Provide 24x7 production support, incident management, and change management.

- Prepare SOPs, RCA documents, operational reports, and technical documentation.

Tech Stack : HDFS, YARN, Hive, Spark, Impala, Oozie, ZooKeeper, Cloudera CDP, Cloudera Manager, Kerberos, Apache Ranger, RHEL/Linux, ServiceNow/JIRA, Splunk.