Big Data Engineer
Inetum is seeking a seasoned Big Data Engineer to join our team and support the operations of our Hadoop-based data lake environments. This is a critical role for ensuring the performance, reliability, and security of our big data infrastructure.
Key Responsibilities
- Operate, monitor, and support Hadoop-based data lake platforms.
- Provide L3 incident response, deep troubleshooting, and performance tuning for big data components.
- Ensure data integrity, replication, and capacity management within HDFS clusters.
- Develop and automate monitoring and alerting for service health and node performance.
- Collaborate with platform and data teams to onboard new workloads with optimal resource allocation.
- Apply patches, upgrades, and configuration changes to maintain platform security and stability.
- Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption.
- Work with storage, network, and security teams to optimize throughput and access controls.
- Maintain cluster documentation and share knowledge across teams.
- Bachelor’s degree in Computer Science or equivalent.
- Minimum 5 years of experience in a similar role.
- Strong expertise in:
- Hadoop Ecosystem & Data Lake Operations
- Big Data Services & Query Engines
- Security & Access Control in Distributed Environments
- Monitoring, Automation & Platform Lifecycle Management
- Proven ability to diagnose and resolve complex issues in Big Data environments.
- Strong communication skills to collaborate with cross-functional teams.
- English proficiency: B2-C1 level
Nice to Have:
- Big Data certifications (e.g., Cloudera).
- Familiarity with Kafka, NiFi, or Flume for ingestion pipelines.
- Knowledge of ITIL processes for incident and change management.