Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Indsafri India Private Limited

Senior Cloudera Data Engineer

Posted

Description

We are seeking a highly experienced Senior Cloudera Data Engineer to join our dynamic data team. The ideal candidate will have extensive experience in designing, developing, and optimizing complex data pipelines and solutions within the Cloudera ecosystem. This role requires a deep understanding of big data technologies and a proven ability to translate business requirements into robust and scalable data engineering solutions.

Key Responsibilities

  • Design, build, and maintain scalable and reliable data pipelines using Cloudera CDP (CDH/HDP).
  • Develop and optimize ETL/ELT processes using Spark, PySpark, Hive, and Impala.
  • Write efficient and complex SQL queries for data extraction, transformation, and analysis.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver impactful solutions.
  • Implement data quality checks and ensure data integrity across various data platforms.
  • Monitor and troubleshoot data pipeline performance, identifying and resolving issues proactively.
  • Contribute to architectural decisions and best practices for big data solutions.
  • Mentor junior data engineers and share expertise within the team.
  • Stay up to date with the latest trends and technologies in big data and cloud data engineering.

Required Skills and Qualifications

  • 7+ years of hands-on experience in data engineering, with a strong focus on big data technologies.
  • Proven expertise in the Cloudera Data Platform (CDP) and its components (e.g., HDFS, YARN, Spark, Hive, Impala, Kudu).
  • Strong programming skills in Python (PySpark) and proficiency in SQL.Experience in designing, developing, and optimizing complex ETL/ELT workflows.
  • Solid understanding of data warehousing concepts and data modeling techniques.
  • Experience with distributed computing frameworks like Apache Spark.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities.

Preferred Qualifications

  • Experience with cloud platforms (AWS, Azure, GCP) and their data services.
  • Familiarity with containerization technologies (Docker, Kubernetes).
  • Experience with streaming data technologies (Kafka, Kinesis).
  • Knowledge of data governance and security best practices.

Skills

Docker Python AWS GCP Azure analytical skills SQL PySpark Problem-Solving communication Kubernetes Collaboration Data Warehousing Data Modeling Data Governance Security best practices apache spark hdfs kafka impala spark Hive YARN Kinesis Big Data technologies Data Engineering Cloudera Data Platform (CDP) Kudu ETL/ELT workflows Distributed Computing Frameworks

Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →