Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Capri Global Capital

Data Engineer

Posted Updated

Description

We are seeking a skilled and passionate Data Engineer with 4-5 years of experience in designing, developing, and maintaining scalable data solutions. The ideal candidate should have strong expertise in AWS, PySpark, Apache Airflow, Kafka, and Streaming Technologies and be capable of building robust data pipelines that support both batch and real-time analytics.


Responsibilities:

  • Design, develop, and maintain scalable ETL/ELT data pipelines.
  • Build and optimize batch and real-time data processing solutions using PySpark.
  • Develop and manage data workflows using Apache Airflow.
  • Implement streaming data architectures using Apache Kafka.
  • Work with AWS cloud services to build and manage data platforms.
  • Ensure high data quality, reliability, scalability, and performance.
  • Collaborate with cross-functional teams, including Product, Engineering, and Analytics.
  • Monitor and troubleshoot data pipelines and production issues.
  • Implement data governance, security, and best practices across the data ecosystem.


Requirements:

  • 4-5 years of experience in Data Engineering.
  • Strong hands-on experience with AWS Services (S3 Glue, EMR, Lambda, Redshift, Athena, etc. ).
  • Expertise in PySpark and distributed data processing.
  • Experience with Apache Airflow for workflow orchestration.
  • Strong knowledge of Apache Kafka and real-time streaming architectures.
  • Experience in building batch and streaming data pipelines.
  • Proficiency in Python and SQL.
  • Good understanding of Data Warehousing and Data Modeling concepts.
  • Experience working with large-scale datasets and cloud-based data platforms.
  • Familiarity with CI/CD and DevOps practices is a plus.


Preferred Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field.
  • Experience working in Agile/Scrum environments.
  • Strong analytical and problem-solving skills.
  • Excellent communication and stakeholder management abilities.

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →