Cloud Data Engineer

Job Summary

We are looking for a skilled Cloud Data Engineer with experience in AWS, PySpark, Informatica, ETL development, and PL/SQL. The candidate will be responsible for developing and maintaining data pipelines, processing large datasets, integrating data from multiple sources, and supporting cloud-based data engineering solutions.

Key Responsibilities

• Design, develop, and maintain data pipelines using PySpark, Informatica, and ETL tools.
• Develop and optimize data processing solutions on AWS cloud platforms.
• Perform data extraction, transformation, loading, and integration from multiple sources.
• Write and optimize PL/SQL queries, stored procedures, functions, and packages.
• Process and transform large datasets using PySpark and distributed computing frameworks.
• Monitor data pipelines, troubleshoot failures, and ensure data quality and reliability.
• Integrate data services and applications using APIs.
• Develop and maintain Power BI dashboards and reports to support business reporting requirements.
• Collaborate with data engineers, developers, and business stakeholders to understand requirements and deliver solutions.
• Follow best practices for data security, performance optimization, documentation, and deployment.

Required Skills

• Hands-on experience with AWS cloud services and cloud-based data processing.
• Strong knowledge of PySpark for large-scale data processing and transformation.
• Experience with Informatica and ETL development.
• Proficiency in PL/SQL, including complex queries and stored procedures.
• Understanding of data warehousing, data integration, and data pipeline development.
• Knowledge of API integration and data exchange mechanisms.
• Exposure to Power BI for dashboard development, reporting, and data visualization.
• Strong analytical, troubleshooting, and problem-solving skills.

Preferred Qualifications

• Experience in data engineering or cloud-based ETL projects.
• Knowledge of AWS data services such as S3, Glue, Lambda, or Redshift.
• Understanding of performance tuning, data quality, and cloud data security.
• Good communication skills and the ability to work in a collaborative environment.