Cloud Data Engineer

Job Summary

We are looking for an experienced and highly motivated Cloud Data Engineer to join our Data Engineering team. The ideal candidate will be responsible for designing, developing, implementing, and maintaining scalable and reliable data pipelines in cloud environments.

The candidate should have strong hands-on experience in ETL/ELT development, Data Warehouse architecture, SQL programming, and Python development. You will work closely with data science, data analysts, and other technology teams to build and optimize data integration processes that support business intelligence, analytics, and data-driven decision-making.

We are also looking for someone who is comfortable leveraging AI-powered tools to improve development productivity, automate repetitive tasks, and enhance overall engineering efficiency.

Key Responsibilities

1. Design, develop, implement, and maintain robust ETL/ELT data pipelines to support enterprise data integration and analytics requirements.

2. Develop and optimize SQL queries, complex stored procedures, and database processes to ensure efficient data extraction, transformation, and loading.

3. Design, build, and maintain Data Warehouse solutions, including data models, data structures, and data integration workflows.

4. Develop and maintain data processing scripts and automation using Python programming language.

5. Implement and manage data pipelines and data solutions on cloud platforms, mainly AWS and Microsoft Fabric.

6. Monitor, troubleshoot, and optimize data pipelines to ensure data quality, reliability, performance, and availability.

7. Collaborate with cross-functional teams to understand business requirements and translate them into effective technical data solutions.

8. Apply best practices in data engineering, including data security, governance, performance optimization, and process automation.

9. Leverage AI-powered development tools to accelerate coding, troubleshooting, documentation, and data engineering activities.

10. Continuously explore and recommend new technologies, tools, and approaches to improve the organization's data engineering capabilities.

Requirements & Qualifications

1. Bachelor's degree in Computer Science, Information Technology, Information Systems, or a related field.

2. Minimum 4 years of professional working experience as a Data Engineer, with hands-on experience in developing and managing ETL/ELT data pipelines.

3. Strong understanding of Data Warehouse concepts, architecture, data modelling, and data integration processes.

4. Strong proficiency in SQL, including complex queries, query optimization, and ETL stored procedure development.

5. Good programming skills in Python, particularly for data processing, transformation, and automation.

6. Hands-on experience working with at least one major cloud platform:

   • Amazon Web Services (AWS)

   • Microsoft Azure

   • Google Cloud Platform (GCP)

7. Familiarity with cloud-based data services, data storage, and data processing technologies.

8. Ability and willingness to leverage AI-powered tools (e.g., Kiro, GitHub Copilot, or similar AI coding assistants) to improve development efficiency and productivity.

9. Strong analytical and problem-solving skills, with the ability to troubleshoot complex technical issues.

10. Good communication skills and the ability to work independently as well as collaboratively within a team.

Preferred / Added Advantages

1. Experience working with cloud-based Data Warehouse platforms such as Amazon Redshift, Microsoft Fabric

2. Familiarity with workflow orchestration and scheduling tools such as Apache Airflow or similar platforms.

3. Experience with big data technologies and distributed data processing frameworks such as Apache Hadoop or Apache Spark.

4. Familiarity with Git, version control, and CI/CD practices for data engineering development.

5. Experience implementing data quality monitoring and automated data validation processes.

6. Hands-on experience with ETL tools such as Talend or Microsoft SQL Server Integration Services (SSIS).

"Our company has never levied any fees for the recruitment process nor has it required to order tickets and accommodation through a certain travel agent or certain person"