Data Engineer Cloud
Summary
Build and maintain cloud-based data pipelines and analytics platforms using AWS, Databricks, Python, and Spark to power scalable reporting and AI/ML initiatives.
We are looking for an experienced Data Engineer (Cloud) to join our growing team. The ideal candidate should have hands-on expertise in designing and developing cloud-based data solutions using AWS, Databricks, Python, SQL, and ETL/ELT technologies. You will be responsible for building scalable data pipelines, modernizing cloud data platforms, and delivering secure, high-performance analytics solutions whilecollaborating with cross-functional teams.
Roles & Responsibilities
Design and develop cloud-based data analytics solutions using AWS and Databricks.
Build and maintain scalable ETL/ELT data pipelines using Python, SQL, and Spark SQL.
Design and implement Data Lakes, Data Warehouses, and Data Marts.
Develop cloud-native data integration solutions using Informatica IDMC.
Automate infrastructure using Terraform and CloudFormation.
Collaborate with business stakeholders to gather and translate technical requirements.
Optimize SQL queries, Spark workloads, and cloud data processing performance.
Implement CI/CD pipelines and support DevOps best practices.
Ensure cloud security, IAM compliance, and data governance standards.
Support AI/ML data engineering initiatives and reporting solutions.
Prepare technical documentation and support production deployments.
Technical Requirements
Experience:
5 -10 years in Cloud Data Engineering. Strong hands-on experience with AWS (Glue, Redshift, S3, Lambda, Athena, EMR, Kinesis). Expertise in Databricks, Delta Lake, Spark, Python, SQL, and Spark SQL. Experience with Informatica IDMC, ETL/ELT, and Data Warehousing. Knowledge of Terraform, CloudFormation, CI/CD, and DevOps. Experience with Oracle, SQL Server, MySQL, or Teradata. Understanding of Cloud Security, IAM, Data Modeling, and Agile methodologies. Skills & Qualifications AWS Cloud Services Databricks & Apache Spark Python, SQL & Spark SQL ETL/ELT & Data Integration Informatica IDMC Data Warehousing & Data Lakes Terraform & CloudFormation CI/CD & DevOps Oracle / SQL Server / MySQL / Teradata Power BI / Tableau Cloud Security & IAM Strong analytical, problem-solving, and communication skills
5 -10 years in Cloud Data Engineering. Strong hands-on experience with AWS (Glue, Redshift, S3, Lambda, Athena, EMR, Kinesis). Expertise in Databricks, Delta Lake, Spark, Python, SQL, and Spark SQL. Experience with Informatica IDMC, ETL/ELT, and Data Warehousing. Knowledge of Terraform, CloudFormation, CI/CD, and DevOps. Experience with Oracle, SQL Server, MySQL, or Teradata. Understanding of Cloud Security, IAM, Data Modeling, and Agile methodologies. Skills & Qualifications AWS Cloud Services Databricks & Apache Spark Python, SQL & Spark SQL ETL/ELT & Data Integration Informatica IDMC Data Warehousing & Data Lakes Terraform & CloudFormation CI/CD & DevOps Oracle / SQL Server / MySQL / Teradata Power BI / Tableau Cloud Security & IAM Strong analytical, problem-solving, and communication skills