Senior Cloud Data & AI Engineer
Posted Updated
Description
Position Description:
.
Position: Cloud AI Platform Lead
Experience: 6+ Years
Category: Software Development / Engineering
Shift: Hybrid - (1 PM to 10 PM Shift)
Main Location: Hyderabad
Position ID: J1026-1467
Employment Type: Full Time
Education Qualification: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, with a minimum of 6 years of relevant experience.
Position Description
We are looking for an experienced Cloud AI Platform Lead with strong expertise in AWS, Python, PySpark, SQL, Databricks, and cloud-native application development. The candidate will be responsible for designing and managing cloud-based data and AI platforms, developing data pipelines, building secure APIs, and automating cloud infrastructure using Terraform.
The role also involves integrating AI services, implementing CI/CD pipelines, ensuring cloud security, and providing technical leadership to engineering teams. The candidate should be able to deliver scalable, secure, and high-quality solutions aligned with business requirements.
Position: Cloud AI Platform Lead
Experience: 6+ Years
Category: Software Development / Engineering
Shift: Hybrid - (1 PM to 10 PM Shift)
Main Location: Hyderabad
Position ID: J1026-1467
Employment Type: Full Time
Education Qualification: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, with a minimum of 6 years of relevant experience.
Position Description
We are looking for an experienced Cloud AI Platform Lead with strong expertise in AWS, Python, PySpark, SQL, Databricks, and cloud-native application development. The candidate will be responsible for designing and managing cloud-based data and AI platforms, developing data pipelines, building secure APIs, and automating cloud infrastructure using Terraform.
The role also involves integrating AI services, implementing CI/CD pipelines, ensuring cloud security, and providing technical leadership to engineering teams. The candidate should be able to deliver scalable, secure, and high-quality solutions aligned with business requirements.
Your future duties and responsibilities:
- Design, develop, and maintain cloud-native applications and data platforms using AWS.
- Build and optimize ETL/ELT pipelines using Python, PySpark, SQL, AWS Glue, and Databricks.
- Develop and integrate secure REST APIs using AWS Lambda and API Gateway.
- Manage AWS services such as S3, EC2, ECS/EKS, CloudFront, IAM, KMS, and load balancers.
- Implement API security using OAuth 2.0, JWT, and access control mechanisms.
- Automate cloud infrastructure provisioning using Terraform.
- Integrate AI services using AWS Bedrock, Azure AI, or Google Cloud AI.
- Optimize data processing jobs and SQL queries for better performance.
- Develop and maintain CI/CD pipelines using suitable DevOps tools.
- Implement cloud security, data goverce, and compliance best practices.
- Troubleshoot application and data pipeline issues and provide production support.
- Collaborate with developers, architects, and business teams to deliver solutions.
- Mentor engineering teams, conduct code reviews, and establish development standards.
- Participate in Agile/Scrum meetings and maintain technical documentation.
Required qualifications to be successful in this role:
Must-Have Skills
- AWS Cloud Services: Lambda, API Gateway, S3, ECS/EKS, CloudFront, ALB/NLB, IAM, and KMS.
- Python / PySpark: Strong programming and data processing skills.
- SQL: Experience with complex queries and query optimization.
- Databricks: Experience developing data processing workloads and pipelines.
- API Development: Experience developing and integrating REST APIs.
- API Security: Knowledge of OAuth 2.0, JWT, authentication, and authorization.
- Data Engineering: Experience with ETL/ELT pipelines and data integration.
- Terraform: Experience with Infrastructure as Code and cloud automation.
- Cloud-Native Development: Understanding of scalable and reliable cloud applications.
- Software Architecture: Knowledge of application design and development best practices.
- Technical Leadership: Ability to guide, mentor, and support engineering teams.
Good-to-Have Skills
- Experience with OpenAPI/Swagger.
- Knowledge of Jenkins, GitHub Actions, or GitLab CI.
- Experience with Docker and Kubernetes.
- Knowledge of DevOps and automation practices.
- Familiarity with AWS Bedrock, Azure AI, or Google Cloud AI.
- Experience with Agile/Scrum methodologies and Jira.
- Knowledge of data goverce and platform management.
- Experience with multi-region and multi-currency applications.
- Understanding of security, compliance, and data protection standards.
#LI-SP40
CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.
Skills:
- AWS Lambda
- AWS S3
- Cloud Native Development
- Databricks
- English
- Infrastructure as a Code
- SQL
- AWS Cloudformation
- Data Engineering
- Data Engineering
- Python
Skills
- Agile
- AI
- API
- API Gateway
- Api Security
- Authentication
- Automation
- AWS
- AWS Bedrock
- Aws Glue
- Azure
- CI/CD
- Cloud
- Cloud Native
- Cloud Security
- CloudFormation
- CloudFront
- Data Engineering
- Data Pipelines
- Databricks
- DevOps
- Docker
- EC2
- ECS
- EKS
- ELT
- ETL
- GCP
- GitHub
- GitHub Actions
- GitLab
- IAM
- Infrastructure as Code
- Jenkins
- Jira
- JWT
- Kubernetes
- Lambda
- OAuth
- OpenAPI
- PySpark
- Python
- REST
- S3
- Scrum
- SQL
- Swagger
- Terraform