SO_Cloud_Devops_Engineer_SME_2026
Summary
Maintain and optimize cloud-based data pipelines using Databricks and Azure tools to ensure stability, scalability, and cost efficiency.
Key responsibilities:
Ensure the stability, scalability, and performance of the data pipelines solution.
Monitor and maintain batch data pipelines in a cloud-based environment.
Improve operational processes including incident handling, performance monitoring, and issue resolution.
Optimize Databricks workloads to improve efficiency and reduce costs.
· Analyze and fine-tune the cloud infrastructure for better cost optimization.
Technical Skills:
Solid understanding of common issues in cloud-based data pipelines and analytics solutions
Working knowledge of Databricks and Lakehouse architecture in a cloud environment.
Working with Batch accounts, IAC, GitHub, IAM, and CI/CD pipelines
Experience with command-line scripting (e.g., PowerShell).
Experience with data pipeline orchestration tools (e.g. Azure Data Factory)
Understanding of monitoring and logging tools is a plus.
Soft Skills:
Excellent problem-solving and critical thinking skills, with a proactive approach to incident management and root cause analysis.
Strong communication and coordination abilities, capable of working effectively across cross-functional and international teams.
High level of ownership, with a strong drive for operational excellence, efficiency, and continuous improvement.
Education:
Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
Professional Experience:
Experience in operating and maintenane
- 3-5 years Experience in cloud infra and Devops