Senior Data Platform and AI Engineer

Job Title: Senior Data Platform and AI Engineer (AWS & AI)

Experience: 6+ Years

Location: Pune (only Pune candidates preferred)

Notice period: Immediate/Serving Notice

Job Summary

We are looking for an experienced Data Platform Engineer to enhance the UDAP data platform, focusing on scalability, performance, reliability, and AI-driven automation.

Key Responsibilities

• Design and optimize scalable data pipelines and batch/streaming workflows.
• Develop automation solutions to improve operational efficiency.
• Implement monitoring, alerting, and anomaly detection.
• Apply AI/ML techniques to improve platform operations and reduce incidents.
• Troubleshoot distributed systems and optimize AWS infrastructure.
• Collaborate with data engineering, SRE, and platform teams.
• Follow engineering best practices and contribute to technical documentation.

Required Skills

• 6+ years of experience in software engineering, data platforms, or distributed systems.
• Experience with AIOps, AI/ML automation, anomaly detection, and predictive monitoring.
• Strong programming skills in Python, Java, or Scala.
• Hands-on experience with Apache Spark, Kafka/NiFi, and Apache Airflow.
• Strong knowledge of AWS services and Linux/Unix scripting.
• Experience with Terraform/CloudFormation and monitoring tools such as Splunk, Prometheus, or Grafana.
• Strong troubleshooting, performance tuning, and automation skills.

Preferred Skills

• Familiarity with Kubernetes, Docker, and object storage such as Amazon S3.
• Experience with enterprise-scale data platforms.