Senior Data Platform Engineer

Job Summary :

We are looking for an experienced Data Platform Engineer to enhance the UDAP data platform, focusing on scalability, performance, reliability, and AI-driven automation.

Key Responsibilities :

- Design and optimize scalable data pipelines and batch/streaming workflows.

- Develop automation solutions to improve operational efficiency.

- Implement monitoring, alerting, and anomaly detection.

- Apply AI/ML techniques to improve platform operations and reduce incidents.

- Troubleshoot distributed systems and optimize AWS infrastructure.

- Collaborate with data engineering, SRE, and platform teams.

- Follow engineering best practices and contribute to technical documentation.

Tech Stack :

- Programming : Python, Java, or Scala

- Data Engineering : Apache Spark, Kafka/NiFi, Apache Airflow

- Infrastructure : AWS, Linux/Unix scripting, Terraform/CloudFormation

- Monitoring/AI : Splunk, Prometheus, Grafana, AIOps, AI/ML automation

Requirements :

- 6+ years of experience in software engineering, data platforms, or distributed systems.

- Strong troubleshooting, performance tuning, and automation skills.