Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

VY SYSTEMS PRIVATE LIMITED

data engineer

Posted Updated

Description

Data Engineer – Splunk & ELK Stack

Job Summary

We are seeking a skilled Data Engineer with hands-on experience in Splunk, the ELK Stack (Elasticsearch, Logstash, Kibana), and modern data engineering practices. The ideal candidate will design, build, and maintain scalable data pipelines, log analytics platforms, and monitoring solutions to support business intelligence, security, and operational excellence.

Key Responsibilities

  • Design, develop, and maintain scalable data ingestion and ETL/ELT pipelines.
  • Configure, administer, and optimize Splunk environments for log collection, indexing, searching, and reporting.
  • Develop and maintain ELK Stack solutions using Elasticsearch, Logstash, Kibana, and Beats.
  • Build dashboards, visualizations, alerts, and reports for infrastructure, application, and security monitoring.
  • Integrate data from multiple structured and unstructured sources into centralized analytics platforms.
  • Optimize Elasticsearch clusters for performance, scalability, and high availability.
  • Troubleshoot data pipeline failures, indexing issues, and system performance bottlenecks.
  • Automate deployment and configuration using scripting and Infrastructure as Code where applicable.
  • Collaborate with DevOps, Security, Cloud, and Application teams to implement observability and monitoring solutions.
  • Ensure data quality, governance, and compliance with organizational standards.
  • Document technical designs, operational procedures, and best practices.

Required Skills

  • Strong experience with Splunk Enterprise administration and development.
  • Hands-on experience with the ELK Stack:
  • Elasticsearch
  • Logstash
  • Kibana
  • Beats (Filebeat, Metricbeat, Winlogbeat, etc.)
  • Experience building ETL/ELT pipelines and data integration workflows.
  • Strong SQL skills and experience with relational databases.
  • Experience with Python, Shell scripting, or Java for automation.
  • Understanding of log management, monitoring, and observability concepts.
  • Experience working with Linux environments.
  • Knowledge of REST APIs and data ingestion techniques.
  • Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
  • Experience with Git and CI/CD pipelines.

Preferred Skills

  • Experience with Kafka, Spark, or other streaming technologies.
  • Knowledge of Docker and Kubernetes.
  • Experience with Terraform, Ansible, or other Infrastructure as Code tools.
  • Understanding of SIEM concepts and security analytics.
  • Experience with Prometheus, Grafana, or OpenTelemetry.
  • Exposure to big data technologies and distributed systems.
Skills:- Data engineering, Splunk, elkstack, Elastic Search, DevOps and Monitoring

Skills

What Middle Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →