Senior Java Engineer - Search & Big Data
Description
Job Description
We are looking for an experienced Java Engineer with strong expertise in Search Technologies and Big Data. The ideal candidate will have hands-on experience building scalable backend applications, developing search solutions, and processing large volumes of structured and unstructured data.
Key Responsibilities
- Design and develop scalable backend applications using Java and Spring Boot.
- Build and optimize search solutions using Elasticsearch, OpenSearch, Apache Solr, or similar platforms.
- Develop REST APIs and microservices for search and data-intensive applications.
- Implement indexing, querying, relevance tuning, analyzers, tokenization, and search optimization.
- Build large-scale data pipelines using Spark, Hadoop, Kafka, or related technologies.
- Process structured, semi-structured, and unstructured datasets.
- Optimize application performance, search latency, database queries, and data-processing workflows.
- Work with distributed systems, cloud infrastructure, and data-storage platforms.
- Follow engineering best practices including testing, code reviews, CI/CD, monitoring, and production support.
Required Skills
Java Development
- Strong Core Java and Java 8+ skills.
- Experience with Collections, Multithreading, Concurrency, and JVM fundamentals.
- Strong Spring Boot, Spring Framework, REST API, and Microservices experience.
- Knowledge of SQL and relational/NoSQL databases.
Search Technologies
- Hands-on experience with Elasticsearch, OpenSearch, or Apache Solr.
- Strong understanding of indexing, mappings, analyzers, tokenizers, and inverted indexes.
- Experience with complex queries, aggregations, relevance scoring, and search tuning.
- Knowledge of distributed search clusters, sharding, replication, and performance optimization.
- Experience integrating search platforms with Java applications.
Big Data
- Experience with Apache Spark, Hadoop, Hive, or related technologies.
- Knowledge of Apache Kafka or similar distributed messaging platforms.
- Experience building ETL/ELT pipelines and processing large datasets.
- Understanding of distributed computing, partitioning, and batch/stream processing.
- Familiarity with JSON, Avro, and Parquet.
Cloud & DevOps
- Exposure to AWS, Azure, or GCP.
- Familiarity with Docker, Kubernetes, Git, Jenkins, or similar CI/CD tools.
- Knowledge of monitoring, troubleshooting, and production deployments.
Preferred
- Experience building enterprise-scale search platforms.
- Experience with real-time streaming and data ingestion architectures.
- Performance profiling and distributed-system troubleshooting.
- Knowledge of security, authentication, authorization, and data governance.
- Strong problem-solving and communication skills.
Key Skills: Java, Spring Boot, Elasticsearch/OpenSearch/Solr, Search, Microservices, Spark, Hadoop, Kafka, Big Data, REST APIs, SQL/NoSQL, Docker, Kubernetes, AWS/Azure/GCP.
͏
Areas of responsibility
Gathering of requirements-Participate in gathering requirements for specific modules and ensure clear, structured documentation. Work across multiple business processes to capture linkages, dependencies, and required changes.
͏
Solution Design-Facilitate creation of application solution designs for a specific module under the guidance of the Project Manager, ensuring alignment with business requirements and technical standards.
͏
Coding and Configuration-"Review the developed codes, resolve technical queries of the team for the assigned module and create consistent replication patterns, to ensure that the developed code aligns with the project standards.Collaborate with project managers through all phases of software development life cycle."
͏
Perform root-cause analysis to identify and troubleshoot recurring technical issues. Modify software codes to resolve errors, adapt to new hardware and software, enhance performance, and upgrade interfaces."
Implementation-"Collaborate with technical teams to validate configurations, facilitate integration of new applications, and address dependencies during deployment. Prepare user training documents and related frameworks to ensure smooth adoption new applications and minimize transition risks."
Skills
- API
- Authentication
- Avro
- AWS
- Azure
- Big Data
- CI/CD
- Cloud
- Data Governance
- Data Ingestion
- Data Pipelines
- DevOps
- Distributed Computing
- Distributed Systems
- Docker
- Elasticsearch
- ELT
- ETL
- GCP
- Git
- Hadoop
- Hive
- Java
- Jenkins
- JSON
- JVM
- Kafka
- Kubernetes
- Microservices
- Multithreading
- NoSQL
- OpenSearch
- Parquet
- REST
- Root Cause Analysis
- Solr
- Solution Design
- Spark
- Spring
- SQL