Senior Software Engineer
Posted Updated
Description
<p><b>We are looking for an experienced Software Engineer with a strong background in Java, Scala, and Apache Spark to join our development team. The ideal candidate has hands-on experience building scalable, high-performance data pipelines and applications, should have worked on large-scale data platforms/products with solid SQL skills and exposure to modern CI/CD practices and cloud platforms, should be comfortable building as well as troubleshooting production systems. Experience with Databricks will be a strong plus. </b></p><p><b><br /></b></p><p><b>Key Responsibilities</b></p><p><b>•Design, develop, and maintain scalable data processing applications using Java and Scala</b></p><p><b>•Build and optimize large-scale distributed data pipelines using Apache Spark</b></p><p><b>•Write efficient, complex SQL queries for data extraction, transformation, and analysis</b></p><p><b>•Collaborate with cross-functional teams to gather requirements and translate them into technical solutions</b></p><p><b>•Implement and maintain CI/CD pipelines for automated build, test, and deployment processes</b></p><p><b>•Deploy, monitor, and optimize applications on cloud platforms (AWS/Azure/GCP)</b></p><p><b>•Ensure code quality through unit testing, code reviews, and adherence to best practices</b></p><p><b>•Troubleshoot and resolve production issues, ensuring high availability and performance of data systems</b></p><p><b>•Work with Databricks environment for data engineering and analytics workloads (preferred)</b></p><p><b>•Participate in architecture discussions and contribute to technical design decisions</b></p><p><b>•Document technical solutions, processes, and system designs</b></p><p><b>Required Skills & Qualifications</b></p><p><b>5–10 years of professional software development experience</b></p><p><b>Strong programming proficiency in Java and Scala</b></p><p><b>Hands-on experience with Apache Spark (batch and/or streaming)</b></p><p><b>Strong command over SQL — writing complex queries, query optimization, and performance tuning</b></p><p><b>Practical experience with CI/CD tools (Jenkins, GitLab CI, Azure DevOps, or similar)</b></p><p><b>Working knowledge of cloud platforms — AWS, Azure, or GCP (compute, storage, and data services)</b></p><p><b>Experience with version control systems (Git)</b></p><p><b>Solid understanding of distributed computing concepts and data pipeline architecture</b></p><p><b>Strong problem-solving, debugging, and analytical skills</b></p><p><b>Good communication skills and ability to work in an Agile environment</b></p><p><b>Preferred Qualifications</b></p><p><b>Hands-on experience with Databricks (notebooks, clusters, Delta Lake, workflows)</b></p><p><b>Experience with orchestration tools (Airflow, Azure Data Factory, etc.)</b></p><p><b>Familiarity with containerization tools (Docker, Kubernetes)</b></p><p><b>Exposure to data warehousing concepts and big data ecosystems (Hive, Kafka, HDFS)</b></p><p><b>Relevant cloud certifications (AWS/Azure/GCP)</b></p><p><b>Education</b></p><p></p><p><b>Bachelor's or Master's degree in Computer Science, Engineering, or a related field</b></p><div><br /></div>
Skills
- Agile
- Airflow
- Analytics
- AWS
- Azure
- Azure Data Factory
- Azure DevOps
- Big Data
- CI/CD
- Cloud
- Containerization
- Data Engineering
- Data Pipelines
- Data Warehousing
- Databricks
- Delta Lake
- DevOps
- Distributed Computing
- Docker
- GCP
- Git
- GitLab
- Hadoop
- Hive
- Java
- Jenkins
- Kafka
- Kubernetes
- Scala
- Spark
- SQL
- Unit Testing
- Version Control
