Senior Software Engineer

<p><b>We are looking for an experienced Software Engineer with a strong background in Java, Scala, and Apache Spark to join our development team. The ideal candidate has hands-on experience building scalable, high-performance data pipelines and applications, should have worked on large-scale data platforms/products with solid SQL skills and exposure to modern CI/CD practices and cloud platforms, should be comfortable building as well as troubleshooting production systems. Experience with Databricks will be a strong plus. </b></p><p><b><br /></b></p><p><b>Key Responsibilities</b></p><p><b>•Design, develop, and maintain scalable data processing applications using Java and Scala</b></p><p><b>•Build and optimize large-scale distributed data pipelines using Apache Spark</b></p><p><b>•Write efficient, complex SQL queries for data extraction, transformation, and analysis</b></p><p><b>•Collaborate with cross-functional teams to gather requirements and translate them into technical solutions</b></p><p><b>•Implement and maintain CI/CD pipelines for automated build, test, and deployment processes</b></p><p><b>•Deploy, monitor, and optimize applications on cloud platforms (AWS/Azure/GCP)</b></p><p><b>•Ensure code quality through unit testing, code reviews, and adherence to best practices</b></p><p><b>•Troubleshoot and resolve production issues, ensuring high availability and performance of data systems</b></p><p><b>•Work with Databricks environment for data engineering and analytics workloads (preferred)</b></p><p><b>•Participate in architecture discussions and contribute to technical design decisions</b></p><p><b>•Document technical solutions, processes, and system designs</b></p><div><div>Required Skills & Qualifications</div><div>5–10 years of professional software development experience</div><div>Strong programming proficiency in Java and Scala</div><div>Hands-on experience with Apache Spark (batch and/or streaming)</div><div>Strong command over SQL — writing complex queries, query optimization, and performance tuning</div><div>Practical experience with CI/CD tools (Jenkins, GitLab CI, Azure DevOps, or similar)</div><div>Working knowledge of cloud platforms — AWS, Azure, or GCP (compute, storage, and data services)</div><div>Experience with version control systems (Git)</div><div>Solid understanding of distributed computing concepts and data pipeline architecture</div><div>Strong problem-solving, debugging, and analytical skills</div><div>Good communication skills and ability to work in an Agile environment</div><div>Preferred Qualifications</div><div>Hands-on experience with Databricks (notebooks, clusters, Delta Lake, workflows)</div><div>Experience with orchestration tools (Airflow, Azure Data Factory, etc.)</div><div>Familiarity with containerization tools (Docker, Kubernetes)</div><div>Exposure to data warehousing concepts and big data ecosystems (Hive, Kafka, HDFS)</div><div>Relevant cloud certifications (AWS/Azure/GCP)</div><div>Education</div><div>Bachelor's or Master's degree in Computer Science, Engineering, or a related field</div></div>