Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
Senior Software Engineer – Core Java, Apache Spark, Python, SQL, Data Processing
Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision! Senior Software Engineer – Core Java, Apache Spark, Python, SQL, Data Processing
Summary
Senior software engineer building and supporting scalable server-side applications and large-scale analytical data processing systems using Core Java, Apache Spark, Python, SQL, and Linux. Day to day: designing microservices, optimizing Spark pipelines and database performance, and supporting deployment and CI/CD in Linux environments.
Senior Software Engineer – Core Java, Apache Spark, Python, Big Data, SQL
Job Description – Core Java, Apache Spark, Python
We are seeking a highly motivated and experienced Software Engineer with strong expertise in Core Java, Apache Spark, Python, SQL, and Linux to design, develop, and support scalable server-side applications and analytical data processing systems. The ideal candidate will have hands‑on experience in building high-performance applications, integrating analytical platforms, and working with large-scale data processing frameworks.
Key Responsibilities
- Design, develop, test, and maintain high-performance, scalable server-side applications using Core Java and Python
- Build and optimize large-scale data processing solutions using Apache Spark
- Develop and maintain database solutions, write complex SQL queries, and optimize database performance
- Design and integrate analytical systems to process and analyze large volumes of structured and unstructured data
- Collaborate with cross-functional teams including business analysts, architects, data engineers, and QA teams to deliver robust solutions
- Troubleshoot, debug, and resolve application and system performance issues
- Work in Linux environments for application deployment, monitoring, and support activities
- Participate in application architecture discussions and contribute to technical design decisions
- Ensure adherence to coding standards, security guidelines, and software development best practices
- Support CI/CD processes and application lifecycle management
Required Skills & Qualifications
- Senior years of hands‑on experience in software development and analytical system integration
- Strong programming expertise in Core Java
- Hands‑on experience with Apache Spark for distributed data processing
- Strong development experience in Python
- Proficiency in SQL and relational databases
- Strong working knowledge of Linux/Unix operating systems
- Experience in application/server-side development and microservices-based architectures
- Experience designing, building, and integrating analytical and data processing systems
- Strong understanding of data structures, algorithms, object-oriented design principles, and multithreading
- Experience with RESTful APIs and system integration
- Excellent problem‑solving and debugging skills
Preferred Qualifications
- Experience with cloud platforms such as AWS, Azure, or GCP
- Knowledge of Hadoop ecosystem technologies
- Experience with containerization technologies such as Docker and Kubernetes
- Familiarity with CI/CD tools and DevOps practices
- Experience working in Agile/Scrum environments
Key Competencies
- Strong analytical and problem-solving skills
- Ability to work independently and collaboratively in a fast-paced environment
- Excellent communication and stakeholder management skills
- Commitment to delivering high-quality, scalable, and maintainable solutions
- Nice to Have: Financial Services / Capital Markets domain experience