Senior Software Engineer- AWS Data Engineer

Dear All,

Greetings from Sparity!

Sparity is a global technology company specializing in AI, Digital Transformation, Cloud, Cybersecurity, and IT Consulting services. With a strong presence across India and international markets, we are committed to innovation, growth, and delivering scalable business solutions.

Role: Senior Software Engineer Data Engineering
Position: Full Time

Experience : 6-8 years
Location:Hyderabad

Key Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using AWS Glue, PySpark, and Python.
• Implement batch and streaming data integration with reliable error handling, retry, and replay mechanisms.
• Develop and optimize SQL queries and stored procedures for Oracle, Aurora PostgreSQL, and Amazon RDS.
• Work with MongoDB and DynamoDB data models and large-scale, multi-terabyte datasets.
• Use AWS Lambda and Step Functions for pipeline orchestration.
• Perform data profiling, validation, debugging, and performance tuning.
• Develop unit tests and data quality checks and support production deployments.
• Work with GitHub, GitHub Actions, Jenkins, ECS, Terraform, Docker, and AWS security services.
• Participate in design reviews, code reviews, root-cause analysis, and production support.
• Maintain technical documentation and provide backup support for the Data Engineering Technical Lead.

Required Skills

• 6-8 years of experience in Data Engineering or ETL Development.
• Strong hands-on experience with AWS Glue, PySpark, Python, and SQL.
• Hands-on experience with Oracle, MongoDB, and DynamoDB.
• Good knowledge of Aurora PostgreSQL, Amazon RDS, batch and streaming data integration.
• Working knowledge of Amazon ECS and Terraform.
• Familiarity with AWS Lambda, Step Functions, Docker, EKS, OpenShift, VPC, Security Groups, IAM, and encryption.
• Experience with CI/CD tools such as GitHub Actions and Jenkins.
• Strong debugging, performance optimization, data validation, and production support skills.

AI Knowledge & AI-Assisted Development

• Understanding of AI/LLM models and prompt engineering.
• Practical experience using AI-assisted development tools such as Devin AI, Cursor, and Claude Skills.
• Ability to review and validate AI-generated code, SQL queries, and data transformations.
• Experience using AI tools for data profiling and technical documentation.
• Awareness of secure AI usage and protection of sensitive data.

Preferred Qualifications

• Experience in the US healthcare, health insurance, or payer domain.
• Knowledge of claims, eligibility, enrollment, provider, or member data.
• Familiarity with HIPAA, HL7, FHIR, or X12 EDI standards.
• Exposure to AWS Athena, Redshift, Kinesis, or EMR.
• AWS Data Engineer or Data Analytics certification.

Education

Bachelors degree in Computer Science, Engineering, Information Systems, or a related field.

Interested Candidates Can please apply now