Senior Python / PySpark Data Engineer
Posted
Summary
Saicon is hiring a Senior Python/PySpark Data Engineer in India to build scalable data solutions: developing reusable Python packages and frameworks, writing unit/integration tests, running CI/CD via GitHub Actions, and tuning PySpark workloads (partitioning, JDBC, large-scale ingestion) with secure data access practices.
We are seeking a Senior Python / PySpark Data Engineer with strong software engineering fundamentals and hands-on experience building scalable data solutions.
Required Skills
- Strong Python development experience with OOP, reusable code, classes, and functions
- Experience building and deploying Python packages (PyPI, wheel files)
- Expertise in Unit Testing and Integration Testing
- Strong CI/CD experience using GitHub Actions
- Solid PySpark knowledge, including:
- Performance tuning and optimization
- Partitioning and data ordering
- JDBC tuning and large-scale data ingestion
- Understanding of security best practices, access controls, and secure data access
Nice to Have
- Experience with enterprise data platforms
- Cloud and modern data engineering experience
What You'll Do
- Develop scalable Python and PySpark applications
- Build reusable frameworks and libraries
- Implement automated testing and CI/CD pipelines
- Optimize large-scale data processing workloads
- Collaborate with engineering teams to deliver secure, high-quality solutions