Python Developer (Lead)
Posted Updated
Summary
Lead-level data engineering role: build and maintain scalable data pipelines with Python and PySpark, design and optimize MS SQL databases, and deploy solutions on Azure and Databricks. Includes data transformation, performance tuning, troubleshooting, and mentoring junior developers.
Job Description
- Develop and maintain scalable data pipelines using Python and PySpark.
- Work extensively with MS SQL to design, optimize, and manage database structures and queries.
- Build and deploy solutions in Azure and Databricks environments.
- Perform data transformations, cleaning, validation, and performance tuning.
- Collaborate with Data Engineers, Cloud Architects, and Business Teams to deliver data solutions.
- Ensure code quality through best practices, reviews, testing, and documentation.
- Troubleshoot complex data issues and optimize workflows for performance and reliability.
- Assist in guiding or mentoring junior developers when required
Requirements
- Minimum 5+ years of total IT experience.
- Minimum
4+ years of hands-on experience Python (Advanced / Hardcore
development), PySpark, MS SQL (queries, stored procedures,
optimization), Azure cloud, Databricks
- Strong understanding of relational databases and data engineering concepts.
- Experience building end-to-end data pipelines and working with large datasets.
- Ability to write clean, efficient, and scalable code.