Associate Consultant - Data Engineer(Python/Pyspark)
Summary
Build and maintain scalable data pipelines using Python and PySpark, ensuring reliable data ingestion, transformation, and integration for analytics and reporting.
- Build data pipelines for ingestion and transformation
- Debug data pipeline and performance issues
- Design scalable data solutions
- Develop ETL and ELT pipelines
- Ensure data quality and reliability
- Integrate data for reporting and analytics
- Maintain data architectures
- Participate in SDLC
- Perform code reviews
- Write optimized data processing code