Data Engineer Senior
Posted Updated 3
views
Summary
Senior Data Engineer at Techridge who designs scalable big data/cloud pipelines, builds real-time ingestion and ETL/ELT processes, and enforces data security and quality to support analytics. Core technologies include PySpark and Kafka.
Responsibilities • Design and Implement scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc. Collaborate with cross-functional teams to understand data requirements and provide effective solutions. • Implement real-time data ingestion and processing solutions • Develop and maintain ETL/ELT processes to support data analytics and reporting. • Implement best practices for data security, integrity, and quality. • Developing data integrati…