Data Engineer - PySpark/AWS

Hiring Data Engineer for Bangalore Location.

Experience : 9 -13 Years

Job Location : Bangalore

F2F interview only

Must have experience in BFSI domain experience

Job Description :

Key Responsibilities :

- Design and implement scalable ETL/ELT pipelines to ingest and transform large-scale datasets, ensuring seamless data flow across the enterprise architecture.

- Develop and optimize data warehousing solutions that support complex analytical queries and reporting requirements for diverse business stakeholders.

- Build and maintain high-performance data processing applications using PySpark to handle distributed computing tasks efficiently.

- Collaborate with cross-functional teams to identify data gaps and implement automated solutions that improve data quality and pipeline reliability.

- Manage cloud-based data infrastructure on AWS, ensuring cost-effective resource utilization and adherence to security best practices.

Required Skillset :

- Demonstrated proficiency in designing and managing data warehouses, with a deep understanding of schema design and performance tuning.

- Advanced technical capability in writing complex SQL queries and optimizing database performance for large-scale production environments.

- Hands-on experience in developing data processing workflows using PySpark and Python to manage distributed data sets.

- Strong working knowledge of AWS services, specifically in the context of data storage, processing, and orchestration.

- Excellent communication skills with the ability to translate technical data challenges into clear, actionable insights for non-technical stakeholders.

- Proven ability to thrive in a collaborative, hybrid work environment, demonstrating self-motivation and a structured approach to problem-solving.

- A degree in Computer Science, Engineering, or a related quantitative field, reflecting a strong foundation in data structures and algorithms.