Data Engineer - PySpark
Description
Job Requirements:
- 5+ years of experience in Data Engineering.
- Strong hands-on expertise in PySpark, SQL, and MS SQL Server.
- Experience with Shell Scripting and experience with Informatica BDM or similar ETL/Data Integration tools.
- Hands-on experience with GitHub, DevOps/CI-CD, and version control practices.
- Experience with Apache Oozie.
Key Responsibilities:
- Build and optimize data models, data warehouses, and data lakes.
- Develop data processing workflows using PySpark and SQL.
- Data migration, ensure data quality, governance, security, and performance optimization.
- Collaborate with business and technology teams to deliver data-driven solutions.
Skills
Sign in to read and join the discussion.