PySpark Developer
Posted Updated
Description
Job Description
PySpark Developer
Job Summary
We are seeking a PySpark Developer with strong experience in Python, ETL, and Databricks to design, build, and optimize scalable data pipelines. The role involves processing large datasets, developing data transformation workflows, and implementing data engineering solutions on the Databricks Lakehouse Platform.
Required Technical/Functional Skills
- PySpark
- Python
- Databricks
- ETL
- Hadoop
- AWS
Roles & Responsibilities
- Design, build, and optimize scalable data pipelines.
- Process large datasets using PySpark.
- Develop efficient data transformation and ETL workflows.
- Implement data engineering solutions on the Databricks Lakehouse Platform.
- Support reliable and scalable data processing requirements.
Preferred Skills
Experience with the following is preferred:
- AWS, Azure, or Google Cloud Platform
- SQL
- Delta Lake
- Data pipeline and PySpark performance tuning
Skills
Sign in to read and join the discussion.