Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Purple Drive Technologies LLC

NewBe an early applicant

PySpark Developer

Posted Updated

Description

Job Description

PySpark Developer

Job Summary

We are seeking a PySpark Developer with strong experience in Python, ETL, and Databricks to design, build, and optimize scalable data pipelines. The role involves processing large datasets, developing data transformation workflows, and implementing data engineering solutions on the Databricks Lakehouse Platform.

Required Technical/Functional Skills

  • PySpark
  • Python
  • Databricks
  • ETL
  • Hadoop
  • AWS

Roles & Responsibilities

  • Design, build, and optimize scalable data pipelines.
  • Process large datasets using PySpark.
  • Develop efficient data transformation and ETL workflows.
  • Implement data engineering solutions on the Databricks Lakehouse Platform.
  • Support reliable and scalable data processing requirements.

Preferred Skills

Experience with the following is preferred:

  • AWS, Azure, or Google Cloud Platform
  • SQL
  • Delta Lake
  • Data pipeline and PySpark performance tuning

Skills

Apply

See also