Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

LanceSoft, Inc.

NewBe an early applicant

Python Pyspark Developer

Posted

Description

Pay Range: CAD 60-70/hr

Required Technical Skills

  • Strong programming experience in Python 3.x, including OOP, data structures, exception handling, and reusable modules.
  • Hands-on experience with PySpark, Apache Spark, Spark SQL, and Spark DataFrames.
  • Strong expertise in SQL, query optimization, and relational databases.
  • Experience developing ETL/ELT pipelines and large-scale data transformation workflows.
  • Knowledge of distributed computing, parallel processing, and big data architecture.
  • Experience with data formats such as Parquet, Avro, JSON, CSV, and ORC.
  • Experience with databases such as PostgreSQL, SQL Server, Oracle, MySQL, or similar.
  • Hands-on experience with cloud platforms (AWS/Azure/GCP).
  • Knowledge of Git, Jenkins, Azure DevOps, GitHub Actions, or other CI/CD tools.

Preferred / Nice-to-Have Skills

  • Experience with Databricks, Delta Lake, and Lakehouse architecture.
  • Knowledge of Snowflake, Amazon Redshift, Azure Synapse Analytics, or BigQuery.
  • Experience with Apache Kafka and real-time streaming.
  • Knowledge of Apache Airflow, AWS Glue, Azure Data Factory, or similar orchestration tools.
  • Experience with Docker and Kubernetes.
  • Understanding of data modeling, dimensional modeling, and data warehousing concepts.
  • Experience with Terraform and cloud infrastructure automation.


Skills

Apply

See also