Senior Databricks Engineer
Posted Updated
Description
We are Photon, one of the world's largest Digital Platform Engineering companies providing a unique combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We are a high growth organization serving over 40% of Fortune 100 companies and truly believe that our people make the world of difference for our clients and our business. With Photon, you get the opportunity to learn and grow, build deep digital/technical expertise, and achieve your professional and personal aspirations.
Check out our introduction video -
We are actively hiring and found your profile very interesting! We’d love the opportunity to connect with you and explore possibilities to build an exciting future together!
Job Title: Senior Databricks Engineer
Location: Irving, TX / New York, NY / Jersey City, NJ / Tampa, FL
Job Nature: Full Time
Duration: Long Term
Job Summary: Seeking Senior Databricks Engineers to develop and support modern data platforms using Databricks, Spark, and cloud technologies. The role will focus on building high-performance data pipelines and supporting analytics initiatives.
Key Responsibilities
- Develop ETL/ELT pipelines using Databricks and PySpark.
- Build and maintain Delta Lake data pipelines.
- Develop notebooks, workflows, and automated jobs.
- Perform data ingestion from multiple source systems.
- Optimize Spark jobs and improve performance.
- Support testing, deployment, and production validation.
- Collaborate with business and analytics teams.
- Monitor and troubleshoot production issues.
Required Skills
- Databricks
- PySpark
- Python
- SQL
- Delta Lake
- Data Warehousing
- ETL/ELT Development
- Azure Data Factory or AWS Glue
- Git
Preferred Skills
- Delta Live Tables
- Unity Catalog
- Kafka
- Airflow
- Banking & Financial Services domain
Skills
Sign in to read and join the discussion.