Senior Databricks Engineer
Islamabad, Pakistan | Posted on 08/10/2026
We are seeking a highly skilled and proactive Senior Databricks Engineer with 7-8 years of experience in data engineering, cloud-based data platforms, and large-scale data processing. The ideal candidate will have deep expertise in Azure Databricks, Apache Spark, data warehousing, and modern data architecture. This role requires a sharp technical professional who can independently design, build, optimize, and maintain scalable data solutions while collaborating closely with business and technical stakeholders.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark.
- Build and optimize ETL/ELT processes for large-scale data integration and transformation.
- Develop and manage Delta Lake architectures to ensure data reliability, governance, and performance.
- Implement and maintain data ingestion frameworks from various structured and unstructured data sources.
- Collaborate with data architects, analysts, and business teams to translate requirements into technical solutions.
- Monitor, troubleshoot, and optimize Databricks workloads for performance and cost efficiency.
- Ensure adherence to data governance, security, and compliance standards.
- Mentor junior engineers and contribute to technical design discussions and architecture reviews.
- Participate in code reviews and drive engineering best practices across the team.
Requirements
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field.
- 7-8 years of overall experience in Data Engineering.
- Minimum 4+ years of hands-on experience with Azure Databricks.
- Strong expertise in Apache Spark (PySpark and/or Scala).
- Advanced SQL development and performance tuning skills.
- Experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.
- Strong understanding of Delta Lake architecture and Lakehouse concepts.
- Experience building robust ETL/ELT pipelines in enterprise environments.
- Knowledge of data modeling, warehousing, and dimensional modeling concepts.
- Experience with Git, DevOps practices, and CI/CD pipelines.
- Strong troubleshooting, analytical, and problem-solving skills.