Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

System Soft Technologies

Azure Databricks Architect

Posted Updated 25 views

Description

Job Requirements and Responsibilities for Azure Databricks Architect:

  • Design, develop, and maintain scalable data pipelines using Azure Databricks.
  • Build high-performance ETL/ELT pipelines using PySpark and Apache Spark.
  • Implement declarative pipelines and optimize workflows for reliability and scalability.
  • Design and manage Delta Lake architecture for efficient data storage and processing.
  • Develop robust batch and streaming data processing solutions.
  • Create and optimize SQL queries for large-scale data processing.
  • Perform performance tuning of Spark jobs and Databricks clusters.
  • Implement data governance using Unity Catalog.
  • Design enterprise-level data models supporting analytics and reporting.
  • Integrate CI/CD pipelines for automated deployment and testing.
  • Collaborate with data scientists and AI teams to enable ML/AI workloads.
  • Ensure data quality, security, monitoring, and best practices across the platform.
  • Databricks certification mandatory.

Skills

Apply

See also

Architecture jobs by country — openings, pay and top skills →