Databricks Architect - (ADLS, S3, or GCS).
Summary
Design and build scalable Databricks-based data pipelines and lakehouse architectures using Spark, Delta Lake, and cloud storage (ADLS/S3/GCS).
Required Skills
13+ years of experience in Data Engineering/Data Architecture.
Strong hands-on experience with Databricks and the Lakehouse architecture.
Expertise in Apache Spark (PySpark/Scala).
Experience with Azure Databricks, AWS Databricks, or GCP Databricks.
Strong SQL and data modeling skills.
Experience designing and implementing ETL/ELT pipelines.
Knowledge of Delta Lake, Unity Catalog, and performance optimization.
Experience with cloud storage solutions (ADLS, S3, or GCS).
Familiarity with CI/CD, Git, and DevOps practices.
Excellent communication and stakeholder management skills.
Preferred Skills
Experience with streaming data (Kafka, Structured Streaming).
Knowledge of orchestration tools such as Airflow or Azure Data Factory.
Databricks or Cloud certifications are a plus.
Responsibilities:
Design and architect scalable Databricks data solutions.
Develop high-performance data pipelines using Spark and Databricks.
Optimize data processing, storage, and query performance.
Collaborate with business and technical teams to define data architecture.
Implement data governance, security, and best practices.
Mentor engineering teams and provide technical leadership.
Regards,
Mohammed ilyas,
PH - 229-264-4024 or Text - 229-469-1455 or you can share the updated resume at Mohammed@vtekis. com
All your information will be kept confidential according to EEO guidelines.