Senior Solution Architect - Databricks
Salary: RM 9,000 – RM 10,500 per month
Location: Tanjong Pagar
Type of Employment: Contract 12 Months (renewable)
Company Industry: Investment Management
Essential Technical Skills:
• Databricks Platform: Proven hands-on experience with Databricks platform including workspace administration, cluster management, and workflow orchestration
• Unity Catalog: Demonstrated experience implementing Unity Catalog for unified governance, including metastore configuration, catalog/schema design, and access control policies
• Data Modelling: Strong expertise in designing and implementing data models, including dimensional modeling, data vault, and lakehouse architectures
• Delta Lake: Deep understanding of Delta Lake features including ACID transactions, time travel, and optimization techniques
• Apache Spark: Proficiency in Spark SQL, DataFrames, and performance tuning
• Programming: Strong skills in Python, SQL, and/or Scala for data processing
• Cloud Platforms: Experience with Azure, AWS, or GCP cloud services
Additional Technical Skills:
• Data pipeline development and ETL/ELT processes
• Data governance frameworks and metadata management
• Performance optimization and troubleshooting
• CI/CD practices for data platforms
• Data quality and validation frameworks
• Understanding of data security and compliance requirements
Professional Experience:
• Minimum 8-10 years in data architecture, engineering, or analytics roles
• At least 3-5 years of hands-on experience with Databricks platform
• Databricks Certified Associate Developer for Apache Spark (mandatory)
• Proven track record implementing Unity Catalog in enterprise environments
• Experience designing and implementing complex data models for large-scale systems
• Background working with Databricks Professional Services or similar partnerships preferred
• Experience across multiple industry sectors (Public Service, Financial Services, Healthcare, etc.) is advantageous
Certifications (Preferred) - mandatory to have at least one certification
• Data Engineer Professional
• Cloud platform certifications (Azure Data Engineer, AWS Data Analytics, or GCP Data Engineer)
• Relevant data management or analytics certifications
Soft Skills
• Excellent communication and presentation abilities
• Strong analytical and problem-solving capabilities
• Ability to work collaboratively with Partners and cross-functional teams
• Client-focused mindset with relationship-building skills
• Self-motivated with ability to manage multiple priorities
• Experience working in agile environments