Databricks Platform Engineer
Summary
Designs and builds Delta Lake tables for financial datasets (AR, GL, invoices) using Databricks, creating PySpark pipelines for ERP data processing and integrating LLMs for semantic query tuning.
Responsibilities Design and build Delta Lake tables on Databricks (bronze/silver/gold medallion architecture) for financial datasets (AR, GL, invoices, collections) Build and manage Databricks Genie Spaces — configure semantic models, write GENIE-compatible SQL, and tune NL-to-SQL behavior for finance use cases Develop PySpark and Python-based data pipelines (Databricks Jobs Workflows) for ERP data ingestion, transformation, and aggregation Integrate Databricks Model Serving with LLMs (Claude,…