Principal Data Platform Engineer
Summary
Architect and build a centralized data platform on Databricks for a FinTech startup, integrating financial data sources and enabling AI/ML workloads.
Responsibilities
- Architect and implement a centralized data platform on Databricks
- Design data models and unified schemas across multiple product lines
- Implement multi-catalog governance strategy using Unity Catalog
- Optimize Delta Lake performance through Z-ordering, compaction, and liquid clustering
- Build declarative ETL pipeline frameworks using Delta Live Tables
- Integrate third-party data sources like ERP systems and external providers
- Implement cost monitoring, data quality frameworks, and self-service patterns
Requirements
- 5-8 years in data engineering or data platform roles
- 3+ years hands-on Databricks experience
- Expertise in Unity Catalog, Delta Lake, and Delta Live Tables
- Proficiency in PySpark and Databricks SQL
- Experience with AWS (S3, IAM, VPC)
- Infrastructure-as-code experience, preferably with Terraform
- Proven track record leading significant platform builds or migrations
Preferred Qualifications
- Experience with financial data or accounting systems like NetSuite
- Background building platforms for AI/ML workloads (RAG, LLMs)
- Knowledge of relationship surfacing with knowledge graphs
- Familiarity with data governance frameworks for regulated industries
About the Company
Exactera is a FinTech SaaS start-up that provides AI-powered corporate tax solutions. Founded in 2016 and backed by over $100 million in funding, the company operates at the intersection of human and machine intelligence to serve customers worldwide.