Data Engineer
Posted Updated
Description
Surgo Health is hiring a Data Engineer to own the data layer behind Derin, our AI-powered interview platform. You will design, build and operate end-to-end data pipelines on Databricks, move data into the lakehouse, and ensure production-grade delivery with quality checks and governance.
You will work with backend engineers, data scientists and product managers in a fast-paced, AI-driven environment, focusing on privacy, security and scalable data solutions across regions.
Own the Databricks data platform behind Derin, from ingestion to analytics-ready tables Design and build reliable batch and incremental pipelines on Databricks Govern pipelines with Unity Catalog and move production data to Lakebase Develop data models for analytics and dashboards for scientists and clients Ensure data quality with checks, tests, lineage, monitoring and alerting Turn notebooks and analyses into production-grade pipelines Embed privacy and security controls in a SOC2/HIPAA-compliant environment Use Terraform and CI/CD to deploy data workloads across environments Collaborate with backend engineers, data scientists and product managers 3+ years in data engineering and building production pipelines in Python and SQL Hands-on Databricks experience (Spark, Delta Lake, Unity Catalog, Lakeflow or Jobs) Strong PostgreSQL skills including schema design and optimization Experience with Microsoft Azure and infrastructure as code/CI/CD Data modeling for analytics/BI and focus on data quality and testing Experience serving data to LLM-powered features is a plus Healthcare data or regulated data experience is a plus AI-native work with agentic tools (Claude Code, Cursor) and awareness of usage considerations University degree in Computer Science or related field Independent, proactive and able to deliver end-to-end with minimal supervision Fluent in English with strong written and spoken skillsSkills
Sign in to read and join the discussion.