Data Engineer - Healthcare
Posted Updated
Description
Title: Data Engineer - Healthcare
Location: Remote (U.S.)
Role Summary
We are seeking an experienced Data Engineer with a healthcare background to design, build, and optimize scalable data pipelines using Python and PySpark. You will ingest, transform, and deliver high-quality clinical, claims, and operational data for analytics, reporting, and downstream applications, while meeting healthcare privacy and compliance standards.
Key Responsibilities
- Design, develop, and maintain batch and streaming data pipelines using PySpark and Python
- Build and optimize ETL/ELT workflows for large healthcare datasets (claims, EHR/EMR, eligibility, provider, pharmacy, and lab data)
- Ingest and transform healthcare data standards such as HL7, FHIR, X12 (837/835/834), CCDA, and ICD-10/CPT/NDC/LOINC code sets
- Tune Spark jobs for performance, cost, and reliability (partitioning, caching, join strategies)
- Develop data models and curated datasets in data lake / lakehouse environments
- Implement data quality checks, validation, lineage, logging, and monitoring
- Apply de-identification, masking, and access controls to PHI/PII in line with HIPAA requirements
- Orchestrate workflows using Airflow or similar schedulers
- Collaborate with data scientists, analysts, clinical SMEs, and application teams
- Apply CI/CD, version control, and testing best practices to data code
- Document pipelines, data flows, and technical designs
Required Qualifications
- 5+ years of hands-on data engineering experience
- 3+ years of experience in the healthcare, health insurance, life sciences, or health IT domain
- Strong proficiency in Python and PySpark (Spark SQL, DataFrames, RDDs)
- Advanced SQL skills and experience with relational and columnar databases
- Experience with big data ecosystems (Hadoop, Hive, Delta Lake, Parquet)
- Experience with at least one major cloud platform (AWS, Azure, or Google Cloud Platform) and its data services (e.g., S3, Glue, EMR, Databricks, Synapse, BigQuery)
- Working knowledge of HIPAA, PHI/PII handling, and healthcare data security practices
- Solid understanding of data warehousing, dimensional modeling, and ETL design
- Experience with Git and CI/CD pipelines
- U.S. Citizen (native/natural-born or naturalized), able to work 100% remotely from within the U.S.
Preferred Qualifications
- Experience with EHR platforms (Epic, Cerner, Allscripts) or payer systems (Facets, QNXT)
- Familiarity with healthcare analytics such as HEDIS, risk adjustment, quality measures, or population health
- Databricks or Snowflake experience
- Streaming experience (Kafka, Spark Structured Streaming)
- Airflow, dbt, Terraform, or Docker/Kubernetes experience
- Cloud or data certifications (AWS, Azure, Databricks)
- Experience with federal or state healthcare programs (Medicare, Medicaid, CMS)
- Bachelor’s degree in Computer Science, Engineering, Health Informatics, or a related field
Skills
- Airflow
- Analytics
- AWS
- Azure
- Big Data
- BigQuery
- CI/CD
- Cloud
- Data Engineering
- Data Lake
- Data Pipelines
- Data Quality
- Data Warehousing
- Databricks
- dbt
- Delta Lake
- Dimensional Modeling
- Docker
- ELT
- ETL
- FHIR
- GCP
- Git
- Hadoop
- Hipaa
- Hive
- HL7
- Kafka
- Kubernetes
- Lakehouse
- Parquet
- PySpark
- Python
- S3
- Snowflake
- Spark
- SQL
- Terraform
- Version Control
Sign in to read and join the discussion.