Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Microgreen Technologies LLC

NewBe an early applicant

Data Engineer - Healthcare

Posted Updated

Description

Title: Data Engineer - Healthcare

Location: Remote (U.S.)

Role Summary

We are seeking an experienced Data Engineer with a healthcare background to design, build, and optimize scalable data pipelines using Python and PySpark. You will ingest, transform, and deliver high-quality clinical, claims, and operational data for analytics, reporting, and downstream applications, while meeting healthcare privacy and compliance standards.

Key Responsibilities

  • Design, develop, and maintain batch and streaming data pipelines using PySpark and Python
  • Build and optimize ETL/ELT workflows for large healthcare datasets (claims, EHR/EMR, eligibility, provider, pharmacy, and lab data)
  • Ingest and transform healthcare data standards such as HL7, FHIR, X12 (837/835/834), CCDA, and ICD-10/CPT/NDC/LOINC code sets
  • Tune Spark jobs for performance, cost, and reliability (partitioning, caching, join strategies)
  • Develop data models and curated datasets in data lake / lakehouse environments
  • Implement data quality checks, validation, lineage, logging, and monitoring
  • Apply de-identification, masking, and access controls to PHI/PII in line with HIPAA requirements
  • Orchestrate workflows using Airflow or similar schedulers
  • Collaborate with data scientists, analysts, clinical SMEs, and application teams
  • Apply CI/CD, version control, and testing best practices to data code
  • Document pipelines, data flows, and technical designs

Required Qualifications

  • 5+ years of hands-on data engineering experience
  • 3+ years of experience in the healthcare, health insurance, life sciences, or health IT domain
  • Strong proficiency in Python and PySpark (Spark SQL, DataFrames, RDDs)
  • Advanced SQL skills and experience with relational and columnar databases
  • Experience with big data ecosystems (Hadoop, Hive, Delta Lake, Parquet)
  • Experience with at least one major cloud platform (AWS, Azure, or Google Cloud Platform) and its data services (e.g., S3, Glue, EMR, Databricks, Synapse, BigQuery)
  • Working knowledge of HIPAA, PHI/PII handling, and healthcare data security practices
  • Solid understanding of data warehousing, dimensional modeling, and ETL design
  • Experience with Git and CI/CD pipelines
  • U.S. Citizen (native/natural-born or naturalized), able to work 100% remotely from within the U.S.

Preferred Qualifications

  • Experience with EHR platforms (Epic, Cerner, Allscripts) or payer systems (Facets, QNXT)
  • Familiarity with healthcare analytics such as HEDIS, risk adjustment, quality measures, or population health
  • Databricks or Snowflake experience
  • Streaming experience (Kafka, Spark Structured Streaming)
  • Airflow, dbt, Terraform, or Docker/Kubernetes experience
  • Cloud or data certifications (AWS, Azure, Databricks)
  • Experience with federal or state healthcare programs (Medicare, Medicaid, CMS)
  • Bachelor’s degree in Computer Science, Engineering, Health Informatics, or a related field

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →