Data Engineer: PySpark & ETL on Azure/AWS — Remote-First
Summary
Remote-first data solutions firm Halo Labs seeks a data engineer to design scalable PySpark frameworks for a SaaS platform: building ETL/ELT pipelines on Azure and AWS, processing data with PySpark on Databricks, integrating clinical systems and healthcare APIs, and implementing CI/CD pipelines.
Halo Labs, a remote-first data solutions firm, is seeking a data engineer to design and implement scalable PySpark frameworks for a SaaS platform. You will build ETL/ELT pipelines on Azure and AWS, process data with PySpark on Databricks, and integrate third-party clinical systems and healthcare APIs.
You will collaborate with software engineers to embed data services into the product architecture, optimize data layer performance, and implement CI/CD pipelines for automated deployment.