Remote Senior Data Engineer — AI-Driven Data Platform
Posted Updated
Description
Transcarent is seeking a Senior Data Engineer to architect and build enterprise-scale data pipelines powering member analytics. You will partner with engineering, analytics, and business stakeholders to modernize a cloud-native data platform, leveraging Databricks and AWS, and pushing AI-powered automation.
In 6–12 months, take ownership of core pipelines, contribute to platform modernization, and pursue AI/ML opportunities to solve real data problems.
Architect, build, and maintain enterprise-scale data pipelines with high reliability and performance. Own core components of a cloud-native data platform on Databricks and AWS. Design and implement data integration across internal and third-party systems; ensure data quality end-to-end. Apply AI/ML, including LLM-based agents, to automate data engineering tasks and unlock analytics capabilities. Build and optimize data models across AWS and Databricks environments. Collaborate with stakeholders to translate requirements into scalable data solutions. Impose data quality controls and observability across the pipeline lifecycle. Diagnose and resolve production data issues; mentor engineers on code quality and architecture. Research and evaluate new tools, advising on adoption where impactful. BS or MS in Computer Science, Data Science, or related field (or equivalent practical experience). 5+ years of professional data engineering experience with leadership. Expert-level Python and SQL for enterprise-scale processing and query optimization. Hands-on Databricks and AWS data services experience (S3, Redshift, RDS, Glue, Lambda). Proven track record designing large-scale data warehousing and ETL/ELT pipelines. Experience with Airflow and modern orchestration frameworks. Interest or experience applying AI/ML to data engineering problems. Medical, dental, vision coverage 401(k) with company match Paid time off and holidays Life Insurance and DisabilitySkills
Sign in to read and join the discussion.