Lead Data Engineer
Summary
Design, develop, and maintain GCP data pipelines and solutions for healthcare clients, working with BigQuery, Cloud Composer/Airflow, Dataproc/Spark, Python, and DBT.
About the job:
- Design, architect, develop, support GCP data pipelines to extract, load, and transform data
- Maintain a holistic view of information assets by creating and maintaining artifacts that illustrate how information is stored, processed, and supported (i.e. documentation)
- Work with the project team, estimate and plan the work effort
- Attend daily team standups
- Work with business analysts and project management to review business requirements and and produce technical design specs that will meet the requirements
About you:
- 5+ years of hands-on experience as a Data Engineer or Data Architect
- Proven track record leading technical projects and teams
- Expert proficiency in Google Cloud Platform (GCP) tools, including: Google Cloud Storage (GCS), BigQuery, Cloud Composer/Airflow, Dataproc/Spark
- Strong data analysis and problem-solving skills
- Proficiency in a Business Intelligence (BI) tool
- Advanced SQL skills, including writing, tuning, and interpreting complex SQL queries
- Experience writing and maintaining Unix/Linux shell scripts
- Solid understanding of Data Build Tool (DBT)
- Experience with CI/CD pipelines
- Machine Learning experience
- Proficiency in developing Python-based ELT data pipelines
- Expertise in optimizing GCP BigQuery SQL queries and scripts
Skills
As published by lever · 5 questions · 2 written answers
Basics
Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL, Other website
Pick from a list (3)
- Are you willing to undergo a background check?
- Are you a US citizen, permanent resident, on OPT, or do you require sponsorship to work in the US?
- Do you currently reside in the US?
Written answers (2)
- How many years of experience do you have with GCP? optional
- Please review the links you provided above - LinkedIn or GitHub. *NOTE: Incomplete or inaccurate profiles may disqualify you from consideration. If you don't have a LinkedIn or GitHub profile, please provide a link to your online portfolio or another relevant platform to showcase your skills.