Data Engineer (Temporary)
Posted Updated
Description
Applaudo Studios is seeking an experienced Data Engineer to build reliable data integrations and transform complex data into actionable insights. You will develop production ETL pipelines using TypeScript/Node.js and Python, integrating REST APIs and leveraging GCP data services.
You will join an async-first, distributed team to monitor pipelines, ensure data quality, and contribute to CI/CD workflows while onboarding into an established codebase.
Build and maintain ETL pipelines between Zuora REST APIs and a GCP data warehouse. Develop and maintain integration components using TypeScript/Node.js and Python. Manage transformation logic for billing events, subscriptions, invoices, payments, and revenue data. Work within existing architecture, patterns, conventions, and CI/CD workflows. Develop data pipelines using BigQuery, Cloud Storage, Dataflow, and Pub/Sub. Implement pipeline monitoring, alerting, error handling, retry logic, and data quality controls. Write complex SQL validation queries to verify data parity between sources and warehouse. Collaborate with Business Architect on data-validation requirements. Investigate pipeline failures and data discrepancies. Support accurate and reliable data movement across systems and environments. Provide clear written updates in an async-first team. 5+ years of professional experience in data engineering, integration development, or related roles. Production ETL pipelines using TypeScript/Node.js and Python. GCP services including BigQuery, Cloud Storage, Dataflow, and Pub/Sub. Experience integrating REST APIs with OAuth 2.0, pagination, error handling and retry mechanisms. Advanced SQL skills and experience with complex data warehouse schemas. Data transformation logic and data quality validations. Pipeline monitoring, alerting, failure recovery, and operational support. Experience with CI/CD workflows and established architectures.Skills
Sign in to read and join the discussion.