Data Engineer
Posted Updated
Duties and Responsibilities
Data Infrastructure & Pipeline Engineering
● Design, build, and operate scalable data pipelines across Salesforce, Snowflake, and external systems (ticketing, lottery, partners)
● Leverage Fivetran and API-based ingestion frameworks to standardize and automate data ingestion from third-party platforms
● Own API, webhook and file-based ingestion systems (SFTP, third-party feeds), ensuring reliability and observability
● Manage AWS infrastructure supporting data ingestion, processing, and orchestration
Data Warehouse & Modeling
● Own Snowflake data architecture, including schema design, transformations, and data modeling
● Develop and maintain transformation layers using dbt, including modular, testable, and well-documented models
● Build canonical datasets and dimensional models supporting analytics, CRM, ticketing, and pricing
● Optimize warehouse performance, cost, and scalability through clustering, partitioning, and query optimization
● Manage schema evolution and deprecation of legacy data structures
Data Quality, Governance & Reliability
● Establish data quality frameworks using dbt tests, monitoring tools, and pipeline validation checks to detect and resolve inconsistencies, duplication, and missing data
● Implement automated validation, monitoring, and alerting across pipelines
● Own data hygiene standards across customer, order, and transaction datasets
Automation & Systems Optimization
● Develop Python-based workflows to automate ingestion, transformation, and operational processes
● Reduce manual workflows through system design, tooling, and pipeline reliability improvements
● Leverage HighTouch to operationalize data by syncing curated datasets back into Salesforce and other business systems
● Partner with third-party developers to maintain ticket lottery systems
● Continuously improve pipeline performance, latency, and failure recovery
Reporting & Data Enablement
● Build and maintain data pipelines supporting core reporting (sales, marketing performance, partner reporting)
● Enable downstream analytics and BI through clean, accessible, and well-modeled datasets
Dynamic Pricing Data Infrastructure & Modeling Support
● Own the data infrastructure supporting dynamic pricing models
● Design and maintain model-ready datasets across pricing, inventory, and demand signals using Snowflake and dbt
● Partner with internal teams and external consultants to operationalize pricing models within Snowflake
● Enable rapid iteration, backtesting, and deployment of pricing strategies