Data Platform Engineer

• Build and maintain reliable web/app crawlers, scrapers, and external API integrations across e-commerce, marketplace, retail, and other external sources.
• Build acquisition systems that remain reliable as external websites, applications, APIs, and data contracts evolve.
• Handle real-world source complexity such as sessions, tokens, pagination, dynamic content, rate limits, retries, concurrency, and partial failures.
• Build resilient and maintainable acquisition systems with appropriate testing, idempotency, deduplication, retries, safe reruns, data-quality validation, monitoring, and alerting.
• Operate acquisition workloads using appropriate workflow orchestration, compute, data storage/warehousing, and cloud infrastructure.
• Continuously improve reliability, scalability, maintainability, and total cost of ownership, including evaluating build-vs-buy approaches for external data.
• Explore new technologies and AI-assisted development or automation to improve how external-data pipelines are built, operated, and maintained.
• Collaborate with Pricing, Data Warehouse Engineering, Data Analysts, and other stakeholders to turn external-data needs into sustainable platform capabilities.

Job Requirements:

• Strong Python/software engineering fundamentals and experience building maintainable production systems.
• Hands-on experience building or operating web scraping, crawling, external API, or similar data acquisition systems.
• Understanding of production reliability patterns such as retry, timeout, rate limiting, concurrency, idempotency, and failure recovery.
• Solid understanding of SQL, data storage/warehousing, schema evolution, workflow orchestration, containerized workloads, and cloud infrastructure fundamentals.
• Strong troubleshooting skills, especially when working with frequently changing external systems outside your direct control.