Senior engineer who builds and maintains large-scale web-scraping pipelines extracting millions of Instagram, TikTok, YouTube, and X records daily for a social media data lab, including anti-bot evasion and monitoring. Core stack: Python or Go, Playwright/Scrapy, distributed queues (Temporal, Kafka, Ray), and data lake storage (Parquet, Iceberg, Snowflake, S3).
Sign in to see your match