Python Developer
Summary
Builds automated scrapers and an AI-powered match engine to extract IT hardware inventory from auction sites and pair it with incoming RFQs using Python, Playwright/Selenium, and PostgreSQL/MongoDB.
Python Automation Engineer:
Auction Site Scraper & AI RFQ Match Engine
Job Description:
We are seeking a talented Python developer to build a specialized, automated pipeline that scrapes secondary-market auction sites for enterprise IT hardware and automatically matches available inventory against incoming RFQ (Request for Quote) demands.
Core Responsibilities:
- Targeted Scraping: Build resilient, asynchronous scrapers (using Playwright or Selenium) capable of extracting inventory data (titles, part numbers, pricing, quantities) from dynamic auction and liquidator portals.
- Anti-Bot Circumvention: Implement stealth browser techniques, premium residential proxy rotation, and captcha-handling to ensure continuous data extraction without getting blocked.
- Unstructured Data Ingestion (RFQs): Build a script (utilizing Regex, fuzzy matching, or LLM-based parsing like OpenAI API/Instructor) to parse messy, unstructured RFQ texts, emails, or spreadsheets into clean hardware variables.
- Match Engine Logic: Develop a backend script (PostgreSQL/MongoDB) that automatically matches the extracted RFQ requirements (Manufacturer Part Numbers, quantities, target pricing) against the scraped auction data, flagging high-margin opportunities.
Required Technical Skills:
- Languages: Python (Advanced)
- Scraping Frameworks: Playwright, Selenium, or Scrapy
- Proxy/Stealth Integration: Experience with Bright Data, ScrapingBee, or similar proxy rotators, and stealth plugins (undetected-chromedriver).
- Data Parsing: Experience with pandas, JSON handling, and structural data extraction via LLMs or NLP.
- Databases: PostgreSQL (experience with pgvector or fuzzy string matching is a major plus) or MongoDB.