Senior Webscraping & Data Engineer

Role Overview

We are looking for an experienced Senior Webscraping & Data Engineer to build scalable systems for collecting data from diverse online sources.

The role focuses on reliable, high-performance webscraping and transforming public, unstructured information into datasets for research and investment teams. You will work with scraping, APIs, data processing, automation and AI-driven solutions.

• 6+ years of experience in software or data engineering.
• Strong experience with web scraping, crawling and automated data collection.
• Excellent Python skills, including pandas.
• Strong SQL and database knowledge.
• Good understanding of HTML, JavaScript, APIs and web technologies.
• Knowledge of networking concepts related to web data collection.
• Experience building data pipelines.
• Understanding of algorithms, data structures and data quality.
• Experience with large-scale or distributed data collection.
• Strong troubleshooting and problem-solving skills.
• Interest in AI/LLMs and agentic technologies.
• Strong communication and collaboration skills.

Nice to Have

• Experience with alternative data in finance or research.
• Background in data-intensive organizations.
• Experience building tools for researchers, analysts, quants or data scientists.
• Knowledge of Airflow, Kafka, Docker or Kubernetes.
• Experience with AWS or other cloud platforms.
• Familiarity with LLM tools, MCPs, agents or autonomous workflows.
• Experience with audio/video data.
• Knowledge of statistics and data analysis.