Python Developer
Posted Updated
Summary
Builds and maintains Python web-scraping solutions for US county property appraiser sites (handling CAPTCHAs, proxies, dynamic content) and end-to-end ETL/ELT pipelines that transform, map, and load property data into PostgreSQL. Core stack: Python (Beautiful Soup, Scrapy, Selenium/Playwright), SQL, and automation workflows.
Key Responsibilities:
• Develop and maintain robust web scraping solutions to extract structured and unstructured data from:
o US county property appraiser/assessor websiteso Public records and property-related data sources
• Handle complex scraping challenges such as:
o CAPTCHA, session handling, rate limiting, dynamic content (JavaScript-heavy sites)
• Design and build end-to-end data pipelines:
o Data extraction → transformation → mapping → loading (ETL/ELT)
• Perform data transformation and attribute mapping to align with internal data models
• Develop automated workflows/applications for:
o Periodic database updateso Data refresh and validationo Ad-hoc data extraction requirements
• Write and optimize SQL/PostgreSQL queries for:
o Data ingestiono Data updates and maintenance
• Ensure data quality, consistency, and integrity across datasets
• Collaborate with analytics, GIS, and business teams to support data-driven use cases
Requirements
Required Skills & Experience:
• 2–3 years of hands-on experience in Python development
• Strong expertise in web scraping using Python libraries, such as:
o Beautiful Soup, Scrapy, Selenium / Playwright
• Experience handling anti-scraping mechanisms (CAPTCHA, headers, proxies, etc.)
• Solid experience with PostgreSQL / SQL:
o Writing complex querieso Database updates, joins, indexing, performance tuning
• Proven experience in building data pipelines (ETL/ELT)
• Strong understanding of data structures and large dataset handling
• Experience in automation scripting and workflow development
• Good understanding of data transformation and mapping techniques
• Strong problem-solving ability and attention to detail
Good to Have (Preferred Skills):
• Experience with geospatial data / GIS tools:
o GeoPandas, PostGIS, QGIS, Shapely
• Exposure to US Property & Casualty Insurance domain
• Understanding of property-level datasets and attributes
• Experience with data validation frameworks and logging/monitoring
• Familiarity with data visualisation or analytical tools
Soft Skills (Mandatory):
• Strong written and verbal communication skills
• Ability to clearly explain technical concepts to non-technical stakeholders
• Ability to work independently and in cross-functional global teams
Benefits
•Be part of a growing technology-first organization transforming the insurance industry.
•Enjoy a 5-day work week, a modern work environment, and cross-functional collaboration.
•Competitive salary and performance-driven career growth.
•Opportunity to work on challenging problems with cutting-edge tools and technologies