Data Engineer

Medcare MSO is one of the largest USA-based Healthcare IT organizations in Pakistan, with 950+ professionals on board. We leverage cutting-edge technologies and engineering best practices to build innovative AI-driven healthcare solutions.

As a Data Engineer, you will be responsible for designing and developing scalable data extraction, web scraping, browser automation, and data ingestion solutions that power our AI and analytics platforms. You will work closely with AI, Machine Learning, and Product teams to acquire, process, and transform data from web sources, APIs, desktop applications, and other structured and unstructured sources. The role requires strong hands-on expertise in Python, web automation, and data engineering, along with the ability to build reliable, production-grade automation solutions that support business-critical AI initiatives.

Position: Data Engineer

Shift Timing: 02:00pm-11:00pm

Location: MMalam, Lahore

Key Responsibilities

• Build, maintain, and optimize scalable data pipelines for ingesting, transforming, and loading data from multiple structured and unstructured sources
• Design, develop, and maintain robust web scraping solutions using Python-based frameworks such as Scrapy, Beautiful Soup, Selenium, and Playwright
• Develop reliable browser automation workflows, including handling anti-bot protection mechanisms such as proxy rotation, CAPTCHA handling, session management, and browser fingerprinting
• Build and maintain desktop application automation and data extraction workflows using UiPath, Automation Anywhere, or Power Automate Desktop
• Develop efficient Python scripts and SQL queries for large-scale data processing, transformation, and validation
• Build and optimize ETL/ELT workflows to ensure high-quality, consistent, and reliable datasets
• Extract structured data from scanned or legacy documents using OCR technologies such as Tesseract or ABBYY where applicable
• Integrate data from REST APIs and other external data sources into automated ingestion pipelines
• Collaborate with ML Engineers to prepare clean, feature-ready datasets for model training and inference
• Develop and maintain browser-based automation solutions, including Chrome Extensions where required
• Implement data validation, quality checks, monitoring, and logging to ensure pipeline reliability and data integrity
• Maintain and optimize data storage solutions, including relational databases, data warehouses, and data lake architectures
• Contribute to data modeling, schema design, and standardization across multiple data source
• Support data versioning, lineage tracking, and reproducibility of datasets used across AI and analytics workflows
• Collaborate with cross-functional engineering teams to integrate pipelines with downstream applications, APIs, and AI systems

Qualifications

• Bachelor\'s degree in Computer Science, Data Engineering, Software Engineering, or a related field
• 2–4 years of hands-on experience in Data Engineering, Web Scraping, or Automation Engineering
• Strong proficiency in Python and SQL
• Hands-on experience with Scrapy, Beautiful Soup, Selenium, and Playwright
• Experience handling anti-bot techniques such as proxy rotation, CAPTCHA, and browser automation
• Hands-on experience with UiPath, Automation Anywhere, or Power Automate Desktop
• Strong understanding of HTML/CSS and selector-based web scraping
• Experience building ETL/ELT pipelines and working with REST APIs
• Experience with OCR tools (Tesseract or ABBYY) is a plus
• Experience with Chrome Extension development (Manifest V3) is a plus
• Exposure to Agentic AI/LLM automation frameworks (LangChain, AutoGen, browser-use agents) is a plus
• Experience with Apache Airflow or similar orchestration tools is a plus
• Strong analytical, problem-solving, and communication skills