Data Engineer
Posted Updated
Summary
Data engineer building and maintaining ETL pipelines and data architecture for large-scale real estate data, including IP proxy rotation, automated ingestion, and data quality monitoring, while supporting the EdgeProp AI team's NLP initiatives. Core stack: SQL, MongoDB, Elasticsearch, Python; AWS, Linux, and Airflow are advantages.
Responsibilities:
- Develop and optimize data pipelines and architecture for cross-functional teams
- Design and maintain robust ETL pipelines to ingest large-scale real estate data
- Manage external data acquisition systems including IP proxy rotation and automated ingestion workflows
- Ensure data accuracy and integrity through automated monitoring processes
- Support the EdgeProp AI team in implementing technical solutions and NLP initiatives
- Collaborate with Product and Engineering teams to architect data solutions
- Solve daily operational data problems to ensure consistent delivery across projects
Requirements:
- BS/MS in Computer Science or a related technical field.
- Minimum 3-5 years of professional data engineering experience
- Hands-on experience with SQL, Relational databases, MongoDB, and Elastic Search
- Proficient in Python for data processing
- Experience managing IP proxy rotation and automated data ingestion
- Experience with AWS, Linux Server and Apache Airflow is an advantage
- Strong communication skills in English and a "can-do" attitude