Staff Data Engineer - Large-Scale Social Crawler
Summary
Build and operate a large-scale social media crawler's data pipelines: write SQL/Scala, optimize pipelines, monitor system health, and work with the data quality team to ensure timely data delivery. Core stack includes Kafka, Redis, Elasticsearch, and relational databases.
nolimit is building a robust, large-scale social media crawler and maintaining daily operations with the data quality team to ensure timely data delivery. The role requires strong SQL, Scala experience, and familiarity with distributed data technologies like Kafka, Redis, Elasticsearch, and relational databases.
Fresh graduates welcome; work with cross-functional stakeholders to clarify data requirements. You will optimize data pipelines, monitor system health, and contribute to scalable