Lead Data Engineer
Summary
Lead a team to design and build scalable data pipelines and distributed platforms using Python, PostgreSQL, Spark, Kafka, and vector databases.
Salary: £80,000 - 115,000 per year Requirements: 7 years of experience in Data Engineering or Backend Engineering. Strong Python development experience. Experience building distributed data platforms and scalable pipelines. Excellent knowledge of PostgreSQL or similar relational databases and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector. Familiarity with Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars. Strong understanding of dat…