Data Engineer (Hadoop / Postgres / SQL)

We're creating a SaaS platform that interprets complex data and tells stories about customer passions and behaviour and we're looking for a Data Engineer to push boundaries with what is possible with our data; to design, develop and and automate a data pipeline that will collect data from numerous transactional, social media and geographical data sets as we build the next generation of our product.

- Applying systems architecture and software design skills in the development of data pipelines

- Design and develop new algorithms for extracting insight from social data

- Develop crawlers to extract data from the web or APIs

- Develop infrastructure around existing internal tools to enhance capabilities and improve data flow.

- Implement statistical models and algorithms including clustering on large scale graph data

Some of the skills and technologies you'll need experience of:

Hadoop, PostgreSQL, Spark, SQL, Pig, Python, Pyspark

We work in an open plan office right in the heart of Oxford Circus. We have a fun social culture with regular showcase (lunch and learn) sessions and after-hours social functions, all adding up to a balanced work-life environment with a 4pm finish on Fridays!