Ahrefs

About

Ahrefs runs an internet-scale bot that crawls the whole web 24/7, storing huge volumes of information to be indexed and structured in a timely fashion. Our backend system is powered by a custom petabyte-scale distributed key-value storage to accommodate all that data coming in at high speed. With this data, Ahrefs builds analytics services for end-users in the Search Engine Optimization (SEO) space and a web-scale search platform. We are a lean and robust team who strongly believe that better technology leads to better solutions for real-world problems. We are a small team that strongly believes that better technology leads to better solutions for real-world problems. We worship functional languages and static typing, extensively employ code generation and meta-programming, value code clarity and predictability, and constantly seek to automate repetitive tasks and eliminate boilerplate. We are guided by DRY and follow KISS. If there is new technology that will make our life easier, we'll give it a try. We rely heavily on open-source code (as the only viable way to build maintainable system) and contribute back, see e.g. https://github.com/ahrefs Our motto is first do it, then do it right, then do it better.