Service discovery at scale using SmartStack

John Billings

Containers - Tuesday, 2/2/2016 11:00 B1.015

"At Yelp we’ve moved to a Service Oriented Architecture in order to scale our development process, and we’re now running over 70 production services across thousands of machines in multiple datacenters. One key piece of infrastructure that has enabled this transition is SmartStack, a service discovery system built by Airbnb that uses Apache ZooKeeper and HAProxy. In this talk we introduce the general concept of service discovery and describe the set of requirements that led us to choosing a service discovery system based upon Apache ZooKeeper and HAProxy. We then discuss specific challenges and features of our service discovery system that should be relevant to anyone interested in building or running a large-scale service discovery system."

About John Billings

For the past five years, John has worked on backend systems at Yelp in a variety of lead roles, ranging from re-architecting the search sharding model to replacing the main job queuing system. Prior to this, John received his PhD in Computer Science at the University of Cambridge, where he researched the specification and compilation of internet routing protocols.