Home Video: How Twitter Scales with Scala

Video: How Twitter Scales with Scala

Last week we told you about how Twitter is migrating its search stack from Ruby to Java. But Twitter is also known for being an early adopter of Scala. This presentation by Marius Eriksen at the Commercial Users of Funtional Programming 2010 conference explains how Twitter uses Scala to scale.

Scaling Scala at Twitter by Marius Eriksen (Twitter) from Scott Smith on Vimeo.

A few of the things Twitter uses Scala for:

  • Social adjacency store (FlockDB)
  • Namesearch
  • “Who to Follow”
  • Kestrel/queueing
  • Streaming API
  • Storage systems
  • Geo

Eriksen mostly focuses on the geospatial applications powered by Scala at Twitter. Eriksen and another engineer built Rockdev, Twitter’s geospatial backend, without any previous experience in Scala or the Java Virtual Machine.

Eriksen also talks about the role distributed databases, Apache Cassandra in particular, fit into the team’s scalability projects.

See also: How Twitter Uses NoSQL.

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the gambling and blockchain industries for major developments, new product and brand launches, game releases and other newsworthy events. Editors assign relevant stories to in-house staff writers with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.