Home Twitter Introduces Gizzard Distributed Datastore Framework

Twitter Introduces Gizzard Distributed Datastore Framework

“Many modern web sites need fast access to an amount of information so large that it cannot be efficiently stored on a single computer,” Nick Kallen wrote on Twitter’s blog. “A good way to deal with this problem is to ‘shard’ that information; that is, store it across multiple computers instead of on just one.

As an alternative to sharding, Twitter has developed a framework that can be used in lieu of either custom-building data-store systems or using untested open-source alternatives and is sharing the code with the public.

From a number of data-store building experiences, Twitter has “extracted Gizzard, a Scala framework that makes it easy to create custom fault-tolerant, distributed databases.”

As an example, Kallen provides “Rowz.”

“To get up-and-running with Gizzard quickly, clone Rowz and start customizing!”

The full code for Gizzard is also available.

He describes Gizzard as a middleware networking service that handles partitioning through a forwarding table, supports migration and prosecutes “eventual consistency.”

The implication of this may be that startups and smaller companies may better be able to deal with large amounts of data quickly, and thereby better serve the needs their users with fewer resources expended.

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech industry for major developments, new product launches, AI breakthroughs, video game releases and other newsworthy events. Editors assign relevant stories to staff writers or freelance contributors with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.