Home Ravel Open Sources GoldenOrb, Big Data Graph Processing for Everyone

Ravel Open Sources GoldenOrb, Big Data Graph Processing for Everyone

Traditional databases, even when they’re called “relational databases,” tend not handle relationships very well, and the traditional way of processing data – particularly large-scale datasets – can actually mean that some of the relationships between objects are lost or obscured.

Several years ago, Google began encountering these sorts of problems with relational data, particularly as this graph data didn’t really fit into its Map Reduce system for big data processing. So Google developed a product called Pregel, which solved the relational data problem and allowed it to be processed on a massive scale.

While Pregel remains an in-house technology for Google, the data startup Ravel is releasing its Pregel-like, large-scale graph processing technology today.

GoldenOrb, which Ravel is also open sourcing (GitHub link), will solve some of the same types of problems as Pregel, but can be applied to many other areas beyond network analysis and social graph analysis, such as epidemiology and mathematics.

But most importantly, says Zach Richardson, the lead architect of the GoldenOrb project and the CTO of Ravel, it makes the programming that developers have to do far simpler. Rather than worrying about how they can get it to run about thousands of machines, “they can just focus on the algorithm for solving their particular problem.” According to Richardson, this means that large scale data problems are now solvable even by startups.

Richardson says that Ravel opted to open source the technology so that others could work on writing algorithms and solve various problems that, in turn, Ravel hopes to be able to learn from as well. The company has no immediate plans to offer commercial support around GoldenOrb.

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech industry for major developments, new product launches, AI breakthroughs, video game releases and other newsworthy events. Editors assign relevant stories to staff writers or freelance contributors with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.