Welcome to the Arvados Project

The Arvados community is dedicated to building a new generation of open source distributed computing software for bioinformatics, data science, and production analysis using massive data sets.

Arvados Core Platform

The Arvados core is a platform for production data science with very large data sets. It is made up of two major systems and a number of related services and components including APIs, SDKs, and visual tools.

Keep

Keep is a content-addressable storage system for managing and storing large collections of files with durable, cryptographically verifiable references and high-throughput processing. Keep works on a wide range of underyling file systems. Learn More >

Crunch

Is a containerized workflow engine for running complex, multi-part pipelines or workflows in a way that is flexible, scalable, and supports versioning, reproducibilty, and provenance. Crunch runs in virtualized computing environments.

  • Arvados Workbench
  • Command Line Interface
  • Tools & Pipelines
  • 3rd Party Web Apps
Interfaces
  • SDKs
  • API & Access Control
Core Services
Elastic Computing Foundation

Genomics Projects

One important application of the Arvados core platform is for managing and processing next generation sequencing data. As part of that effort there are several genomic specific projects.

Lightning

Lightning is a system to enable real-time queries and machine learning with very large populations of human genomic data.

Tapestry & GET-Evidence

Tapestry and GET-Evidence are web applications for managing open science research studies especially focused on the collection of genomic data. These apps are used by personal genome project studies around the world.

Standards Efforts

The Arvados community is collaborating closely with several standards efforts.

Common Workflow Language

The goal of the CWL project is to create specifications that enable data scientists to describe analysis tools and workflows that are powerful, easy to use, portable, and support reproducibility.

Global Alliance

The Global Alliance for Genomics and Health (GA4GH) is a global standards body defining data formats and APIs for precision medicine.