The Arvados community is dedicated to building a new generation of open source distributed computing software for bioinformatics, data science, and production analysis using massive data sets.
The Arvados core is a platform for production data science with very large data sets. It is made up of two major systems and a number of related services and components including APIs, SDKs, and visual tools.
Keep is a content-addressable storage system for managing and storing large collections of files with durable, cryptographically verifiable references and high-throughput processing. Keep works on a wide range of underyling file systems. Learn More >
Is a containerized workflow engine for running complex, multi-part pipelines or workflows in a way that is flexible, scalable, and supports versioning, reproducibilty, and provenance. Crunch runs in virtualized computing environments.
One important application of the Arvados core platform is for managing and processing next generation sequencing data. As part of that effort there are several genomic specific projects.
Lightning is a system to enable real-time queries and machine learning with very large populations of human genomic data.
Tapestry and GET-Evidence are web applications for managing open science research studies especially focused on the collection of genomic data. These apps are used by personal genome project studies around the world.
The Arvados community is collaborating closely with several standards efforts.
The goal of the CWL project is to create specifications that enable data scientists to describe analysis tools and workflows that are powerful, easy to use, portable, and support reproducibility.
The Global Alliance for Genomics and Health (GA4GH) is a global standards body defining data formats and APIs for precision medicine.