Conveyor
Conveyor is a workflow engine which uses a novel approach for defining and deploying of analytical workflows. It is based on a full generic object-oriented data model, and allows a datadriven, interface based design of workflows. The engine is extensible by plugins, allowing almost any functionality to be included in a workflow.
Conveyor: a workflow engine for bioinformatic analyses
The rapidly increasing amounts of data available from new high-throughput methods have made data processing without automated pipelines infeasible. As was pointed out in several publications, integration of data and analytic resources into workflow systems provides a solution to this problem, simplifying the task of data analysis. Various applications for defining and running workflows in the field of bioinformatics have been proposed and published, e. g. Galaxy, Mobyle, Taverna, Pegasus or Kepler. One of the main aims of such workflow systems is to enable scientists to focus on analyzing their data sets instead of taking care for data management, job management or monitoring the execution of computational tasks. The currently available workflow systems achieve this goal, but fundamentally differ in their way of executing workflows. We have developed the Conveyor software library, a multitiered generic workflow engine for composition, execution and monitoring of complex workflows. It features an open, extensible system architecture and concurrent program execution to exploit resources available on modern multicore CPU hardware. It offers the ability to build complex workflows with branches, loops and other control structures. Two example use cases illustrate the application of the versatile Conveyor engine to common bioinformatics problems.
Details about Conveyor can be found in the corresponding publication:
Linke B, Giegerich R, Goesmann AConveyor: a workflow engine for bioinformatic analyses. (2011)
Bioinformatics (Oxford, England) 27(7): 903-11
DOI | PubMed | Europe PMC