Alex Sczyrba talk on “Critical Assessment of Metagenome Interpretation” Tue 1 PM GBSF 4202

Special Seminar

Tuesday May 3, 2016

GBSF 4202


Critical Assessment of Metagenome Interpretation (CAMI) 

Alex Sczyrba

Head of Bielefeld University Bioinformatics Services

University of Bielefeld, Germany

The interpretation of metagenomes relies on sophisticated computational approaches such as short read assembly, binning and taxonomic classification. All subsequent analyses can only be as meaningful as the outcome of these initial data processing methods. Tremendous progress has been achieved during the last years. However, none of these approaches can completely recover the complex information encoded in metagenomes. Simplifying assumptions are needed and lead to strong limitations and potential inaccuracies in their practical use.

The accuracy of computational methods in metagenomics has so far been evaluated in publications presenting novel or improved methods. However, these snapshots are hardly comparable due to the lack of a general standard for the assessment of computational methods in metagenomics. Users are thus not well informed about general and specific limitations of computational methods. This may result in misinterpretations of computational predictions. Furthermore, method developers need to individually evaluate existing approaches in order to come up with ideas and concepts for improvements and new algorithms. This consumes substantial time and computational resources, and may introduce unintended biases.

We suggest tackling this problem by a new initiative, aiming at the “Critical Assessment of Metagenome Interpretation” (CAMI). It aims at evaluating methods in metagenomics independently, comprehensively and without bias. The initiative should supply users with exhaustive quantitative data about the performance of methods in all relevant scenarios. It will therefore guide users in the selection and application of methods and in their proper interpretation. Furthermore, it will provide valuable information to developers, allowing them to identify promising directions for their future work. In the talk I will present the current status of the evaluation of the results of the first CAMI challenge, which took place in 2015.


Hosts: Jonathan Eisen and Matthias Hess

This entry was posted in Misc. and tagged by Jonathan Eisen. Bookmark the permalink.

About Jonathan Eisen

I am an evolutionary biologist and a Professor at U. C. Davis. (see my lab site here). My research focuses on the origin of novelty (how new processes and functions originate). To study this I focus on sequencing and analyzing genomes of organisms, especially microbes and using phylogenomic analysis

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s