Critical Assessment of Metagenome Interpretation

Welcome to CAMI - Critical Assessment of Metagenome Interpretation

CAMI brings together the metagenomics research community to facilitate the benchmarking of metagenomic computational methods, promote standards and good practices, and further accelerate advancements in this rapidly evolving field of bioinformatics.

*New*

CAMI III Challenges are now open: participate and submit your results

CAMI
CAMI III announcements

CAMI III Challenges are now open

July 14, 2026. CAMI III Challenges start today! Read more...

CAMI III launches with release of a new pre-challenge benchmark dataset

Mar 19, 2026. CAMI III launches with the release of a new pre-challenge benchmark dataset, named CAMI III Toy Longitudinal Human Gut, prior to the opening of the challenges. Read more...

News

CAMI Benchmarking Portal paper published in NAR!

May 7, 2025. Read the open-access publication in Nucleic Acids Research: https://doi.org/10.1093/nar/gkaf369

New CAMI benchmarking portal launched!

Dec 5, 2024. We are excited to announce the launch of the new CAMI portal. Read more…

Stats
Summary
# Datasets 14 # Total results 40213
# Samples 582 # Methods 115
Per category Assembly Genome binning Taxonomic binning Taxonomic profiling
# Results 96 446 5885 33786
# Methods 26 39 18 40
How to cite

If you use the CAMI benchmarking service, datasets, or results in your work, please consider citing:

  • Meyer, F., Fritz, A., Deng, ZL. et al. Critical Assessment of Metagenome Interpretation: the second round of challenges. Nat Methods 19, 429–440 (2022). DOI: 10.1038/s41592-022-01431-4
  • Sczyrba, A., Hofmann, P., Belmann, P. et al. Critical Assessment of Metagenome Interpretation—a benchmark of metagenomics software. Nat Methods 14, 1063–1071 (2017). DOI: 10.1038/nmeth.4458

CAMI follows the principles described in:

  • Meyer, F., Lesker, TR., Koslicki, D. et al. Tutorial: assessing metagenomics software with the CAMI benchmarking toolkit. Nat Protoc 16, 1785–1801 (2021). DOI: 10.1038/s41596-020-00480-3

To assess assembly, genome and taxon binning, and taxonomic profiling, this service uses the following software:

  • Mikheenko, A., Saveliev, V. & Gurevich, A. MetaQUAST: evaluation of metagenome assemblies. Bioinformatics 32, 1088–1090 (2016). DOI: 10.1093/bioinformatics/btv697
  • Meyer, F. et al. AMBER: assessment of metagenome BinnERs. Gigascience 7, giy069 (2018). DOI: 10.1093/gigascience/giy069
  • Meyer, F. et al. Assessing taxonomic metagenome profilers with OPAL. Genome Biol. 20, 51 (2019). DOI: 10.1186/s13059-019-1646-y

For datasets, please refer to the DOIs on the datasets page.

Funding

The CAMI benchmarking portal is funded by

NFDI4Microbiota
Helmholtz Centre for Infection Research