An open API service indexing awesome lists of open source software.

https://github.com/ctlab/metafast

Fast metagenome analysis toolkit
https://github.com/ctlab/metafast

Last synced: 8 months ago
JSON representation

Fast metagenome analysis toolkit

Awesome Lists containing this project

README

          

![Build](https://github.com/ctlab/metafast/actions/workflows/ant.yml/badge.svg)

# MetaFast

MetaFast

**MetaFast** (METAgenome FAST analysis toolkit) is a toolkit for calculating a number of statistics of
metagenome sequences and building the distance matrix between them. It also provides a functionality
to extract features from metagenomic samples.

Authors:
* **Software:** *Artem Ivanov*, *Sergey Kazakov* and [*Vladimir Ulyantsev*](https://ulyantsev.com),

[ITMO University](http://en.itmo.ru/en/), Saint-Petersburg, Russia.
* **Testing:** *Veronika Dubinkina* and *Alexandr Tyakht*,

SRI of Physical-Chemical Medicine, Moscow, Russia.
* **Idea, supervisor:** *Dmitry Alexeev*,

SRI of Physical-Chemical Medicine, Moscow, Russia.

**MetaFast** documentation is available on the GitHub [wiki page](https://github.com/ctlab/metafast/wiki).

Here is a short version of it.

## Content

* [Installation](#installation)
* [MetaFast 1.3](#metafast-13)
* [Running instructions](#running-instructions)
* [Examples](#examples)
* [FAQ](#faq)
* [Citation](#citation)
* [Contact](#contact)
* [License](#license)
* [Publications using MetaFast](#publications-using-metafast)
* [See also](#see-also)

## Installation

To run MetaFast you need to have JRE 1.6 or higher installed and only one script – `metafast.sh`, `metafast.bat` or `metafast.jar`.

You can download it from the last stable release in the GitHub ['Releases' section](https://github.com/ctlab/metafast/releases).

* For *Linux* and *Mac OS*: download `metafast.sh`, run the command `chmod a+x metafast.sh`, then run `./metafast.sh` from the command line.
* For *Windows*: download `metafast.bat` and run it from the command line.
* For other OS: download `metafast.jar` and run it via command `java -jar metafast.jar`.

Alternatively, you can build the newest version of the MetaFast from the repository:
~~~
git clone https://github.com/ctlab/metafast.git
cd metafast
ant
./out/metafast.sh --version
~~~

## MetaFast 1.3

A new version of MetaFast software is being prepared for the release. New pipelines for comparative metagenomics data analysis have been implemented. Four recommended use cases (including the original one) and a detailed description of available tools are presented in [Pipelines.md](Pipelines.md)

## Running instructions

To run MetaFast use the following syntax:
* `metafast.sh [] []`
* `metafast.bat [] []`
* `java -jar metafast.jar [] []`

To view help for launch options and input parameters run `metafast.sh --help` or `metafast.sh --help-all`.

By running MetaFast a working directory is created (by default `./workDir/`).
All intermidiate files, log file and final results are saved in it.

File `output_description.txt` is created after every run in the current and working directories.
It contains the description of every output file produced by the MetaFast.

Metafast run script also allows you to run subtools of whole process or different tools, that was included into the package.
To see the list of available additional tools, run `metafast.sh --tools`.

## Examples

#### Generated _in-silico_ dataset

Download [meta_test_1.fa](https://github.com/ctlab/metafast/raw/master/test_data/meta_test_1.fa),
[meta_test_2.fa](https://github.com/ctlab/metafast/raw/master/test_data/meta_test_2.fa) and
[meta_test_3.fa](https://github.com/ctlab/metafast/raw/master/test_data/meta_test_3.fa) and run the command:
~~~
./metafast.sh -i meta_test_1.fa meta_test_2.fa meta_test_3.fa
~~~

After it has finished, a distance matrix can be found in `workDir/matrices/dist_matrix__

The element `matrix[i][j]` is a distance between *sample i* and *sample j*.

K-mers frequency statistics is saved in `workDir/kmer-counter-many/stats/.stat.txt`;

image file with heatmap and dendrogram is saved in `workDir/matrices/dist_matrix__

#### Mock community example

For testing on realistic metagenomic communities, the CAMI Challenge dataset was used. The detailed example description is available in file [Example.md](Example.md).

## FAQ

**Q** Does MetaFast works with paired-end reads?

**A** Yes, MetaFast can process paired-end reads. For correct detection, files should be named with suffixes "_R1"&"_R2" or "_r1"&"_r2" after sample name before extension. For example, sample_r1.fastq & sample_r2.fastq, or reads_R1.fq.gz & reads_R2.fq.gz

**Q** Can I compare samples with different read lengths or the number of reads?

**A** Yes, you can do this without any specific preprocessing. MetaFast uses k-mers for comparing metagenomic sequences, so it will automatically normalize all values by the total number of k-mers per sample.

**Q** Can I compare metagenomes obtained from different sequencing platforms (i.e. Illumina vs 454-seq)

**A** Yes, you can. MetaFast extract features from each metagenome independently, so you can compare samples from different sequencing platforms.

## Citation

If you use MetaFast in your research, please cite the following publication:

Ulyantsev V.I., Kazakov S.V., Dubinkina V.B., Tyakht A.V. & Alexeev D.G. (2016).
MetaFast: fast reference-free graph-based comparison of shotgun metagenomic data.
Bioinformatics, 32(18), 2760-2767.
[doi: 10.1093/bioinformatics/btw312](https://academic.oup.com/bioinformatics/article/32/18/2760/1743520)

## Contact

Please report any problems directly to the GitHub [issue tracker](https://github.com/ctlab/metafast/issues).

Also, you can send your feedback to [abivanov@itmo.ru](mailto:abivanov@itmo.ru).

## License

The MIT License (MIT)

## Publications using MetaFast

There are several papers about bioinformatics projects, which used various MetaFast pipelines for data analysis:

* Analysis of human gut microbiota of patients with Crohn's disease, ulcerative colitis and healthy controls

Khachatryan, L., Xiang, Y., Ivanov, A., Glaab, E., Graham, G., Granata, I., ... & Poussin, C. (2023). Results and lessons learned from the sbv IMPROVER metagenomics diagnostics for inflammatory bowel disease challenge. Scientific Reports, 13(1), [doi: 10.1038/s41598-023-33050-0](https://doi.org/10.1038/s41598-023-33050-0)
* Analysis of human gut microbiota of patients undergoing melanoma immunotherapy

Olekhnovich, E. I., Ivanov, A. B., Babkina, A. A., Sokolov, A. A., Ulyantsev, V. I., Fedorov, D. E., & Ilina, E. N. (2023). Consistent Stool Metagenomic Biomarkers Associated with the Response To Melanoma Immunotherapy. Msystems, 8(2), e01023-22. [doi: 10.1128/msystems.01023-22](https://doi.org/10.1128/msystems.01023-22)
* Analysis of gut microbiota time-series samples from patients undergoing microbiome transplantation
Olekhnovich, E. I., Ivanov, A. B., Ulyantsev, V. I., & Ilina, E. N. (2021). Separation of donor and recipient microbial diversity allows determination of taxonomic and functional features of gut microbiota restructuring following fecal transplantation. Msystems, 6(4), e00811-21. [doi: 10.1128/msystems.00811-21](https://doi.org/10.1128/msystems.00811-21)

## See also

* [MetaCherchant](https://github.com/ctlab/metacherchant) – a tool for analysing genomic environment within a metagenome.
* [RECAST](https://github.com/ctlab/recast) – a tool for sorting reads per their origin in metagenomic time series.
* [khmer](https://github.com/ged-lab/khmer) – a toolkit to split reads.
* [crAss](http://edwards.sdsu.edu/crass/) – Cross-Assembly of Metagenomes.
* [MaryGold](http://sourceforge.net/projects/metavar/) – Variation analysis of metagenomic samples.