The Genome Analysis Toolkit: A MapReduce framework for analyzing next-generation DNA sequencing data
Инструментарий анализа генома: фреймворк MapReduce для анализа данных секвенирования ДНК нового поколения
2010-07-19
SCID: 54.1/kzfv7bf3
Discuss with AI
1000 Genomes ProjectGenome Analysis Toolkit (GATK)MapReduce frameworknext-generation DNA sequencingsingle nucleotide polymorphism calling
Figures from the paper
Abstract (AI)
Next-generation DNA sequencing (NGS) projects, such as the 1000 Genomes Project, are already revolutionizing our understanding of genetic variation among individuals. However, the massive data sets generated by NGS--the 1000 Genome pilot alone includes nearly five terabases--make writing feature-rich, efficient, and robust analysis tools difficult for even computationally sophisticated individuals. Indeed, many professionals are limited in the scope and the ease with which they can answer scientific questions by the complexity of accessing and manipulating the data produced by these machines. Here, we discuss our Genome Analysis Toolkit (GATK), a structured programming framework designed to ease the development of efficient and robust analysis tools for next-generation DNA sequencers using the functional programming philosophy of MapReduce. The GATK provides a small but rich set of data access patterns that encompass the majority of analysis tool needs. Separating specific analysis calculations from common data management infrastructure enables us to optimize the GATK framework for correctness, stability, and CPU and memory efficiency and to enable distributed and shared memory parallelization. We highlight the capabilities of the GATK by describing the implementation and application of robust, scale-tolerant tools like coverage calculators and single nucleotide polymorphism (SNP) calling. We conclude that the GATK programming framework enables developers and analysts to quickly and easily write efficient and robust NGS tools, many of which have already been incorporated into large-scale sequencing projects like the 1000 Genomes Project and The Cancer Genome Atlas.
Key Findings
1
GATK provides a small, rich set of reusable data-access patterns covering most analysis-tool requirements while separating calculations from data-management infrastructure.
2
GATK tools have been incorporated into large-scale projects including the 1000 Genomes Project and The Cancer Genome Atlas.
3
The Genome Analysis Toolkit (GATK) is a MapReduce-based programming framework designed to simplify development of efficient, robust tools for next-generation sequencing data.
4
The framework enables robust, scale-tolerant implementations of applications including coverage calculation and single-nucleotide polymorphism calling.
5
This separation supports optimization for correctness, stability, CPU and memory efficiency, and distributed or shared-memory parallelization.
Research Object
Genome Analysis Toolkit (GATK) software framework for next-generation DNA sequencing data analysis
Research Subject
The framework’s efficiency, robustness, scalability, and parallelization for developing and applying NGS analysis tools
Publication Details
Publication Date
2010-07-19
Journal
Publisher
ISSN
Cited by
27809
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai1
Cited by20
Second-generation PLINK: rising to the challenge of larger and richer datasets2015
Pilon: An Integrated Tool for Comprehensive Microbial Variant Detection and Genome Assembly Improvement2014
Analysis of 100,000 human cancer genomes reveals the landscape of tumor mutational burden2017
ANGSD: Analysis of Next Generation Sequencing Data2014
Next-Generation Sequencing Technology: Current Trends and Advancements2023
Neoantigens: promising targets for cancer therapy2023
Scalable whole-exome sequencing of cell-free DNA reveals high concordance with metastatic tumors2017
Gossypium barbadense and Gossypium hirsutum genomes provide insights into the origin and evolution of allotetraploid cotton2019
Allele-defined genome of the autopolyploid sugarcane Saccharum spontaneum L.2018
A high-quality apple genome assembly reveals the association of a retrotransposon and red fruit colour2019
Tumor microenvironment: barrier or opportunity towards effective cancer therapy2022
Ancient genomes show social and reproductive behavior of early Upper Paleolithic foragers2017
Genomics reveals historic and contemporary transmission dynamics of a bacterial disease among wildlife and livestock2016
Comparison of village dog and wolf genomes highlights the role of the neural crest in dog domestication2018
Genome sequencing of 2000 canids by the Dog10K consortium advances the understanding of demography, genome function and architecture2023
Severe childhood speech disorder2020
A Bacillus anthracis Genome Sequence from the Sverdlovsk 1979 Autopsy Specimens2016
A point mutation in recC associated with subclonal replacement of carbapenem-resistant Klebsiella pneumoniae ST11 in China2023
Introgression of Eastern Chinese and Southern Chinese haplotypes contributes to the improvement of fertility and immunity in European modern pigs2020
BioMaster: Multi-agent system for automated bioinformatics analysis workflow2026