HuggingFace's Transformers: State-of-the-art Natural Language Processing
Transformers от HuggingFace: современные методы обработки естественного языка
2019-10-09
SCID: 54.1/wp99kuje
Discuss with AI
HuggingFace Transformers libraryTransformer architecturesTransformersnatural language processingpretrained models
Figures from the paper
Abstract (AI)
Recent progress in natural language processing has been driven by advances in both model architecture and model pretraining. Transformer architectures have facilitated building higher-capacity models and pretraining has made it possible to effectively utilize this capacity for a wide variety of tasks. \textit{Transformers} is an open-source library with the goal of opening up these advances to the wider machine learning community. The library consists of carefully engineered state-of-the art Transformer architectures under a unified API. Backing this library is a curated collection of pretrained models made by and available for the community. \textit{Transformers} is designed to be extensible by researchers, simple for practitioners, and fast and robust in industrial deployments. The library is available at \url{https://github.com/huggingface/transformers}.
Key Findings
1
The library backs its architectures with a curated collection of pretrained models made available to the community.
2
The project aims to democratize advances in model architecture and pretraining by making them accessible via the GitHub repository https://github.com/huggingface/transformers.
3
Transformers is an open-source library that provides carefully engineered state-of-the-art Transformer architectures under a unified API.
4
Transformers is designed to be extensible for researchers, simple for practitioners, and fast and robust for industrial deployments.
Research Object
HuggingFace Transformers open-source library
Research Subject
Provision and engineering of state-of-the-art Transformer model architectures and curated pretrained models under a unified, extensible API for research, practitioner use, and industrial deployment
Publication Details
Publication Date
2019-10-09
Journal
Publisher
ISSN
Cited by
3068
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai4
Cited by13
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks2020
ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope2023
Heterogeneous Graph Transformer2020
The neural architecture of language: Integrative modeling converges on predictive processing2021
A Frustratingly Easy Approach for Entity and Relation Extraction2021
A review of large language models and autonomous agents in chemistry2024
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference2024
Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects2023
DNA language models are powerful predictors of genome-wide variant effects2023
Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval2020
Longitudinal analysis of sentiment and emotion in news media headlines using automated labelling with Transformer language models2022
Augmented Datasheets for Speech Datasets and Ethical Decision-Making2023
Mapping the neuronal building blocks of human language with language models2026