Hierarchical Attention Networks for Document Classification
Иерархические сети внимания для классификации документов
2016-01-01
SCID: 54.1/2rjdc5a8
Discuss with AI
Hierarchical Attention Networksattention mechanismdocument classificationhierarchical structure
Figures from the paper
Abstract (AI)
Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2016.
Key Findings
1
Demonstrates improved document classification performance (state-of-the-art at time) on benchmark datasets compared to baseline methods
2
Hierarchical structure preserves document structure and yields better document representations than flat models
3
Introduces hierarchical attention networks that model documents at word and sentence levels for document classification
4
Uses attention mechanisms at both the word and sentence levels to identify informative words and sentences for classification
Research Object
Document classification models based on hierarchical attention networks
Research Subject
Effectiveness of hierarchical attention mechanisms (word- and sentence-level) for improving document classification performance
Publication Details
Publication Date
2016-01-01
Journal
Publisher
ISSN
Cited by
5043
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest
References available in scid.ai5
Gradient-based learning applied to document recognition1998
Distributed Representations of Words and Phrases and their Compositionality2013
Neural Machine Translation by Jointly Learning to Align and Translate2014
Convolutional Neural Networks for Sentence Classification2014
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank2013
Cited by7
Earthquake transformer—an attentive deep-learning model for simultaneous earthquake detection and phase picking2020
Attention in Natural Language Processing2020
Large language models (LLMs): survey, technical frameworks, and future challenges2024
ETC: Encoding Long and Structured Inputs in Transformers2020
Vision-language models for medical report generation and visual question answering: a review2024
Financial Sentiment Analysis: Techniques and Applications2024
Semantic Text Matching for Long-Form Documents2019