Adaptive Mixtures of Local Experts
Адаптивные смеси локальных экспертов
1991-02-01
SCID: 54.1/c6t92at9
Discuss with AI
adaptive mixtures of local expertscompetitive learningmodular networkssupervised learningvowel discrimination
Figures from the paper
Abstract (AI)
We present a new supervised learning procedure for systems composed of many separate networks, each of which learns to handle a subset of the complete set of training cases. The new procedure can be viewed either as a modular version of a multilayer supervised network, or as an associative version of competitive learning. It therefore provides a new link between these two apparently different approaches. We demonstrate that the learning procedure divides up a vowel discrimination task into appropriate subtasks, each of which can be solved by a very simple expert network.
Key Findings
1
In a vowel discrimination task, the method partitions the problem into appropriate subtasks handled by simple expert networks.
2
Introduces a supervised learning procedure for systems composed of multiple expert networks, each specializing in a subset of training cases.
3
It establishes a conceptual connection between modular supervised networks and competitive learning approaches.
4
The procedure can be interpreted as either a modular multilayer supervised network or an associative form of competitive learning.
Research Object
A supervised learning system composed of multiple local expert networks for vowel discrimination
Research Subject
Adaptive decomposition of the training cases into subtasks and coordination of expert networks to solve those subtasks
Publication Details
Publication Date
1991-02-01
Journal
Publisher
ISSN
Cited by
5309
Access Type
Author Information
Download PDF
Subscribe to digest
Cited by7
Distilling the Knowledge in a Neural Network2015
Improving neural networks by preventing co-adaptation of feature detectors2012
Building Watson: An Overview of the DeepQA Project2010
Deterministic annealing for clustering, compression, classification, regression, and related optimization problems1998
Learning to select and generalize striking movements in robot table tennis2013
Generative AI Agents With Large Language Model for Satellite Networks via a Mixture of Experts Transmission2024
OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers2024