Slimmed Optical Neural Networks with Multiplexed Neuron Sets and a Corresponding Backpropagation Training Algorithm
Уплотнённые оптические нейронные сети с мультиплексированными наборами нейронов и соответствующим алгоритмом обучения методом обратного распространения ошибки
2023-12-18
SCID: 54.1/hn9uhcfm
Discuss with AI
backpropagation training algorithmmultiplexed neuron sets (MNS)optical neural networkssemiconductor optical amplifierswavelength division multiplexing
Figures from the paper
Abstract (AI)
Optical neural networks (ONNs) have recently attracted extensive interest as potential alternatives to electronic artificial neural networks, owing to their intrinsic capabilities in parallel signal processing with reduced power consumption and low latency. Preliminary confirmation of parallelism in optical computing has been widely performed by applying wavelength division multiplexing (WDM) to the linear transformation of neural networks. However, interchannel crosstalk has obstructed WDM technologies from being deployed in nonlinear activation on ONNs. Here, we propose a universal WDM structure called multiplexed neuron sets (MNS), which applies WDM technologies to optical neurons and enables ONNs to be further compressed. A corresponding backpropagation (BP) training algorithm was proposed to alleviate or even annul the influence of interchannel crosstalk in MNS-based WDM-ONNs. For simplicity, semiconductor optical amplifiers are employed as an example of MNS to construct a WDM-ONN trained using the new algorithm. The results show that the combination of MNS and the corresponding BP training algorithm clearly downsizes the system and improves the energy efficiency by a factor of 10 while providing similar performance to traditional ONNs.
Key Findings
1
Combination of MNS and the corresponding BP training algorithm downsizes the system and improves energy efficiency by a factor of 10.
2
Demonstrated an example implementation using semiconductor optical amplifiers as MNS elements to construct a WDM-ONN trained with the new algorithm.
3
Introduced multiplexed neuron sets (MNS), a universal WDM structure that applies wavelength division multiplexing to optical neurons enabling further compression of ONNs.
4
Proposed a corresponding backpropagation (BP) training algorithm that alleviates or can annul interchannel crosstalk in MNS-based WDM-ONNs.
5
The MNS-based WDM-ONN with the BP training algorithm achieves similar performance to traditional ONNs despite compression and crosstalk mitigation.
Research Object
WDM-based optical neural networks implementing multiplexed neuron sets (MNS) using semiconductor optical amplifiers as example neurons
Research Subject
Compression and energy-efficiency improvement of WDM-ONNs via multiplexed neuron sets and a corresponding backpropagation training algorithm that mitigates interchannel crosstalk while preserving performance
Publication Details
Publication Date
2023-12-18
Journal
Publisher
ISSN
Cited by
1
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest