Slimmed Optical Neural Networks with Multiplexed Neuron Sets and a Corresponding Backpropagation Training Algorithm

Уплотнённые оптические нейронные сети с мультиплексированными наборами нейронов и соответствующим алгоритмом обучения методом обратного распространения ошибки
Kejie Huang, Chenhui Li, Bowen Wang, Yi-Feng Liu, Rui-Yao Ren, Dai‐Bao Hou, Hai‐Zhong Weng, Xing Lin, Feng Liu, Chao‐Yuan Jin
2023-12-18

backpropagation training algorithmmultiplexed neuron sets (MNS)optical neural networkssemiconductor optical amplifierswavelength division multiplexing
Optical neural networks (ONNs) have recently attracted extensive interest as potential alternatives to electronic artificial neural networks, owing to their intrinsic capabilities in parallel signal processing with reduced power consumption and low latency. Preliminary confirmation of parallelism in optical computing has been widely performed by applying wavelength division multiplexing (WDM) to the linear transformation of neural networks. However, interchannel crosstalk has obstructed WDM technologies from being deployed in nonlinear activation on ONNs. Here, we propose a universal WDM structure called multiplexed neuron sets (MNS), which applies WDM technologies to optical neurons and enables ONNs to be further compressed. A corresponding backpropagation (BP) training algorithm was proposed to alleviate or even annul the influence of interchannel crosstalk in MNS-based WDM-ONNs. For simplicity, semiconductor optical amplifiers are employed as an example of MNS to construct a WDM-ONN trained using the new algorithm. The results show that the combination of MNS and the corresponding BP training algorithm clearly downsizes the system and improves the energy efficiency by a factor of 10 while providing similar performance to traditional ONNs.
1
Combination of MNS and the corresponding BP training algorithm downsizes the system and improves energy efficiency by a factor of 10.
2
Demonstrated an example implementation using semiconductor optical amplifiers as MNS elements to construct a WDM-ONN trained with the new algorithm.
3
Introduced multiplexed neuron sets (MNS), a universal WDM structure that applies wavelength division multiplexing to optical neurons enabling further compression of ONNs.
4
Proposed a corresponding backpropagation (BP) training algorithm that alleviates or can annul interchannel crosstalk in MNS-based WDM-ONNs.
5
The MNS-based WDM-ONN with the BP training algorithm achieves similar performance to traditional ONNs despite compression and crosstalk mitigation.

WDM-based optical neural networks implementing multiplexed neuron sets (MNS) using semiconductor optical amplifiers as example neurons

Compression and energy-efficiency improvement of WDM-ONNs via multiplexed neuron sets and a corresponding backpropagation training algorithm that mitigates interchannel crosstalk while preserving performance

Publication Details
Publication Date
2023-12-18
Journal
Publisher
ISSN
Cited by
1
Access Type
Author Information
Authors
Kejie Huang
Chenhui Li
Bowen Wang
Yi-Feng Liu
Rui-Yao Ren
Dai‐Bao Hou
Hai‐Zhong Weng
Xing Lin
Feng Liu
Chao‐Yuan Jin
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%