Training of photonic neural networks through in situ backpropagation and gradient measurement
Обучение фотонных нейронных сетей методом in situ обратного распространения ошибки и измерения градиента
2018-07-19
SCID: 54.1/d7pfpwe9
Discuss with AI
adjoint variable methodsgradient measurement via intensity measurementsin situ backpropagationphotonic neural networkstraining of integrated photonics neural networks
Figures from the paper
Abstract (AI)
Recently, integrated optics has gained interest as a hardware platform for implementing machine learning algorithms. Of particular interest are artificial neural networks, since matrix-vector multi- plications, which are used heavily in artificial neural networks, can be done efficiently in photonic circuits. The training of an artificial neural network is a crucial step in its application. However, currently on the integrated photonics platform there is no efficient protocol for the training of these networks. In this work, we introduce a method that enables highly efficient, in situ training of a photonic neural network. We use adjoint variable methods to derive the photonic analogue of the backpropagation algorithm, which is the standard method for computing gradients of conventional neural networks. We further show how these gradients may be obtained exactly by performing intensity measurements within the device. As an application, we demonstrate the training of a numerically simulated photonic artificial neural network. Beyond the training of photonic machine learning implementations, our method may also be of broad interest to experimental sensitivity analysis of photonic systems and the optimization of reconfigurable optics platforms.
Key Findings
1
Demonstrated training of a numerically simulated photonic artificial neural network using the proposed method.
2
Derived the photonic analogue of the backpropagation algorithm using adjoint variable methods to compute gradients in photonic circuits.
3
Introduced a method enabling highly efficient, in situ training of photonic neural networks on integrated optics platforms.
4
Method is broadly applicable to experimental sensitivity analysis and optimization of reconfigurable photonic systems.
5
Showed that gradients can be obtained exactly by performing intensity measurements within the photonic device.
Research Object
Integrated photonic neural network (photonic artificial neural network) implemented in photonic circuits
Research Subject
In situ training via photonic analogue of backpropagation: deriving and measuring exact gradients using adjoint-variable methods and intensity measurements for efficient training and optimization
Publication Details
Publication Date
2018-07-19
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest