Training of photonic neural networks through in situ backpropagation and gradient measurement

Обучение фотонных нейронных сетей методом in situ обратного распространения ошибки и измерения градиента
Yu Shi, Tyler W. Hughes, Momchil Minkov, Shanhui Fan
2018-07-19

adjoint variable methodsgradient measurement via intensity measurementsin situ backpropagationphotonic neural networkstraining of integrated photonics neural networks
Recently, integrated optics has gained interest as a hardware platform for implementing machine learning algorithms. Of particular interest are artificial neural networks, since matrix-vector multi- plications, which are used heavily in artificial neural networks, can be done efficiently in photonic circuits. The training of an artificial neural network is a crucial step in its application. However, currently on the integrated photonics platform there is no efficient protocol for the training of these networks. In this work, we introduce a method that enables highly efficient, in situ training of a photonic neural network. We use adjoint variable methods to derive the photonic analogue of the backpropagation algorithm, which is the standard method for computing gradients of conventional neural networks. We further show how these gradients may be obtained exactly by performing intensity measurements within the device. As an application, we demonstrate the training of a numerically simulated photonic artificial neural network. Beyond the training of photonic machine learning implementations, our method may also be of broad interest to experimental sensitivity analysis of photonic systems and the optimization of reconfigurable optics platforms.
1
Demonstrated training of a numerically simulated photonic artificial neural network using the proposed method.
2
Derived the photonic analogue of the backpropagation algorithm using adjoint variable methods to compute gradients in photonic circuits.
3
Introduced a method enabling highly efficient, in situ training of photonic neural networks on integrated optics platforms.
4
Method is broadly applicable to experimental sensitivity analysis and optimization of reconfigurable photonic systems.
5
Showed that gradients can be obtained exactly by performing intensity measurements within the photonic device.

Integrated photonic neural network (photonic artificial neural network) implemented in photonic circuits

In situ training via photonic analogue of backpropagation: deriving and measuring exact gradients using adjoint-variable methods and intensity measurements for efficient training and optimization

Publication Details
Publication Date
2018-07-19
Journal
Publisher
ISSN
Access Type
Author Information
Authors
Yu Shi
Tyler W. Hughes
Momchil Minkov
Shanhui Fan
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%