Intelligent nanophotonics: when machine learning sheds light

Abstract The synergistic development of nanophotonics and machine learning has inspired tremendous innovations in both fields in the past decade. In diverse photonics research, deep-learning methods using artificial neural networks become the key game changer that greatly facilitates rapid nanophotonics design and the versatile processing of optical information. Moreover, optical computing platforms that perform calculations through light propagation are receiving tremendous interest as next-generation machine-learning hardware with advantages in computing speed, energy efficiency, and parallelism. This review summarizes the current state-of-the-art nanophotonic devices enabled by machine learning and analyzes the longstanding challenges that must be overcome to make an impact on technology. We also discuss the opportunities of intelligent photonics in applications such as computational imaging/sensing and machine vision. The intersection of nanophotonics with deep learning holds tremendous implications for transformative technologies ranging from internet of things to smart health. Lastly, we provide our perspective on the pressing challenges in intelligent photonics that must be tackled to advance this field to the next level and the vast opportunities for multidisciplinary collaboration.