Wide & Deep Learning for Recommender Systems

Wide & Deep Learning для рекомендательных систем
Xiaobing Liu, Greg S. Corrado, Rohan Anil, Heng-Tze Cheng, Tal Shaked, Tushar Chandra, Levent Koç, Jeremiah Harmsen, Hrishi Aradhye, Glen Anderson, Wei Koong Chai, Mustafa Ispir, Zakaria Haque, Lichan Hong, Vihan Jain, Hemal Shah
2016-09-15

Google Play recommender systemWide & Deep learningcross-product feature transformationsdeep neural networkswide linear models
Generalized linear models with nonlinear feature transformations are widely used for large-scale regression and classification problems with sparse inputs. Memorization of feature interactions through a wide set of cross-product feature transformations are effective and interpretable, while generalization requires more feature engineering effort. With less feature engineering, deep neural networks can generalize better to unseen feature combinations through low-dimensional dense embeddings learned for the sparse features. However, deep neural networks with embeddings can over-generalize and recommend less relevant items when the user-item interactions are sparse and high-rank. In this paper, we present Wide & Deep learning---jointly trained wide linear models and deep neural networks---to combine the benefits of memorization and generalization for recommender systems. We productionized and evaluated the system on Google Play, a commercial mobile app store with over one billion active users and over one million apps. Online experiment results show that Wide & Deep significantly increased app acquisitions compared with wide-only and deep-only models. We have also open-sourced our implementation in TensorFlow.
1
Combining a wide linear model and a deep neural network (Wide & Deep) captures both memorization (feature interactions) and generalization (embeddings).
2
Deep neural networks with embeddings generalize to unseen feature combinations but can over-generalize and recommend less relevant items when interactions are sparse and high-rank.
3
The authors productionized the Wide & Deep system for a large-scale commercial setting (Google Play) and open-sourced the TensorFlow implementation.
4
Wide & Deep jointly trained model outperforms wide-only and deep-only models in online experiments on Google Play by significantly increasing app acquisitions.
5
Wide models using cross-product feature transformations provide effective and interpretable memorization but require more feature engineering to generalize.

Wide & Deep learning recommender system (jointly trained wide linear models and deep neural networks) deployed for app recommendation on Google Play

Combining memorization and generalization by jointly training wide (cross-product feature) and deep (embedding-based) models to improve recommendation relevance and app acquisition under sparse, high-rank user–item interactions

Publication Details
Publication Date
2016-09-15
Journal
Publisher
ISSN
Access Type
Author Information
Authors
Xiaobing Liu
Greg S. Corrado
Rohan Anil
Heng-Tze Cheng
Tal Shaked
Tushar Chandra
Levent Koç
Jeremiah Harmsen
Hrishi Aradhye
Glen Anderson
Wei Koong Chai
Mustafa Ispir
Zakaria Haque
Lichan Hong
Vihan Jain
Hemal Shah
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%