Wide & Deep Learning for Recommender Systems
Wide & Deep Learning для рекомендательных систем
2016-09-15
SCID: 54.1/33xhw7kg
Discuss with AI
Google Play recommender systemWide & Deep learningcross-product feature transformationsdeep neural networkswide linear models
Figures from the paper
Abstract (AI)
Generalized linear models with nonlinear feature transformations are widely used for large-scale regression and classification problems with sparse inputs. Memorization of feature interactions through a wide set of cross-product feature transformations are effective and interpretable, while generalization requires more feature engineering effort. With less feature engineering, deep neural networks can generalize better to unseen feature combinations through low-dimensional dense embeddings learned for the sparse features. However, deep neural networks with embeddings can over-generalize and recommend less relevant items when the user-item interactions are sparse and high-rank. In this paper, we present Wide & Deep learning---jointly trained wide linear models and deep neural networks---to combine the benefits of memorization and generalization for recommender systems. We productionized and evaluated the system on Google Play, a commercial mobile app store with over one billion active users and over one million apps. Online experiment results show that Wide & Deep significantly increased app acquisitions compared with wide-only and deep-only models. We have also open-sourced our implementation in TensorFlow.
Key Findings
1
Combining a wide linear model and a deep neural network (Wide & Deep) captures both memorization (feature interactions) and generalization (embeddings).
2
Deep neural networks with embeddings generalize to unseen feature combinations but can over-generalize and recommend less relevant items when interactions are sparse and high-rank.
3
The authors productionized the Wide & Deep system for a large-scale commercial setting (Google Play) and open-sourced the TensorFlow implementation.
4
Wide & Deep jointly trained model outperforms wide-only and deep-only models in online experiments on Google Play by significantly increasing app acquisitions.
5
Wide models using cross-product feature transformations provide effective and interpretable memorization but require more feature engineering to generalize.
Research Object
Wide & Deep learning recommender system (jointly trained wide linear models and deep neural networks) deployed for app recommendation on Google Play
Research Subject
Combining memorization and generalization by jointly training wide (cross-product feature) and deep (embedding-based) models to improve recommendation relevance and app acquisition under sparse, high-rank user–item interactions
Publication Details
Publication Date
2016-09-15
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest