[Objective] This paper aims to predict online customers’ future purchases based on their previous shopping behaviors.[Methods] We proposed a new product recommendation approach based on multi-head self-attention neural networks. Our method captured the relationship and attributes of items checked out by specific customers.Finally, we generated the recommended lists using recurrent neural networks with attentions.[Results] We examined the proposed approach on three real-world data sets and yielded better F1 values than existing methods (2% higher).[Limitations] The diversity of the recommended lists needs more analysis.[Conclusions] The multi-head self-attention mechanism is an effective way to model shopping behaviors and create better recommendations for the consumers.
Hidasi B, Karatzoglou A, Baltrunas L , et al. Session-based Recommendations with Recurrent Neural Networks[OL]. arXiv Preprint, arXiv: 1511.06939.
[2]
Hidasi B, Quadrana M, Karatzoglou A . Parallel Recurrent Neural Network Architectures for Feature-rich Session-based Recommendations [C]// Proceedings of the 10th ACM Conference on Recommender Systems, Boston, USA. ACM, 2016: 241-248.
[3]
Quadrana M, Karatzoglou A, Hidasi B , et al. Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks [C]// Proceedings of the 11th ACM Conference on Recommender Systems, Como, Italy. ACM, 2017: 130-137.
[4]
Jannach D, Ludewig M . When Recurrent Neural Networks Meet the Neighborhood for Session-based Recommendation [C]// Proceedings of the 11th ACM Conference on Recommender Systems, Como, Italy. ACM, 2017: 306-310.
[5]
De Montjoye Y A, Shmueli E, Wang S S . openPDS: Protecting the Privacy of Metadata Through Safe Answers[J]. PLoS One, 2014,9(7):e98790.
[6]
Vescovi M, Perentis C, Leonardi C , et al. My Data Store: Toward User Awareness and Control on Personal Data [C]// Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication, Seattle, USA. ACM, 2014: 179-182.
[7]
Hsu C N, Chung H H, Huang H S . Mining Skewed and Sparse Transaction Data for Personalized Shopping Recommendation[J]. Machine Learning, 2004,57(1-2):35-59.
[8]
Lazcorreta E, Botella F, Fernández-Caballero A . Towards Personalized Recommendation by Two-step Modified Apriori Data Mining Algorithm[J]. Expert Systems with Applications, 2008,35(3):1422-1429.
[9]
Guidotti R, Rossetti G, Pappalardo L , et al. Next Basket Prediction Using Recurring Sequential Patterns[OL]. arXiv Preprint, arXiv: 1702.07158.
[10]
Chand C, Thakkar A, Ganatra A . Sequential Pattern Mining: Survey and Current Research Challenges[J]. International Journal of Soft Computing and Engineering, 2012,1(2):185-193.
[11]
Rendle S, Freudenthaler C, Schmidt-Thieme L . Factorizing Personalized Markov Chains for Next-Basket Recommendation [C]// Proceedings of the 19th International Conference on World Wide Web. New York: ACM, 2010: 811-820.
[12]
Chen J, Wang C, Wang J . A Personalized Interest-forgetting Markov Model for Recommendations [C]// Proceedings of the 29th AAAI Conference on Artificial Intelligence. 2015.
[13]
Wang P, Guo J, Lan Y , et al. Learning Hierarchical Representation Model for Next Basket Recommendation [C]// Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile. ACM, 2015: 403-412.
[14]
Yu F, Liu Q, Wu S , et al. A Dynamic Recurrent Model for Next Basket Recommendation [C]// Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, Pisa, Italy. ACM, 2016: 729-732.
[15]
Bai T, Nie J Y, Zhao W X , et al. An Attribute-aware Neural Attentive Model for Next Basket Recommendation [C]// Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, Ann Arbor, MI, USA. ACM, 2018: 1201-1204.
[16]
Vaswani A, Shazeer N, Parmar N , et al. Attention is All You Need [C]// Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017: 5998-6008.
[17]
Yu A W, Dohan D, Luong M T , et al. QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension[OL]. arXiv Preprint, arXiv: 1804.09541.
[18]
Shen T, Zhou T, Long G , et al. DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding [C]// Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 2018.
Lee D D, Seung H S . Algorithms for Non-negative Matrix Factorization [C]// Proceedings of the 13th International Conference on Neural Information Processing Systems. 2001: 556-562.