|
|
Predicting User Pay Conversion Intention Based on Stacking Ensemble Learning: Case Study of Free Value-Added Games |
Li Meiyu(),Liu Yang,Wang Yixuan,Zhu Qinghua |
School of Information Management, Nanjing University, Nanjing 210023, China |
|
|
Abstract [Objective] This paper proposes a model based on the Stacking ensemble learning method to predict users' intention to convert to paid services, aiming to identify potential paying users accurately. [Methods] We constructed a model for predicting payment intention based on Stacking ensemble learning. First, we determined the base model combination by their prediction performance. Then, we examined the proposed model performance and portability with game players' behavior data set. [Results] The prediction accuracy of our model reached 90.88%, with a F1 value of 90.71% and an AUC value of 0.960 2. Compared to the Bayesian model with the worst performance, our model improved by 4.15%, 4.50%, and 0.106 2, respectively. [Limitations] Our model cannot predict whether players will engage in irrational spending. [Conclusions] This study verifies the applicability of the Stacking ensemble learning method in game payment scenarios. The fusion of multiple models can obtain stable and accurate prediction results of payment intention. The proposed model could predict users' payment intentions in different fields.
|
Received: 27 November 2022
Published: 30 March 2023
|
|
Fund:National Natural Science Foundation of China(72174083) |
Corresponding Authors:
Li Meiyu,ORCID:0000-0002-4155-2501,E-mail: limeiyu1998@163.com。
|
[1] |
孙宝文, 李涛. 互联网经济蓝皮书:中国互联网经济发展报告(2018)[M]. 北京: 社会科学文献出版社, 2018.
|
[1] |
Sun Baowen, Li Tao. Blue Book of Internet Economy:Annual Report on the Development of China's Internet Economy(2018)[M]. Beijing: Social Sciences Academic Press(China), 2018.)
|
[2] |
中华人民共和国工业与信息化部. 2021年互联网和相关服务业运行情况[EB/OL]. (2022-10-27). [2022-01-27]. https://www.miit.gov.cn/gxsj/tjfx/hlw/art/2022/art_b0299e5b207946f9b7206e752e727e66.html.
|
[2] |
( Ministry of Industry and Information Technology of the People's Republic of China. Operation of Internet and Related Service Industries in 2021[EB/OL]. (2022-10-27). [2022-01-27]. https://www.miit.gov.cn/gxsj/tjfx/hlw/art/2022/art_b0299e5b207946f9b7206e752e727e66.html.)
|
[3] |
晏梦灵, 邱凌云. 游戏类移动应用软件盈利模式[J]. 管理现代化, 2015, 35(5): 120-122.
|
[3] |
(Yan Mengling, Qiu Lingyun. Profit Model of Game Mobile Application Software[J]. Modernization of Management, 2015, 35(5): 120-122.)
|
[4] |
Singh D, Pillai S. Implementation of Digital Marketing Strategy in the Gaming Industry[C]// Proceedings of the 2022 International Conference on Decision Aid Sciences and Applications. IEEE, 2022: 387-394.
|
[5] |
郭国庆, 王玉玺, 杨海龙. 免费增值商业模式下用户参与度分析——基于在线游戏的实证研究[J]. 管理评论, 2019, 31(7): 199-209.
|
[5] |
(Guo Guoqing, Wang Yuxi, Yang Hailong. The Impact of Freemium Business Model on Player's Engagement: An Empirical Study in Online Game[J]. Management Review, 2019, 31(7): 199-209.)
|
[6] |
中国音像与数字出版协会游戏出版工作委员会, 中国游戏产业研究院. 2022年1-6月中国游戏产业报告[EB/OL]. (2022-08-06). [2022-10-10]. https://news.ycwb.com/attachment/2022-07/21/74fee951-02d6-4a92-8bf1-5b87e03c723c.pdf.
|
[6] |
(Game Publishing Committee of the China Audio-video and Digital Publishing Association, China Game Industry Research Institute. China Gaming Industry Report[EB/OL]. (2022-08-06). [2022-10-10]. https://news.ycwb.com/attachment/2022-07/21/74fee951-02d6-4a92-8bf1-5b87e03c723c.pdf.)
|
[7] |
Rietveld J. Creating and Capturing Value from Freemium Business Models: A Demand-Side Perspective[J]. Strategic Entrepreneurship Journal, 2018, 12(2): 171-193.
doi: 10.1002/sej.2018.12.issue-2
|
[8] |
Ravoniarison A, Benito C. Mobile Games: Players' Experiences with In-App Purchases[J]. Journal of Research in Interactive Marketing, 2019, 13(1): 62-78.
doi: 10.1108/JRIM-06-2016-0060
|
[9] |
Marder B, Gattig D, Collins E, et al. The Avatar's New Clothes: Understanding Why Players Purchase Non-Functional Items in Free-to-Play Games[J]. Computers in Human Behavior, 2019, 91: 72-83.
doi: 10.1016/j.chb.2018.09.006
|
[10] |
Hamari J, Alha K, Järvelä S, et al. Why Do Players Buy In-Game Content? An Empirical Study on Concrete Purchase Motivations[J]. Computers in Human Behavior, 2017, 68: 538-546.
doi: 10.1016/j.chb.2016.11.045
|
[11] |
Flunger R, Mladenow A, Strauss C. The Free-to-Play Business Model[C]// Proceedings of the 19th International Conference on Information Integration and Web-Based Applications & Services. ACM, 2017: 373-379.
|
[12] |
Yang W S, Huang T, Zeng J L, et al. Purchase Prediction in Free Online Games via Survival Analysis[C]// Proceedings of the 2019 IEEE International Conference on Big Data. IEEE, 2019: 4444-4449.
|
[13] |
Guitart A, Tan S H, del Río A F, et al. From Non-Paying to Premium: Predicting User Conversion in Video Games with Ensemble Learning[C]// Proceedings of the 14th International Conference on the Foundations of Digital Games. ACM, 2019: 1-9.
|
[14] |
Ani R, Harikumar V, Devan A K, et al. Victory Prediction in League of Legends Using Feature Selection and Ensemble Methods[C]// Proceedings of the 2019 International Conference on Intelligent Computing and Control Systems. IEEE, 2019: 74-77.
|
[15] |
Woh S M, Lee J H. Game State Prediction with Ensemble of Machine Learning Techniques[C]// Proceedings of the 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems and 19th International Symposium on Advanced Intelligent Systems. IEEE, 2018: 89-92.
|
[16] |
Karmakar B, Liu P, Mukherjee G, et al. Improved Retention Analysis in Freemium Role-Playing Games by Jointly Modelling Players' Motivation, Progression and Churn[J]. Journal of the Royal Statistical Society Series A: Statistics in Society, 2022, 185(1): 102-133.
doi: 10.1111/rssa.12730
|
[17] |
Dew R, Ansari A. Bayesian Nonparametric Customer Base Analysis with Model-Based Visualizations[J]. Marketing Science, 2018, 37(2): 216-235.
doi: 10.1287/mksc.2017.1050
|
[18] |
Fang B, Zheng Z E, Ye Q, et al. Social Influence and Monetization of Freemium Social Games[J]. Journal of Management Information Systems, 2019, 36(3): 730-754.
doi: 10.1080/07421222.2019.1628878
|
[19] |
Hamari J, Hanner N, Koivisto J. “Why Pay Premium in Freemium Services?” A Study on Perceived Value, Continued Use and Purchase Intentions in Free-to-Play Games[J]. International Journal of Information Management, 2020, 51: Article No.102040.
|
[20] |
Guo C H, Chen X, Goes P, et al. Multiplex Social Influence in a Freemium Context: Evidence from Online Social Games[J]. Decision Support Systems, 2022, 155: Article No.113711.
|
[21] |
Rothmeier K, Pflanzl N, Hüllmann J A, et al. Prediction of Player Churn and Disengagement Based on User Activity Data of a Freemium Online Strategy Game[J]. IEEE Transactions on Games, 2021, 13(1): 78-88.
doi: 10.1109/TG.2020.2992282
|
[22] |
吴悦昕, 赵鑫, 过岩巍, 等. 在线游戏用户的流失预测: 基于不平衡数据的采样方法比较和分析[J]. 中文信息学报, 2016, 30(4): 213-222.
|
[22] |
(Wu Yuexin, Zhao Xin, Guo Yanwei, et al. User Churn Prediction for Online Game: Comparison and Analysis of Approaches Based on Sampling for Imbalanced Data[J]. Journal of Chinese Information Processing, 2016, 30(4): 213-222.)
|
[23] |
Gainsbury S M, King D L, Russell A M T, et al. Who Pays to Play Freemium Games? The Profiles and Motivations of Players Who Make Purchases Within Social Casino Games[J]. Journal of Behavioral Addictions, 2016, 5(2): 221-230.
doi: 10.1556/2006.5.2016.031
pmid: 27306146
|
[24] |
Hanner N, Zarnekow R. Purchasing Behavior in Free to Play Games: Concepts and Empirical Validation[C]// Proceedings of the 48th Hawaii International Conference on System Sciences. IEEE, 2015: 3326-3335.
|
[25] |
Voigt S, Hinz O. Making Digital Freemium Business Models a Success: Predicting Customers' Lifetime Value via Initial Purchase Information[J]. Business & Information Systems Engineering, 2016, 58(2): 107-118.
|
[26] |
何磊. 关于游戏虚拟商品收入确认的思考[J]. 中国市场, 2022(19): 61-63.
|
[26] |
(He Lei. Reflections on the Revenue Confirmation of Game Virtual Goods[J]. China Market, 2022(19): 61-63.)
|
[27] |
Zhou Z H. Ensemble Methods: Foundations and Algorithms[M]. CRC Press, 2012: 83-86.
|
[28] |
周志华. 机器学习[M]. 北京: 清华大学出版社, 2016.
|
[28] |
(Zhou Zhihua. Machine Learning[M]. Beijing: Tsinghua University Press, 2016.)
|
[29] |
Breiman L. Random Forests[J]. Machine Learning, 2001, 45: 5-32.
doi: 10.1023/A:1010933404324
|
[30] |
Chen T, Guestrin C. XGBoost: A Scalable Tree Boosting System[C]// Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016: 785-794.
|
[31] |
John C P. Sequential Minimal Optimization: A Fast Algorithm for Training Support Vector Machines[R]. Microsoft Research, 1998.
|
[32] |
Bacaër N. The Diffusion of Genes (1937)[A]//Bacaër N. A Short History of Mathematical Population Dynamics[M]. London: Springer, 2011: 111-116.
|
[33] |
Akyol K. Stacking Ensemble Based Deep Neural Networks Modeling for Effective Epileptic Seizure Detection[J]. Expert Systems with Applications, 2020, 148: Article No.113239.
|
[34] |
Cui S Z, Yin Y Q, Wang D J, et al. A Stacking-Based Ensemble Learning Method for Earthquake Casualty Prediction[J]. Applied Soft Computing, 2021, 101: Article No.107038.
|
[35] |
Chawla N V, Bowyer K W, Hall L O, et al. SMOTE: Synthetic Minority Over-Sampling Technique[J]. Journal of Artificial Intelligence Research, 2002, 16: 321-357.
doi: 10.1613/jair.953
|
[36] |
Tomek I. Two Modifications of CNN[J]. IEEE Transactions on Systems, Man, and Cybernetics, 1976, 6(11): 769-772.
|
[37] |
Tharwat A. Principal Component Analysis—A Tutorial[J]. International Journal of Applied Pattern Recognition, 2016, 3(3): 197-240.
doi: 10.1504/IJAPR.2016.079733
|
[38] |
瞿珊. 基于机器学习的网络游戏收益预测实证研究[D]. 重庆: 重庆大学, 2019.
|
[38] |
(Qu Shan. Empirical Analysis on the Prediction of Online Game Revenue Based on Machine Learning Algorithms[D]. Chongqing: Chongqing University, 2019.)
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|