Please wait a minute...
Data Analysis and Knowledge Discovery  2023, Vol. 7 Issue (8): 46-61    DOI: 10.11925/infotech.2096-3467.2022.0787
Current Issue | Archive | Adv Search |
CEO Facial Expression Analysis Based on Neural Networks and Its Impacts on Media Attention at Press Conferences
Li Yang,Zhao Jichang()
School of Economics and Management, Beihang University, Beijing 100191, China
Download: PDF (3489 KB)   HTML ( 26
Export: BibTeX | EndNote (RIS)      
Abstract  

[Objective] This paper uses neural networks to detect facial expressions in real-time video streams, aiming to explore the correlation between CEO’s emotional characteristics at product launch events and media attention. [Methods] A total of 566 product launch event videos from 34 electronics companies were collected. Facial expressions of CEOs during the events were detected using models like MTCNN. Then, we investigated the patterns of CEO’s emotional expressions and explored the influence of their characteristics on media attention with correlation analysis. [Results] CEOs of different companies exhibited distinct emotional expression patterns during the launch events, which could be clustered closely associated with the main product types of the companies. Each cluster also had significant emotional inertia expression and influence trends. The proportion of anger was positively correlated with media attention during the launch events at a confidence level of 95% (with Pearson’s correlation coefficients exceeding 0.21). [Limitations] This study focuses on electronic product launch events, and the collected data from various companies were not unevenly distributed. [Conclusions] Deep learning enable the rapid detection of CEO facial expressions based on video streams. This study analyzed CEO’s emotional expression patterns and their influence and provided suggestions for CEO’s emotional management in brand communication.

Key wordsExpression Analysis      Neural Network      CEO      Press Conference      Media Attention     
Received: 27 July 2022      Published: 08 October 2023
ZTFLH:  TP391  
Fund:National Natural Science Foundation of China(71871006)
Corresponding Authors: Zhao Jichang,ORCID:0000-0002-5319-8060,E-mail: jichang@tuaa.edu.cn。   

Cite this article:

Li Yang, Zhao Jichang. CEO Facial Expression Analysis Based on Neural Networks and Its Impacts on Media Attention at Press Conferences. Data Analysis and Knowledge Discovery, 2023, 7(8): 46-61.

URL:

https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/10.11925/infotech.2096-3467.2022.0787     OR     https://manu44.magtech.com.cn/Jwk_infotech_wk3/EN/Y2023/V7/I8/46

Research Framework
Face Recognition Network
公司名称 视频数量/条 采集时间 公司名称 视频数量/条 采集时间
OPPO 60 2012-2021 明基 2 2019
Realme 25 2018-2021 机械革命 1 2020
锤子科技 13 2014-2020 VIVO 28 2015-2021
红米 31 2013-2021 联发科 5 2019-2021
魅族 42 2014-2021 华米 9 2017-2021
荣耀 45 2015-2021 红魔 7 2018-2021
小米 97 2011-2021 黑鲨 9 2018-2021
华为 71 2014-2021 ROG 13 2018-2021
IQOO 13 2019-2021 长虹 1 2019
努比亚 15 2015-2021 乐视 3 2015-2021
海尔 1 2019 海信 2 2020
卡萨帝 1 2021 中兴 10 2020-2021
海康 3 2020-2022 TCL 12 2016-2021
格力 5 2021 一加 21 2019-2021
奥克斯 1 2020 酷开 1 2021
当贝 1 2020 创维 2 2019-2020
云米 5 2019-2022 华硕 11 2018-2021
Distribution of Product Launch Videos
数据参数 参数详情 参数解释
关键字 字符串 公司品牌名称
省份/市 字符串 全国
时间 时间格式文本 当日日期
搜索PC+移动 数字 PC及移动端搜索指数和
Data Structure of Baidu Search Index
Fluctuations of Baidu Search Index of Honor Company
Mean Distribution of CEO Emotion Scores of Nine Companies
Clustering Hierarchy of CEO Emotions in 34 Companies
Distribution of CEO Emotion Features Based on Clustering Results
CEO’s Emotional Autocorrelation within the 30-Order Delay (Taking Meizu as an Example)
The Influence of the Cross-Correlation of IQOO CEO’s Anger with Other Emotions
数据名称 公司名称 Pearson
相关系数
p-value 增幅方式
愤怒比例 红米 0.436* 0.436* 单日
愤怒持续分布偏度 红米 0.434* 0.434* 单日
愤怒持续分布峰度 红米 0.485** 0.485** 单日
愤怒比例 荣耀 0.442** 0.442** 双日平均
愤怒持续分布偏度 荣耀 0.309* 0.309* 双日平均
愤怒持续分布峰度 荣耀 0.331* 0.331* 双日平均
愤怒比例 华为 0.253* 0.253* 单日
愤怒持续分布偏度 华为 0.288** 0.288** 单日
愤怒持续分布峰度 华为 0.364** 0.364** 单日
愤怒比例 小米 0.212* 0.212* 双日平均
愤怒持续分布偏度 小米 0.284** 0.284** 双日平均
愤怒持续分布峰度 小米 0.292** 0.292** 双日平均
Correlation Analysis Between the CEO Emotion Distribution and the Increasing Range of Baidu Search Index
[1] Hirshleifer D, Low A, Teoh S H. Are Overconfident CEOs Better Innovators?[J]. United Kingdom: The Journal of Finance, 2012, 67(4): 1457-1498.
[2] 李峰, 崔康乐. 企业社会责任行为对东道国消费者的影响研究——基于中国品牌国际化视角[J]. 华东经济管理, 2022, 36(6): 89-104.
[2] (Li Feng, Cui Kangle. Research on the Impact of Corporate Social Responsibility Behavior on Consumers in the Host Country: From the Perspective of Chinese Brand Internationalization[J]. East China Economic Management, 2022, 36(6): 89-104.)
[3] 张彩燕. 企业社会责任对企业品牌的影响作用研究[J]. 现代商业, 2022(5): 24-26.
[3] (Zhang Caiyan. Research on the Influence of Corporate Social Responsibility on Corporate Brand[J]. Modern Business, 2022(5): 24-26.)
[4] 张琼. 论移动互联时代广告文案在品牌价值上的功能体现[J]. 应用写作, 2022(2): 21-27.
[4] (Zhang Qiong. On the Function of Advertising Copy in the Era of Mobile Internet in Brand Value[J]. Applied Writing, 2022(2): 21-27.)
[5] 梁子玉. 品牌建构:苹果公司的植入式广告探析[J]. 新闻研究导刊, 2022, 13(1): 242-244.
[5] (Liang Ziyu. Brand Building: An Analysis of Apple’s Product Placement[J]. Journal of Journalism and Research, 2022, 13(1): 242-244.)
[6] Haroon Hakimi. 影响新闻发布会的关键因素:公共关系从业人员和新闻工作者的互动研究[D]. 重庆: 西南大学, 2021.
[6] (Haroon Hakimi. The Effective Elements of a Press Conference:The Coorientation Approach of Public Relations Practitioner and Journalists[D]. Chongqing: Southwest University, 2021.)
[7] 姜继涛. 产品发布会在手机营销中的作用与对策分析[J]. 现代营销, 2018(1): 67.
[7] (Jiang Jitao. Analysis of the Function and Countermeasures of Product Launch in Mobile Phone Marketing[J]. Modern Marketing, 2018(1): 67.)
[8] Li S, Deng W H. Deep Facial Expression Recognition: A Survey[J]. IEEE Transactions on Affective Computing, 2022, 13(3): 1195-1215.
doi: 10.1109/TAFFC.2020.2981446
[9] Donahue J, Jia Y Q, Vinyals O. DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition[C]// Proceedings of the 31st International Conference on Machine Learning - Volume 32. 2014: I-647-I-655.
[10] Jia Y Q, Shelhamer E, Donahue J, et al. Caffe: Convolutional Architecture for Fast Feature Embedding[C]// Proceedings of the 22nd ACM International Conference on Multimedia. 2014: 675-678.
[11] Yu Z D, Zhang C. Image Based Static Facial Expression Recognition with Multiple Deep Network Learning[C]// Proceedings of the 2015 ACM on International Conference on Multimodal Interaction. 2015: 435-442.
[12] Schroff F, Kalenichenko D, Philbin J. FaceNet: A Unified Embedding for Face Recognition and Clustering[C]// Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. 2015: 815-823.
[13] Ekman P, Friesen W V. Constants Across Cultures in the Face and Emotion[J]. Journal of Personality and Social Psychology, 1971, 17(2): 124-129.
doi: 10.1037/h0030377 pmid: 5542557
[14] Ben X Y, Ren Y, Zhang J P, et al. Video-Based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44(9): 5826-5846.
[15] Liu Y J, Zhang J K, Yan W J, et al. A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition[J]. IEEE Transactions on Affective Computing, 2016, 7(4): 299-310.
doi: 10.1109/T-AFFC.5165369
[16] Kim D H, Baddar W J, Ro Y M. Micro-Expression Recognition with Expression-State Constrained Spatio-Temporal Feature Representations[C]// Proceedings of the 24th ACM International Conference on Multimedia. 2016: 382-386.
[17] Zhang K H, Huang Y Z, Du Y, et al. Facial Expression Recognition Based on Deep Evolutional Spatial-Temporal Networks[J]. IEEE Transactions on Image Processing, 2017, 26(9): 4193-4203.
doi: 10.1109/TIP.2017.2689999 pmid: 28371777
[18] Zhou E J, Cao Z M, Yin Q. Naive-Deep Face Recognition: Touching the Limit of LFW Benchmark or Not [OL]. arXiv Preprint, arXiv: 1501.04690.
[19] Fan H Q, Cao Z M, Jiang Y N, et al. Learning Deep Face Representation[OL]. arXiv Preprint, arXiv: 1403.2802.
[20] 王琳琳. CEO情绪特质对企业战略决策影响的实证研究[D]. 合肥: 中国科学技术大学, 2018.
[20] (Wang Linlin. An Empirical Study on the Influence of CEO’s Emotional Characteristics on Corporate Strategic Decision-Making[D]. Hefei: University of Science and Technology of China, 2018.)
[21] Mesquita B, Boiger M. Emotions in Context: A Sociodynamic Model of Emotions[J]. Emotion Review, 2014, 6(4): 298-302.
doi: 10.1177/1754073914534480
[22] LaBar K S, Cabeza R. Cognitive Neuroscience of Emotional Memory[J]. Nature Reviews Neuroscience, 2006, 7: 54-64.
doi: 10.1038/nrn1825 pmid: 16371950
[23] Kuppens P, Verduyn P. Emotion Dynamics[J]. Current Opinion in Psychology, 2017, 17: 22-26.
doi: S2352-250X(16)30201-9 pmid: 28950968
[24] Kuppens P, Verduyn P. Looking at Emotion Regulation Through the Window of Emotion Dynamics[J]. Psychological Inquiry, 2015, 26(1): 72-79.
doi: 10.1080/1047840X.2015.960505
[25] Larsen R J. The Stability of Mood Variability: A Spectral Analytic Approach to Daily Mood Assessments[J]. Journal of Personality and Social Psychology, 1987, 52(6): 1195-1204.
doi: 10.1037/0022-3514.52.6.1195
[26] 于宁莉, 易东云, 涂先勤. 时间序列中自相关与偏相关函数分析[J]. 数学理论与应用, 2007, 27(1): 54-57.
[26] (Yu Ningli, Yi Dongyun, Tu Xianqin. Analysis of Autocorrelation and Partial Correlation Functions in Time Series[J]. Mathematical Theory and Applications, 2007, 27(1): 54-57.)
[27] Bertrand M, Schoar A. Managing with Style: The Effect of Managers on Firm Policies[J]. The Quarterly Journal of Economics, 2003, 118(4): 1169-1208.
doi: 10.1162/003355303322552775
[28] Gomulya D, Wong E M, Ormiston M E, et al. The Role of Facial Appearance on CEO Selection after Firm Misconduct[J]. Journal of Applied Psychology, 2017, 102(4): 617-635.
doi: 10.1037/apl0000172 pmid: 27991800
[29] Sun Y J, Akansu A A, Cicon J E. The Power of Fear: Facial Emotion Analysis of CEOs to Forecast Firm Performance[C]// Proceedings of the 2014 IEEE 15th International Conference on Information Reuse and Integration. 2014: 695-702.
[30] 田敏, 李纯青, 萧庆龙. 企业社会责任行为对消费者品牌评价的影响[J]. 南开管理评论, 2014, 17(6): 19-29.
[30] (Tian Min, Li Chunqing, Xiao Qinglong. The Impact of Corporate Social Responsibility Activities on Brand Evaluation[J]. Nankai Business Review, 2014, 17(6): 19-29.)
[31] 裴荣康. 企业微博内容对网络口碑及品牌认可度的影响及对策探析[J]. 企业改革与管理, 2022(2): 114-116.
[31] (Pei Rongkang. The Influence of Enterprise Weibo Content on Online Word of Mouth and Brand Recognition and the Countermeasures[J]. Enterprise Reform and Management, 2022(2): 114-116.)
[32] Pe M L, Kuppens P. The Dynamic Interplay Between Emotions in Daily Life: Augmentation, Blunting, and the Role of Appraisal Overlap[J]. Emotion, 2012, 12(6): 1320-1328.
doi: 10.1037/a0028262 pmid: 22642355
[33] Barrett L F, Gross J J, Christensen T C, et al. Knowing What You’re Feeling and Knowing What to Do about It: Mapping the Relation Between Emotion Differentiation and Emotion Regulation[J]. Cognition and Emotion, 2001, 15(6): 713-724.
doi: 10.1080/02699930143000239
[34] Nook E C, Sasse S F, Lambert H K, et al. The Nonlinear Development of Emotion Differentiation: Granular Emotional Experience is Low in Adolescence[J]. Psychological Science, 2018, 29(8): 1346-1357.
doi: 10.1177/0956797618773357 pmid: 29878880
[35] Sun Y, Wang X G, Tang X O. Deep Convolutional Network Cascade for Facial Point Detection[C]// Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition. 2013: 3476-3483.
[36] Fan R, Xu K, Zhao J C. Weak Ties Strengthen Anger Contagion in Social Media[OL]. arXiv Preprint, arXiv: 2005.01924.
[37] Chuai Y W, Zhao J C. Anger Can Make Fake News Viral Online[J]. Frontiers in Physics, 2022, 10: 970174.
doi: 10.3389/fphy.2022.970174
[1] Xu Xin, Li Qian, Yao Zhanlei. Technology Recognition and Link Prediction Method Based on GNN[J]. 数据分析与知识发现, 2023, 7(6): 15-25.
[2] Li Haojun, Lv Yun, Wang Xuhui, Huang Jieya. A Deep Recommendation Model with Multi-Layer Interaction and Sentiment Analysis[J]. 数据分析与知识发现, 2023, 7(3): 43-57.
[3] Pei Wei, Sun Shuifa, Li Xiaolong, Lu Ji, Yang Liu, Wu Yirong. Medical Named Entity Recognition with Domain Knowledge[J]. 数据分析与知识发现, 2023, 7(3): 142-154.
[4] Duan Yufeng, He Guoxiu. Analysis of Neural Network Modules for Named Entity Recognition of Chinese Medical Texts[J]. 数据分析与知识发现, 2023, 7(2): 26-37.
[5] Zhao Ruijie, Tong Xinyu, Liu Xiaohua, Lu Yonghe. Entity Recognition and Labeling for Medical Literature Based on Neural Network[J]. 数据分析与知识发现, 2022, 6(9): 100-112.
[6] Cheng Quan, She Dexin. Drug Recommendation Based on Graph Neural Network with Patient Signs and Medication Data[J]. 数据分析与知识发现, 2022, 6(9): 113-124.
[7] Tang Jiao, Zhang Lisheng, Sang Chunyan. News Recommendation with Latent Topic Distribution and Long and Short-Term User Representations[J]. 数据分析与知识发现, 2022, 6(9): 52-64.
[8] Yang Meifang, Yang Bo. Extracting Entities for Enterprise Risks Based on Stroke ELMo and IDCNN-CRF Model[J]. 数据分析与知识发现, 2022, 6(9): 86-99.
[9] Zhao Pengwu, Li Zhiyi, Lin Xiaoqi. Identifying Relationship of Chinese Characters with Attention Mechanism and Convolutional Neural Network[J]. 数据分析与知识发现, 2022, 6(8): 41-51.
[10] Zhou Ning, Jin Gaoya, Shi Wenqian. Algorithm for Entity Coreference Resolution with Neural Network and Global Reasoning[J]. 数据分析与知识发现, 2022, 6(8): 75-83.
[11] Yang Wenli, Li Nana. A Text-Aligned Cross-Language Sentiment Classification Method Based on Adversarial Networks[J]. 数据分析与知识发现, 2022, 6(7): 141-151.
[12] Guo Fanrong, Huang Xiaoxi, Wang Rongbo, Chen Zhiqun, Hu Chuang, Xie Yimin, Si Boyu. Identifying Metaphor with Transformer and Graph Convolutional Network[J]. 数据分析与知识发现, 2022, 6(4): 120-129.
[13] Wei Tingting, Jiang Tao, Zheng Shuling, Zhang Jiantao. Extracting Chinese Patent Keywords with LSTM and Logistic Regression[J]. 数据分析与知识发现, 2022, 6(2/3): 308-317.
[14] Wang Nan, Li Hairong, Tan Shuru. Predicting Public Opinion Reversal Based on Evolution Analysis of Events and Improved KE-SMOTE Algorithm[J]. 数据分析与知识发现, 2022, 6(2/3): 396-408.
[15] Yan Dongmei, He Wenxin, Chen Zhi. Predicting Stock Prices Based on RoBERTa-TCN and Sentimental Characteristics[J]. 数据分析与知识发现, 2022, 6(12): 123-134.
  Copyright © 2016 Data Analysis and Knowledge Discovery   Tel/Fax:(010)82626611-6626,82624938   E-mail:jishu@mail.las.ac.cn