1School of Management, Jilin University, Changchun 130022, China 2Center for Information Resources Research, Jilin University, Changchun 130022, China 3School of Computer Science and Technology, Beihua University, Jilin 132021, China
[Objective] This paper reviews the methods, developing trends and applications of attribute reduction, aiming to support systematic research in this field.[Coverage] From the Web of Science and CNKI, we retrieved 142 articles on attribute reduction, using the keywords of “Attribute Reduction” and “属性约简”. We also optimized the results with topic selection, intensive reading and retrospective method.[Methods] We surveyed the fundamentals of attribute reduction, and then summarized its leading research.[Results] The popular research of attribute reduction methods focused on rough sets, granular computing and formal concept analysis. Its developing trends were closely related to the dynamics of data and the fusion of intelligent algorithms.[Limitations] We only briefly discussed the merging of attribute reduction algorithms.[Conclusions] We explored the developing trends of attribute reduction methods.
Lin K C, Zhang K Y, Huang Y H , et al. Feature Selection Based on an Improved Cat Swarm Optimization Algorithm for Big Data Classification[J]. Journal of Supercomputing, 2016,72(8):3210-3221.
[2]
Yao Y, Zhao Y . Attribute Reduction in Decision-Theoretic Rough Set Models[J]. Information Sciences, 2008,178(17):3356-3373.
[3]
Wong S K M, Ziarko W . On Optimal Decision Rules in Decision Tables[J]. Bulletin of the Polish Academy of Sciences Mathematics, 1985,33(11-12):693-696.
( Tan Zhanglu, Peng Shengnan, Wang Zhaogang . Research on Hotspots and Trends of Domestic Text Mining Based on Cluster Analysis[J]. Journal of the China Society for Scientific and Technical Information, 2019,38(6):578-585.)
[5]
Abdolrazzagh-Nezhad M . Enhanced Cultural Algorithm to Solve Multi-objective Attribute Reduction Based on Rough Set Theory[J]. Mathematics and Computers in Simulation, 2020,170:332-350.
[6]
Yao Y. Three-Way Decision: An Interpretation of Rules in Rough Set Theory [C]// Proceedings of the 2009 International Conference on Rough Sets and Knowledge Technology. Springer Berlin Heidelberg, 2009: 642-649.
[7]
Zadeh L A . Toward a Theory of Fuzzy Information Granulation and Its Centrality in Human Reasoning and Fuzzy Logic[J]. Fuzzy Sets & Systems, 1997,90:111-127.
[8]
Li J, Huang C, Qi J , et al. Three-Way Cognitive Concept Learning via Multi-Granularity[J]. Information Sciences, 2017,378:244-263.
( Yao Yiyu, Qi Jianjun, Wei Ling . Formal Concept Analysis, Rough Set Analysis and Granular Computing Based on Three-Way Decisions[J]. Journal of Northwest University: Natural Science Edition, 2018,48(4):477-487.)
[10]
Ganter B, Godin R . Formal Concept Analysis[M]. Springer Berlin Heidelberg, 1999.
( Li Jinjin, Zhang Yanlan, Wu Weizhi , et al. Attribute Reduction for Formal Context and Consistent Decision Formal Context and Concept Lattice Generation[J]. Chinese Journal of Computers, 2014,37(8):1768-1774.)
[14]
Chen D, Wang C, Hu Q . A New Approach to Attribute Reduction of Consistent and Inconsistent Covering Decision Systems with Covering Rough Sets[J]. Information Sciences, 2007,177(17):3500-3518.
[15]
Katzberg J D, Ziarko W . Variable Precision Extension of Rough Sets[J]. Fundamenta Informaticae, 1996,27(2-3):155-168.
[16]
Lin T Y . Granular Computing on Binary Relations I: Data Mining and Neighborhood Systems[J]. Rough Sets in Knowledge Discovery, 1998,1:107-121.
[17]
Jia X, Liao W, Tang Z , et al. Minimum Cost Attribute Reduction in Decision-Theoretic Rough Set Models[J]. Information Sciences, 2013,219(1):151-167.
( Miao Duoqian, Wang Jue . An Information Representation of the Concepts and Operations in Rough Set Theory[J]. Journal of Software, 1999,10(2):113-116.)
[19]
Skowron A, Rauszer C . The Discernibility Matrices and Functions in Information Systems[A]// Intelligent Decision Support. Theory and Decision Library[M]. Springer, 1992,11:331-362.
[20]
Pawlak Z . Rough Sets[J]. International Journal of Computer and Information Science, 1982,11(5):341-356.
( Wu Shangzhi, Gou Pingzhang . Attribute Reduction Algorithm on Rough Set and Information Entropy and Its Application[J]. Computer Engineering, 2011,37(7):56-58.)
[22]
Wang G Y, Zhao J, An J J, et al. Theoretical Study on Attribute Reduction of Rough Set Theory: Comparison of Algebra and Information Views [C]// Proceedings of the IEEE International Conference on Cognitive Informatics. IEEE, 2004: 148-155.
( Chen Yuan, Yang Dong . Attribute Reduction Algorithm Based on Information Entropy and Its Application[J]. Journal of Chongqing University of Technology: Natural Science, 2013,27(1):42-46.)
[24]
马斌斌 . 基于多重奇异值分解熵的属性约简方法研究及应用[D]. 合肥: 安徽大学, 2017.
[24]
( Ma Binbin . Research on Attribute Reduction Based on Multi-scales Singular Value Decomposition Entropy and Its Application[D]. Hefei: Anhui University, 2017.)
( Tao Wusha, Teng Shuhua, Sun Jixiang , et al. Study on Uncertainty Measure Based on General Binary Relation[J]. Journal of National University of Defense Technology, 2011,33(2):63-67.)
( Teng Shuhua, Lu Min, Yang Afeng , et al. A Weighted Uncertainty Measure of Rough Sets Based on General Binary Relation[J]. Chinese Journal of Computers, 2014,37(3):649-665.)
[27]
Felix R, Ushio T. Rough Sets-Based Machine Learning Using a Binary Discernibility Matrix [C]// Proceedings of the 2nd International Conference on Intelligent Processing and Manufacturing of Materials. IEEE, 1999,1:299-305.
( Yang Chuanjian, Ge Hao, Li Longshu . Attribute Reduction of Vertically Partitioned Binary Discernible Matrix[J]. Control and Decision, 2013,28(4):563-568.)
( Wu Shouling, Yang Ying, Yang Lei , et al. Study of Decision Table Attribute Reduction Methods Based on Rough Set[J]. Computer Technology and Development, 2012,22(1):32-35.)
( Deng Dayong, Li Ya’nan, Xue Huanhuan . Attribute Reduction of Various Positive Region Based on Rough Sets[J]. Journal of Zhejiang Normal University: Natural Sciences, 2016,39(3):294-297.)
( Xu Zhangyan, Liu Zuopeng, Yang Bingru , et al. A Quick Attribute Reduction Algorithm with Complexity of max(O(|C||U|),O(|C|2|U/C|))[J]. Chinese Journal of Computers, 2006,29(3):391-399.)
( Ge Hao, Li Longshu, Yang Chuanjian . Improvement to Quick Attribution Reduction Algorithm[J]. Journal of Chinese Computer Systems, 2009,30(2):308-312.)
( Chen Zhien, Ma Xu . Rules Extraction Method of Information System Based on Granular Computing[J]. Journal of Northwest Normal University: Natural Science, 2018,54(4):11-15.)
[34]
杨正华 . 基于商空间的粒计算模型研究[D]. 长沙:中南大学, 2012.
[34]
( Yang Zhenghua . Research on Granular Computing Model Based on Quotient Space[D]. Changsha: Central South University, 2012.)
[35]
Yao Y Y . A Partition Model of Granular Computing[A]// Transactions on Rough Sets I. Lecture Notes in Computer Science[M]. Springer, 2004.
( Zhang Wenxiu, Wei Ling, Qi Jianjun . Attribute Reduction Theory and Method of Concept Lattice[J]. Science in China: Series E, 2005,35(6):628-639.)
[41]
Zhang W, Wei L, Qi J . Attribute Reduction Theory and Approach to Concept Lattice[J]. Science in China Series F: Information Sciences, 2005,48(6):713-726.
[42]
张文修, 仇国芳 . 基于粗糙集的不确定决策[M]. 北京: 清华大学出版社, 2005.
[42]
( Zhang Wenxiu, Qiu Guofang. Uncertain Decision Making Based on Rough Set[M]. Beijing: Tsinghua University Press, 2005.)
[43]
Li J, Mei C, Lv Y . Knowledge Reduction in Decision Formal Contexts[J]. Knowledge-Based Systems, 2011,24(5):709-715.
[44]
Wang H, Zhang W X . Approaches to Knowledge Reduction in Generalized Consistent Decision Formal Context[J]. Mathematical & Computer Modelling, 2008,48(11-12):1677-1684.
( Wei Ling, Qi Jianjun, Zhang Wenxiu . Conceptual Lattice Attribute Reduction of Decision-Making Formal Background[J]. Science in China: Series E, 2008,38(2):195-208.)
[46]
Belohlavek R, Vychodil V. Reducing the Size of Fuzzy Concept Lattices by Hedges [C]// Proceedings of the 14th IEEE International Conference on Fuzzy Systems. IEEE, 2005: 663-668.
[47]
丁棉卫 . 基于二进制区分矩阵的增量式知识约简算法研究[D]. 南京: 南京邮电大学, 2017.
[47]
( Ding Mianwei . Research on Incremental Knowledge Reduction Algorithm Based on Binary Discernibility Matrix[D]. Nanjing: Nanjing University of Posts and Telecommunications, 2017.)
[48]
Wei W, Wu X, Liang J , et al. Discernibility Matrix Based Incremental Attribute Reduction for Dynamic Data[J]. Knowledge-Based Systems, 2018,140:142-157.
[49]
Wang J, Wang J . Reduction Algorithms Based on Discernibility Matrix: The Ordered Attributes Method[J]. Journal of Computer Science and Technology, 2001,16(6):489-504.
[50]
Liang J, Wang F, Dang C , et al. A Group Incremental Approach to Feature Selection Applying Rough Set Technique[J]. IEEE Transaction on Knowledge and Data Engineering, 2014,26(2):294-308.
[51]
Shu W, Qian W . An Incremental Approach to Attribute Reduction from Dynamic Incomplete Decision Systems in Rough Set Theory[J]. Data & Knowledge Engineering, 2015,100:116-132.
[52]
Jing Y, Li T, Fujita H , et al. An Incremental Attribute Reduction Approach Based on Knowledge Granularity with a Multi-Granulation View[J]. Information Sciences, 2017,411:23-38.
( Shen Xuefen . The Research on Incremental Learning Algorithm Based on Neighborhood Rough Sets and Application in Customer Classification[D]. Taiyuan: Taiyuan University of Technology, 2014.)
[54]
Wang F, Liang J, Qian Y . Attribute Reduction: A Dimension Incremental Strategy[J]. Knowledge-Based Systems, 2013,39(2):95-108.
[55]
景运革 . 基于知识粒度的动态属性约简算法研究[D]. 成都: 西南交通大学, 2017.
[55]
( Jing Yunge . Research on Approaches of Dynamic Attribute Reduction Based on Knowledge Granularity[D]. Chengdu: Southwest Jiaotong University, 2017.)
[56]
Wang F, Liang J, Dang C . Attribute Reduction for Dynamic Data Sets[J]. Applied Soft Computing, 2013,13(1):676-689.
( Wang Lei, Hong Zhiquan, Wan Ni . Research on Matrix-Based Incremental Method for Updating Approximations Under Variation of Attribute Values in Variable Precision Rough Set[J]. Application Research of Computers, 2013,30(7):2010-2013.)
( Ji Xiaolan, Li Tianrui, Zou Weili , et al. Analysis of Approximations Under Dominance Relation During Attribute Values Coarsening and Refining[J]. Computer Engineering, 2010,36(12):33-35,42.)
[59]
Kusiak A . Decomposition in Data Mining: An Industrial Case Study[J]. IEEE Transactions on Electronics Packaging Manufacturing, 2000,23(4):345-353.
( Ji Suqin, Shi Hongbo, Lv Yali . An Attribute Reduction Algorithm Based on Granular Computing and Discernibility[J]. Pattern Recognition and Artificial Intelligence, 2015,28(4):327-334.)
[61]
Yang Y, Chen Z, Liang Z, et al. Attribute Reduction for Massive Data Based on Rough Set Theory and MapReduce [C]// Proceedings of the 2010 International Conference on Rough Set and Knowledge Technology. Springer Berlin Heidelberg, 2010: 672-678.
[62]
刘柳明 . 基于粗糙集的决策信息系统分解研究[D]. 长沙: 中南大学, 2007.
[62]
( Liu Liuming . Research on Decomposition of Decision Information System Based on Rough Set Theory[D]. Changsha: Central South University, 2007.)
( Xiao Dawei, Wang Guoyin, Hu Feng . Fast Parallel Attribute Reduction Algorithm Based on Rough Set Theory[J]. Computer Science, 2009,36(3):208-211.)
[64]
Deng D Y, Wang J Y, Li X J. Parallel Reducts in a Series of Decision Subsystems [C]// Proceedings of the 2009 International Joint Conference on Computational Sciences and Optimization. IEEE, 2009,2:377-380.
[65]
Liang J, Wang F, Dang C , et al. An Efficient Rough Feature Selection Algorithm with a Multi-Granulation View[J]. International Journal of Approximate Reasoning, 2012,53(6):912-926.
[66]
Dean J, Ghemawat S . MapReduce: Simplified Data Processing on Large Clusters[J]. Communications of the ACM, 2008,51(1):107-113.
[67]
李朋 . 基于云计算的粗糙集属性约简的研究[D]. 沈阳: 沈阳师范大学, 2015.
[67]
( Li Peng . Study on the Attribute Reduction of Rough Set Based on Cloud Computing[D]. Shenyang: Shenyang Normal University, 2015.)
( Wu Jianyang . Rough Set Attribute Reduction Research Based on Canonical Correlation Analysis Algorithm and the Parallelization[D]. Nanjing: Nanjing University, 2014.)
[69]
Hu Q, Zhang L, Zhou Y , et al. Large-Scale Multi-Modality Attribute Reduction with Multi-Kernel Fuzzy Rough Sets[J]. IEEE Transactions on Fuzzy Systems, 2017,26(1):226-238.
[70]
周威光 . 粗糙集理论处理海量电子病历的研究与应用[D]. 杭州: 浙江理工大学, 2017.
[70]
( Zhou Weiguang . Research and Application of Rough Set Theory in Dealing with Massive Electronic Medical Records[D]. Hangzhou: Zhejiang Sci-Tech University, 2017.)
( Qi Chenhong . Research on Classification Technology of Breast Disease Data and Application Based on Attribute Reduction[D]. Lanzhou: Lanzhou Jiaotong University, 2015.)
( Rao Hong, Xia Yejuan, Li Meizhu . Algorithm for Rule Extraction Based on Discernibility Matrix and Attribute Significance[J]. Computer Engineering and Applications, 2008,44(23):163-165.)
( Qu Chaoyang, Chen Shuai, Yang Fan , et al. An Attribute Reducing Method for Electric Power Big Data Preprocessing Based on Cloud Computing Technology[J]. Automation of Electric Power Systems, 2014,38(8):67-71.)
( Li Ping . Research on the Teaching Quality Evaluation System Based on Attribute Reduction of Conditional Information Entropy[J]. Journal of Chifeng University: Natural Science Edition, 2017,33(4):205-206.)
( Chen Yang, Zuo Shan . Library Information Resources Evaluation Based on Rough Set Conditional Information Entropy[J]. Journal of Modern Information, 2014,34(3):47-50.)
( Gao Tian, Du Junping, Wang Su . Tourism Emergency Attribute Reduction Based on Rough Set[J]. Journal of Southeast University: Natural Science Edition, 2009,39(S1):163-167.)
( Wu Xuelian, Sun Bingyu, Li Wenbo , et al. Relief Food Demand Forecast Based on Rough Set and Case-based Reasoning[J]. Computer Engineering, 2012,38(9):158-161.)
( Zhong Qiuyan, Wang Ran, Qu Yi . A Method of Attribute Reduction for Emergency Based on Rough Set[J]. Operations Research and Management Science, 2018,27(1):89-95.)
( Wu Yunlong, Liu Danlong, Wang Haoran , et al. Reduction of Risk Assessment Indexes for Mine Fire Based on Skowron Discernibility Matrix of Rough Set Theory[J]. Journal of Safety Science and Technology, 2016,12(5):60-65.)
( Chen Xu, Jiang Chaohui . Reduction of Security Assessment Indexes for Cloud Computing Based on Differential Matrix of Rough Set Theory[J]. Communications Technology, 2018,51(4):919-923.)
( Liu Jie . The Application of Reduction Improvement Algorithm in Enterprise Competitive Power Indicator System Construction Based on Information Granulation[J]. China Management Informatization, 2008,11(15):98-100.)
( Zhang Min . A Study of the Attribute Reduction in the Real Valued Decision Table Based on Rough Set Theory[D]. Beijing: North China Electric Power University, 2015.)
( Chen Xi, Lei Jian, Fu Ming . Attribute Reduction Algorithm for Rough Set Based on Improving Genetic Algorithm[J]. Computer Engineering and Design, 2010,31(3):602-604,608.)
( Li Yulong, Zhang Yaguang, Bi Congcong . An Attribute Reduction Algorithm for Rough Set Based on Improving Genetic Algorithm[J]. Computer and Digital Engineering, 2014,42(10):1831-1834.)
[85]
Jia X, Liao W, Tang Z , et al. Minimum Cost Attribute Reduction in Decision-Theoretic Rough Set Models[J]. Information Sciences, 2013,219(1):151-167.
[86]
陈晨 . 基于模糊聚类和粗糙集的连续值属性约简研究[D]. 北京: 首都经济贸易大学, 2016.
[86]
( Chen Chen . Research on Continuous Value Attribute Reduction Based on Fuzzy Clustering and Rough Set[D]. Beijing: Capital University of Economics and Business, 2016.)
[87]
Jensen R, Shen Q. Finding Rough Set Reducts with Ant Colony Optimization [C]// Proceedings of the 2003 UK Workshop on Computational Intelligence. 2003.
[88]
Chen Y, Miao D, Wang R . A Rough Set Approach to Feature Selection Based on Ant Colony Optimization[J]. Pattern Recognition Letters, 2010,31(3):226-233.
( Chen Yingyue, Chen Yuming . Attribute Reduction Algorithm Based on Information Entropy and Ant Colony Optimization[J]. Journal of Chinese Computer Systems, 2015,36(3):586-590.)