Current Trends in Signal Processing Review Article
A Study on Feature Subset Selection in Feature Streams of Dynamic Data
Abstract
As the use of real-time data with high dimensions continues to expand across various domains, selecting important features from the dataset is a key step to improve the predictive accuracy and time taken to build a machine learning model. In datasets where not all features are available at the same time and we are unaware of the total number of features, and features arrive at different time stamps, for example, in real-time patient monitoring in a hospital’s intensive care unit (ICU), feature selection becomes even more challenging. In an ICU, patients are continuously monitored using various medical instruments with sensors for monitoring heart rate, blood pressure, oxygen saturation, and electrocardiograms (ECG), etc.These devices stream data at different intervals, often providing updates asynchronously.
Keywords
References (24)
- Villa-Blanco C, Bielza C, Larrañaga P. Feature subset selection for data and feature streams: a review. Artificial Intelligence Review. 2023;56(S1):1011-1062. doi:10.1007/s10462-023-10546-9
- Wang J, Zhao P, Hoi SCH, Jin R. Online feature selection and its applications. IEEE Trans Knowl Data Eng. 2014;26(3):698–710.
- Patil DV, Bichkar RS. Issues in optimization of decision tree learning: A survey. Int J Appl Inf Syst. 2012;3:13-29.
- William P, Paithankar DN, Yawalkar PM, Korde SK, Rajendra A, Pabale, et al. Divination of Air Quality Assessment using Ensembling Machine Learning Approach. 2023 International Conference on Artificial Intelligence and Knowledge Discovery in Concurrent Engineering (ICECONF). 2023:1-10. doi:10.1109/iceconf57129.2023.10083751
- Perkins S, Theiler J. Online feature selection using grafting. Proceedings of the Twentieth International Conference on Machine Learning (ICML’03); 2003; Washington, DC, USA. AAAI Press; 2003. p. 592-9.
- Zhou J, Foster D, Stine R, Ungar L. Streaming feature selection using alpha-investing. Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining. 2005:384-393. doi:10.1145/1081870.1081914
- Wu X, Yu K, Wang H, Ding W. Online streaming feature selection. Proceedings of the 27th International Conference on Machine Learning (ICML’10); 2010; Haifa, Israel. Madison, WI: Omnipress; 2010. p. 1159-66.
- Hochma Y, Last M. Fast online feature selection in streaming data. Machine Learning. 2025;114(1). doi:10.1007/s10994-024-06712-x
- Yu K, Wu X, Ding W, Pei J. Scalable and Accurate Online Feature Selection for Big Data. ACM Transactions on Knowledge Discovery from Data. 2016;11(2):1-39. doi:10.1145/2976744
- Zhou P, Zhao S, Yan Y, Wu X. Online Scalable Streaming Feature Selection via Dynamic Decision. ACM Transactions on Knowledge Discovery from Data. 2022;16(5):1-20. doi:10.1145/3502737
- Almusallam N, Tari Z, Chan J, Fahad A, Alabdulatif A, Al-Naeem M. Towards an Unsupervised Feature Selection Method for Effective Dynamic Features. IEEE Access. 2021;9:77149-77163. doi:10.1109/access.2021.3082755
- Huan Liu, Setiono R. Chi2: feature selection and discretization of numeric attributes. Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence. 388-391. doi:10.1109/tai.1995.479783
- Zubaroğlu A, Atalay V. ata stream lusterin : A review. Artif ntell Rev. 2021;54:1201-36. doi:10.1007/s10462-020-09874-x.
- Zhou P, Hu X, Li P, Wu X. Online streaming feature selection using adapted Neighborhood Rough Set. Information Sciences. 2019;481:258-279. doi:10.1016/j.ins.2018.12.074
- Liu J, Lin Y, Du J, Zhang H, Chen Z, Zhang J. ASFS: A novel streaming feature selection for multi- label data based on neighborhood rough set. Appl Intell. 2023;53:1707-24. doi:10.1007/s10489- 022-03366-x.
- Zhou P, Zhang Y, Yan Y, Zhao S. Unknown Type Streaming Feature Selection via Maximal Information Coefficient. 2022 IEEE International Conference on Data Mining Workshops (ICDMW). 2022:650-657. doi:10.1109/icdmw58026.2022.00089
- Liu H, Setiono R. Feature selection via discretization. IEEE Trans Knowl Data Eng. 1997 Aug 31;9(4):642-5.
- Miller A. Subset Selection in Regression. 2002. doi:10.1201/9781420035933
- Hanchuan Peng, Fuhui Long, Ding C. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2005;27(8):1226-1238. doi:10.1109/tpami.2005.159
- Cover TM. Elements of Information Theory. New Jersey, US: John Wiley & Sons; 1999.
- Tibshirani R. Regression Shrinkage and Selection Via the Lasso. Journal of the Royal Statistical Society Series B: Statistical Methodology. 1996;58(1):267-288. doi:10.1111/j.2517-6161.1996.tb02080.x
- Breiman L. Random Forests. Machine Learning. 2001;45(1):5-32. doi:10.1023/a:1010933404324
- Sandhiya S, Palani U. A Novel HOSFS Algorithm for Online Streaming Feature Selection. 2020 International Conference on System, Computation, Automation and Networking (ICSCAN). 2020:1-6. doi:10.1109/icscan49426.2020.9262401
- Lundberg SM, Lee SI. A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS’17); 2017; Long Beach, California, USA. Curran Associates Inc.; 2017. p. 4768-77.