Current Trends in Signal Processing Review Article

A Study on Feature Subset Selection in Feature Streams of Dynamic Data

  1. Priyadarshini Department of Computer Engineering MET’s Institute of Engineering Bhujbal Knowledge City (BKC),Nashik
  2. Shirish S. Sane Department of Computer Engineering, Gokhale’s Education Society R H Sapat College of Engineering, Nashik

Abstract

As the use of real-time data with high dimensions continues to expand across various domains, selecting important features from the dataset is a key step to improve the predictive accuracy and time taken to build a machine learning model. In datasets where not all features are available at the same time and we are unaware of the total number of features, and features arrive at different time stamps, for example, in real-time patient monitoring in a hospital’s intensive care unit (ICU), feature selection becomes even more challenging. In an ICU, patients are continuously monitored using various medical instruments with sensors for monitoring heart rate, blood pressure, oxygen saturation, and electrocardiograms (ECG), etc.These devices stream data at different intervals, often providing updates asynchronously.

Keywords

References (24)

  1. Villa-Blanco C, Bielza C, Larrañaga P. Feature subset selection for data and feature streams: a review. Artificial Intelligence Review. 2023;56(S1):1011-1062. doi:10.1007/s10462-023-10546-9
  2. Wang J, Zhao P, Hoi SCH, Jin R. Online feature selection and its applications. IEEE Trans Knowl Data Eng. 2014;26(3):698–710.
  3. Patil DV, Bichkar RS. Issues in optimization of decision tree learning: A survey. Int J Appl Inf Syst. 2012;3:13-29.
  4. William P, Paithankar DN, Yawalkar PM, Korde SK, Rajendra A, Pabale, et al. Divination of Air Quality Assessment using Ensembling Machine Learning Approach. 2023 International Conference on Artificial Intelligence and Knowledge Discovery in Concurrent Engineering (ICECONF). 2023:1-10. doi:10.1109/iceconf57129.2023.10083751
  5. Perkins S, Theiler J. Online feature selection using grafting. Proceedings of the Twentieth International Conference on Machine Learning (ICML’03); 2003; Washington, DC, USA. AAAI Press; 2003. p. 592-9.
  6. Zhou J, Foster D, Stine R, Ungar L. Streaming feature selection using alpha-investing. Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining. 2005:384-393. doi:10.1145/1081870.1081914
  7. Wu X, Yu K, Wang H, Ding W. Online streaming feature selection. Proceedings of the 27th International Conference on Machine Learning (ICML’10); 2010; Haifa, Israel. Madison, WI: Omnipress; 2010. p. 1159-66.
  8. Hochma Y, Last M. Fast online feature selection in streaming data. Machine Learning. 2025;114(1). doi:10.1007/s10994-024-06712-x
  9. Yu K, Wu X, Ding W, Pei J. Scalable and Accurate Online Feature Selection for Big Data. ACM Transactions on Knowledge Discovery from Data. 2016;11(2):1-39. doi:10.1145/2976744
  10. Zhou P, Zhao S, Yan Y, Wu X. Online Scalable Streaming Feature Selection via Dynamic Decision. ACM Transactions on Knowledge Discovery from Data. 2022;16(5):1-20. doi:10.1145/3502737
  11. Almusallam N, Tari Z, Chan J, Fahad A, Alabdulatif A, Al-Naeem M. Towards an Unsupervised Feature Selection Method for Effective Dynamic Features. IEEE Access. 2021;9:77149-77163. doi:10.1109/access.2021.3082755
  12. Huan Liu, Setiono R. Chi2: feature selection and discretization of numeric attributes. Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence. 388-391. doi:10.1109/tai.1995.479783
  13. Zubaroğlu A, Atalay V. ata stream lusterin : A review. Artif ntell Rev. 2021;54:1201-36. doi:10.1007/s10462-020-09874-x.
  14. Zhou P, Hu X, Li P, Wu X. Online streaming feature selection using adapted Neighborhood Rough Set. Information Sciences. 2019;481:258-279. doi:10.1016/j.ins.2018.12.074
  15. Liu J, Lin Y, Du J, Zhang H, Chen Z, Zhang J. ASFS: A novel streaming feature selection for multi- label data based on neighborhood rough set. Appl Intell. 2023;53:1707-24. doi:10.1007/s10489- 022-03366-x.
  16. Zhou P, Zhang Y, Yan Y, Zhao S. Unknown Type Streaming Feature Selection via Maximal Information Coefficient. 2022 IEEE International Conference on Data Mining Workshops (ICDMW). 2022:650-657. doi:10.1109/icdmw58026.2022.00089
  17. Liu H, Setiono R. Feature selection via discretization. IEEE Trans Knowl Data Eng. 1997 Aug 31;9(4):642-5.
  18. Miller A. Subset Selection in Regression. 2002. doi:10.1201/9781420035933
  19. Hanchuan Peng, Fuhui Long, Ding C. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2005;27(8):1226-1238. doi:10.1109/tpami.2005.159
  20. Cover TM. Elements of Information Theory. New Jersey, US: John Wiley & Sons; 1999.
  21. Tibshirani R. Regression Shrinkage and Selection Via the Lasso. Journal of the Royal Statistical Society Series B: Statistical Methodology. 1996;58(1):267-288. doi:10.1111/j.2517-6161.1996.tb02080.x
  22. Breiman L. Random Forests. Machine Learning. 2001;45(1):5-32. doi:10.1023/a:1010933404324
  23. Sandhiya S, Palani U. A Novel HOSFS Algorithm for Online Streaming Feature Selection. 2020 International Conference on System, Computation, Automation and Networking (ICSCAN). 2020:1-6. doi:10.1109/icscan49426.2020.9262401
  24. Lundberg SM, Lee SI. A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS’17); 2017; Long Beach, California, USA. Curran Associates Inc.; 2017. p. 4768-77.
Support