STM Journals Peer-reviewed research from Consortium e-Learning Network

International Journal of Bioinformatics and Computational Biology Review Article

Combining Unstructured and Structured Clinical Data in a Hybrid Transformer Model to Enhance Cardiovascular Analytics and Clinical Decision- Making

  1. Kalyani Neve MCA Dept, G H Raisoni College of Engineering and Management, Jalgaon
  2. Dr. Padma Mishra Thakur Institute of Management Studies, Career Development & Research
  3. Karishma Chaudhari G H Raisoni College of Engineering and Management, Jalgaon
  4. Dr I. D. Paul Mechanical Engineering S.S.G.B, Bhusawal

Abstract

Since cardiovascular disease (CVD) continues to be a major global cause of morbidity and mortality, early and accurate risk prediction is essential for prompt intervention and individualized treatment. This study introduces a new hybrid transformer-based model that combines unstructured clinical narratives, structured data, and customized lifestyle characteristics. A comprehensive understanding of disease progression is made possible by the model's ability to capture contextual, temporal, and patient- specific insights through the use of transformer architectures and sophisticated natural language processing. Clinical interpretability and transparency are guaranteed by a special explainability module. Our method combines insights from deep learning, statistical modeling, and graph-based temporal embeddings to improve prediction accuracy and clinical relevance, building on significant advancements in time-aware LSTMs, hybrid modeling, self-attention transformers, and automated machine learning from previous works [1–20]. Assessed using reference datasets, the model The model outperformed both conventional and cutting- edge methods on benchmark datasets, obtaining a Precision@5 of 78.65%, an AUC of 0.86, and an F1- score of 0.76. Its exceptional performance across comorbid conditions and demographic groups demonstrates its generalizability and practicality. This hybrid framework, which seamlessly integrates various data modalities for actionable and equitable CVD risk prediction, is a prime example of the future of predictive analytics in healthcare and advances precision medicine.

Keywords

References (32)

  1. Johnson, A. E., Pollard, T. J., Shen, L., et al. (2016). MIMIC-III, a freely accessible critical care database.
  2. Scientific Data, 3, 160035. doi:10.1038/sdata.2016.35
  3. Huang, K., Altosaar, J., & Ranganath, R. (2019).
  4. ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission. arXiv preprint arXiv:1904.05342.
  5. Rajkomar A, Oren E, Chen K, Dai AM, Hajaj N, Hardt M, et al. Scalable and accurate deep learning with electronic health records. npj Digital Medicine. 2018;1(1). doi:10.1038/s41746-018-0029-1
  6. Baytas, I. M., Xiao, C., Zhang, X., Wang, F., et al.(2017). Patient Subtyping via Time-Aware LSTM Models. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
  7. Wang, S., et al. (2019). BiteNet: Bidirectional Encoder Network for Future Clinical Event Prediction. IEEE Transactions on Neural Networks and Learning Systems.
  8. Peng, J., et al. (2020). Transforming clinical event prediction with self-attention mechanism-based transformers. Journal of Biomedical Informatics.
  9. Zhang, Z., et al. (2021). Hybrid models for healthcare prediction: combining ICD codes with clinical narratives. Journal of Medical Systems. doi:10.1007/s10916-021-01630-x.
  10. Rajkomar A, Oren E, Chen K, Dai AM, Hajaj N, Hardt M, et al. Scalable and accurate deep learning with electronic health records. npj Digital Medicine. 2018;1(1). doi:10.1038/s41746-018-0029-1
  11. Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2016). Learning to diagnose with LSTM recurrent neural networks. arXiv preprint. doi:10.48550/arXiv.1706.03762.
  12. Choi, E., Bahadori, M. T., Schuetz, A., Stewart, W. F., & Sun, J. (2016). Doctor AI: Predicting clinical events via recurrent neural networks. Machine Learning for Healthcare Conference.
  13. Vaswani, A., Shazeer, N., Parmar, N., et al. (2017). Attention is all you need. Advances in Neural Information Processing Systems. doi:10.48550/arXiv.1706.03762.
  14. Miotto R, Wang F, Wang S, Jiang X, Dudley JT. Deep learning for healthcare: review, opportunities and challenges. Briefings in Bioinformatics. 2017;19(6):1236-1246. doi:10.1093/bib/bbx044
  15. Alaa AM, Bolton T, Di Angelantonio E, Rudd JHF, van der Schaar M. Cardiovascular disease risk prediction using automated machine learning: A prospective study of 423,604 UK Biobank participants. PLOS ONE. 2019;14(5):e0213653. doi:10.1371/journal.pone.0213653
  16. Stevens, D., Lane, D. A., Harrison, S. L., Lip, G. Y. H., & Kolamunnage-Dona, R. (2021). Modelling of longitudinal data to predict cardiovascular disease risk: A methodological review. BMC Medical Research Methodology. doi:10.1186/s12874-021- 01288-4.
  17. Vishnu Vardhana Reddy Karna, et al. (2024). A Comprehensive Review on Heart Disease Risk Prediction using Machine Learning and Deep Learning Algorithms. Archives of Computational Methods in Engineering.
  18. Lee, S., et al. (2021). Attention-based models for cardiovascular disease prediction: A hybrid approach. IEEE Journal of Biomedical and Health Informatics.
  19. Hochreiter S, Schmidhuber J. Long Short-Term Memory. Neural Computation. 1997;9(8):1735-1780. doi:10.1162/neco.1997.9.8.1735
  20. Esteban, C., et al. (2016). Predicting clinical events by combining static and dynamic data in LSTM models. PLOS ONE. doi:10.1371/journal.pone.0146251.
  21. Zhang, Y., et al. (2020). THIGE: Temporal Heterogeneous Interaction Graph Embedding for Health Data Analysis. Neural Networks and Applications.
  22. Cai, Y., et al. (2024). Artificial intelligence in the risk prediction models of cardiovascular disease and development of an independent validation screening tool: A systematic review. BMC Medicine. doi:10.1186/s12916-024-02835-z.
  23. Deepa, R., et al. (2024). Early prediction of cardiovascular disease using machine learning: Unveiling risk factors from health records. AIP Advances. doi:10.1063/1.5128374.
  24. Miotto, R., et al. (2016). Deep Patient: An unsupervised representation to predict the future of patients from electronic health records. Scientific Reports
  25. Sudlow et al., “UK Biobank: An Open Access Resource for Identifying the Causes of a Wide Range of Complex Diseases of Middle and Old Age,” PLoS Med., vol. 12, no. 3, p. e1001779, Mar. 2015. Available: https://www.ukbiobank.ac.uk/enable- your-research/apply-for-access
  26. B. Kannel et al., “An Investigation of Coronary Heart Disease in Families: The Framingham Offspring Study,” Am. J. Epidemiol., vol. 110, no. 3, pp. 281–290, Sep. 1979. Available: https://biolincc.nhlbi.nih.gov/studies/framcohort/.
  27. Gerela P, Mishra PN, Vipat R. Study on data visualization. International journal of health sciences. 2022:6298-6305. doi:10.53730/ijhs.v6ns3.7393
  28. Mishra PN, Gerala P, Maitra S. Study on artificial intelligence applications uses in agriculture. International journal of health sciences. 2022:9162-9173. doi:10.53730/ijhs.v6ns2.7391
  29. Basavaraj GN, Ainapure B, Sowmya MR, Sandeep C, Mishra PN, Lakkimsetty NR, et al. Machine Learning-enhanced Direction-of-Arrival Estimation for Coherent and Non-Coherent Sources. Engineering, Technology & Applied Science Research. 2025;15(2):20647-20652. doi:10.48084/etasr.9494
  30. Mishra, P., Gaikwad, V., Dhawan, A., Bagul, R., Shaikh, A., & Singh, R. (2025). Precision agriculture meets AI: Predicting nutritional crop outcomes from genomic data. International Journal of Environmental Sciences, 11(14S), 207–218. https://www.theaspd.com/ijes.php
  31. Ahmad E, Dash B, Tripathi A, Mishra P, Manjunath TC, Sethi KC. Hybrid CNN and image processing framework for precise characterization of cracks in concrete structures. Asian Journal of Civil Engineering. 2025;27(2):815-828. doi:10.1007/s42107-025-01535-0
  32. AI-Enabled Early Detection of Fetal Gestational Age and CNS Anomalies in the First Trimester through Ultrasound to Support Rural Doctors in India. International Journal of Electronics and Communication Engineering. 2025;12(7). doi:10.14445/23488549/ijece-v12i7p113