CME-Insights: A Cognitive Multimodal Explainability Framework for Credit Risk Assessment Using SEC Financial Filings

Authors

  • Ankur Agarwal Sam Higginbottom University of Agriculture, Technology and Sciences
  • Shashi Prabha Sam Higginbottom University of Agriculture, Technology and Sciences
  • Raghav Yadav Sam Higginbottom University of Agriculture, Technology and Sciences

DOI:

https://doi.org/10.29207/resti.v10i5.7678

Keywords:

cognitive analytics, credit risk modelling, explainable AI, multimodal machine learning

Abstract

In financial data analysis, credit risk assessment has traditionally depended on financial ratios. However, a lot of useful information is hidden in company reports, especially in the textual sections. Most of the financial analytics models do not utilize the textual features of financial data. To address this gap, this work proposes the Cognitive Analytics, Multimodal and Explainability (CME-Insights) framework, which is designed to provide clear and data-driven support for financial decision making. The proposed approach combines numerical financial indicators and textual information from the Management Discussion and Analysis (MD&A) sections. These two modalities of data are extracted from SEC 10-K and 10-Q reports. The structured financial modality is drawn from a publicly available corporate credit rating dataset comprising 2,029 records. The model uses 25 financial features along with 11 text-based features. These text features capture characteristics such as sentiment, uncertainty, risk, legal tone, and readability. Loughran-McDonald financial dictionary and the VADER sentiment model are used to extract these features. The best results came from a stacked model that combines CatBoost, LightGBM, and Random Forest base learners with a Logistic Regression meta-classifier. This model achieved an accuracy of 89.36% when ticker symbols were included, and 86.24% without them. SHAP and LIME explainability approaches indicated that the features such as debt ratio and operating cash flow per share play a key role in predicting credit risk. Thus, the CME-Insights framework delivers more accurate and explainable credit risk assessment than traditional financial-ratio-only approaches.



Downloads

Download data is not yet available.

References

[1] I. H. Sarker, “Data Science and Analytics: An Overview from Data-Driven Smart Computing, Decision-Making and Applications Perspective,” SN Comput. Sci., vol. 2, no. 5, p. 377, 2021, doi: 10.1007/s42979-021-00765-8.

[2] V. Ravi and S. Kamaruddin, “Big Data Analytics Enabled Smart Financial Services: Opportunities and Challenges BT - Big Data Analytics,” P. K. Reddy, A. Sureka, S. Chakravarthy, and S. Bhalla, Eds., Cham: Springer International Publishing, 2017, pp. 15–39. doi: https://doi.org/10.1007/978-3-319-72413-3_2.

[3] Institute of International Finance (IIF), “Global Debt Monitor: In Search of Sustainability,” IIF, Washington, 2023. [Online]. Available: https://www.iif.com/portals/0/Files/content/Global Debt Monitor_Sept2023_vf.pdf

[4] E. I. Altman, “Financial Ratios, Discriminant Analysis and the Prediction of Corporate Bankruptcy,” J. Finance, vol. 23, no. 4, pp. 589–609, Sep. 1968, doi: https://doi.org/10.1111/j.1540-6261.1968.tb00843.x.

[5] R. A. Mancisidor, M. Kampffmeyer, K. Aas, and R. Jenssen, “Generating customer’s credit behavior with deep generative models,” Knowledge-Based Syst., vol. 245, p. 108568, 2022, doi: https://doi.org/10.1016/j.knosys.2022.108568.

[6] D. Broby, “The use of predictive analytics in finance,” J. Financ. Data Sci., vol. 8, pp. 145–161, 2022, doi: https://doi.org/10.1016/j.jfds.2022.05.003.

[7] N. Hajiheydari, M. S. Delgosha, Y. Wang, and H. Olya, “Exploring the paths to big data analytics implementation success in banking and financial service: an integrated approach,” Ind. Manag. Data Syst., vol. 121, no. 12, pp. 2498–2529, 2021, doi: 10.1108/IMDS-04-2021-0209.

[8] W. H. Beaver, “Financial Ratios As Predictors of Failure,” J. Account. Res., vol. 4, pp. 71–111, Oct. 1966, doi: 10.2307/2490171.

[9] J. A. Ohlson, “Financial Ratios and the Probabilistic Prediction of Bankruptcy,” J. Account. Res., vol. 18, no. 1, pp. 109–131, Oct. 1980, doi: 10.2307/2490395.

[10] E. Demers, “The Impact of Credibility on the Pricing of Managerial Textual Content *,” SSRN, no. June, 2014, doi: Demers, Elizabeth and Vega, Clara, The Impact of Credibility on the Pricing of Managerial Textual Content (June 6, 2014). Available at SSRN: https://ssrn.com/abstract=1153450 or http://dx.doi.org/10.2139/ssrn.1153450.

[11] G. Dicuonzo, G. Galeone, E. Zappimbulso, and V. Dell’Atti, “Risk Management 4.0: The Role of Big Data Analytics in the Bank Sector,” Int. J. Econ. Financ. Issues, vol. 9, no. 6 SE-Articles, pp. 40–47, Oct. 2019, [Online]. Available: https://www.econjournals.com/index.php/ijefi/article/view/8556

[12] T. Loughran and B. Mcdonald, “When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10-Ks,” J. Finance, vol. 66, no. 1, pp. 35–65, Feb. 2011, doi: https://doi.org/10.1111/j.1540-6261.2010.01625.x.

[13] T. Loughran and B. Mcdonald, “Measuring Readability in Financial Disclosures,” J. Finance, vol. 69, no. 4, pp. 1643–1671, Aug. 2014, doi: https://doi.org/10.1111/jofi.12162.

[14] C. V Nguyen et al., “Multimodal Machine Learning for Credit Modeling,” in 2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC), 2021, pp. 1754–1759. doi: 10.1109/COMPSAC51774.2021.00262.

[15] Y. Ye, S. Liu, and J. Li, “A Multiclass Machine Learning Approach to Credit Rating Prediction,” in 2008 International Symposiums on Information Processing, 2008, pp. 57–61. doi: 10.1109/ISIP.2008.37.

[16] F. S. Khan, S. S. Mazhar, K. Mazhar, D. A. AlSaleh, and A. Mazhar, “Model-agnostic explainable artificial intelligence methods in finance: a systematic review, recent developments, limitations, challenges and future directions,” Artif. Intell. Rev., vol. 58, no. 8, p. 232, 2025, doi: 10.1007/s10462-025-11215-9.

[17] M. Tavakoli, R. Chandra, F. Tian, and C. Bravo, “Multi-modal deep learning for credit rating prediction using text and numerical data streams,” Appl. Soft Comput., vol. 171, p. 112771, 2025, doi: https://doi.org/10.1016/j.asoc.2025.112771.

[18] M. F. Morthens, “Credit rating prediction using multi-modal temporal neural networks,” Reykjavik University, 2025. [Online]. Available: http://hdl.handle.net/1946/47689

[19] A. Anwar and M. O. Akeel, “Integrating Artificial Intelligence in Audit Workflow: Opportunities, Architecture, and Challenges: A Systematic Review,” Accounting and Auditing, vol. 2, no. 1. p. 4, 2026. doi: 10.3390/accountaudit2010004.

[20] R. Bahlool, N. Hewahi, and W. Elmedany, “Performance, Fairness, and Explainability in AI-Based Credit Scoring: A Systematic Literature Review,” Journal of Risk and Financial Management, vol. 19, no. 2. p. 104, 2026. doi: 10.3390/jrfm19020104.

[21] S. M. Lundberg and S.-I. Lee, “A unified approach to interpreting model predictions,” CoRR, vol. abs/1705.07874, 2017, doi: 10.48550/ARXIV.1705.07874.

[22] M. T. Ribeiro, S. Singh, and C. Guestrin, “‘Why Should I Trust You?’: Explaining the Predictions of Any Classifier,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, in KDD ’16. New York, NY, USA: Association for Computing Machinery, 2016, pp. 1135–1144. doi: 10.1145/2939672.2939778.

[23] A. B. Nassif, M. A. Talib, Q. Nasir, and F. M. Dakalbab, “Machine Learning for Anomaly Detection: A Systematic Review,” IEEE Access, vol. 9, pp. 78658–78700, 2021, doi: 10.1109/ACCESS.2021.3083060.

[24] D. Araci, “FinBERT: Financial Sentiment Analysis with Pre-trained Language Models,” CoRR, vol. abs/1908.10063, 2019, doi: 10.48550/ARXIV.1908.10063.

[25] P. P. Liang, A. Zadeh, and L.-P. Morency, “Foundations & Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions,” ACM Comput. Surv., vol. 56, no. 10, Jun. 2024, doi: 10.1145/3656580.

[26] A. Gewerk, “Corporate Credit Rating,” Kaggle. [Online]. Available: https://www.kaggle.com/datasets/agewerc/corporate-credit-rating

[27] Sbhatti, “Financial Sentiment Analysis,” Kaggle. [Online]. Available: https://www.kaggle.com/datasets/sbhatti/financial-sentiment-analysis

[28] Y. Liang, D. Quan, F. Wang, X. Jia, M. Li, and T. Li, “Financial Big Data Analysis and Early Warning Platform: A Case Study,” IEEE Access, vol. 8, pp. 36515–36526, 2020, doi: 10.1109/ACCESS.2020.2969039.

[29] K. Malit, “Bank Customer Churn Prediction,” Kaggle. [Online]. Available: https://www.kaggle.com/code/kmalit/bank-customer-churn-prediction

[30] C. J. Hutto and E. Gilbert, VADER: A Parsimonious Rule-based Model for Sentiment Analysis of Social Media Text. 2015.doi: https://doi.org/10.1609/icwsm.v8i1.14550.

[31] S. L. Heston and N. R. Sinha, “News vs. Sentiment: Predicting Stock Returns from News Stories,” Financ. Anal. J., vol. 73, no. 3, pp. 67–83, Jul. 2017, doi: 10.2469/faj.v73.n3.3.

[32] R. Gunning, The Technique of Clear Writing. McGraw-Hill, 1952.

Downloads

Published

2026-10-03

Issue

Section

Artificial Intelligence

How to Cite

Agarwal, A., Prabha, S. ., & Yadav, R. . (2026). CME-Insights: A Cognitive Multimodal Explainability Framework for Credit Risk Assessment Using SEC Financial Filings. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 10(5), 1287-1300. https://doi.org/10.29207/resti.v10i5.7678