Correlation Analysis of ISO 25010 Modularity, CK Metrics,  and Architecture Smells

Maulana Alirridlo; Enrico Almer  Tahara; Siti Rochimah

doi:10.29207/resti.v9i6.6825

Authors

Maulana Alirridlo Institut Teknologi Sepuluh Nopember
Enrico Almer Tahara Institut Teknologi Sepuluh Nopember
Siti Rochimah Institut Teknologi Sepuluh Nopember

DOI:

https://doi.org/10.29207/resti.v9i6.6825

Keywords:

Architecture Smells, CK Metrics, ISO 25010, Pearson, Spearman

Abstract

Open-source software projects face increasing challenges in maintaining design quality as they evolve, often resulting in technical debt accumulation and reduced maintainability. This study explores the relationship between software modularity, measured using ISO/IEC 25010 quality attributes, Chidamber and Kemerer (CK) object-oriented metrics, and architectural smells (AS) in Java-based open-source software. Six Java-based open-source projects were strategically selected based on varying complexity levels (ranging from 6-994 classes) and different application domains to ensure comprehensive analysis coverage using DesigniteJava to extract AS, CK metrics, and modularity indicators. Correlation analyses showed that architectural smells such as Cyclic Dependency, Ambiguous Interface, and God Component are strongly correlated with CK metrics like Weighted Methods per Class, Depth of Inheritance Tree, and Number of Children. These CK metrics also exhibited strong positive correlations with Cyclomatic Complexity, indicating that structurally complex components also tend to have more complex control logic. Dense Structure was found to negatively correlate with Coupling of Components Conformance, suggesting its effect on modularity compliance. On the other hand, smells like Feature Concentration and Scattered Functionality showed weak or inconsistent correlations with these metrics. The findings highlight the importance of addressing specific architectural smells to improve modularity and software quality.

Downloads

Download data is not yet available.

References

“ISO/IEC 25010.” Accessed: Apr. 23, 2025. [Online]. Available: ISO/IEC 25010

S. R. Chidamber and C. F. Kemerer, "A metrics suite for object oriented design," in IEEE Transactions on Software Engineering, vol. 20, no. 6, pp. 476-493, June 1994, doi: 10.1109/32.295895

F. A. Fontana, V. Lenarduzzi, R. Roveda, and D. Taibi, “Are Architectural Smells Independent from Code Smells? An Empirical Study,” 2019.

I. M. A. Wikantyasa, A. P. Kurniawan, and S. Rochimah, “C K Metric and Architecture Smells Relations: Towards Software Quality Assurance,” in 2023 14th International Conference on Information and Communication Technology and System, ICTS 2023, Institute of Electrical and Electronics Engineers Inc., 2023, pp. 13–17. doi: 10.1109/ICTS58770.2023.10330874.

D. Yuniasri, S. Rochimah, and A. B. Raharjo, “A Correlation Analysis between ISO 25010 based Modularity and CK Metrics in Object-Oriented Software,” in 3rd International Conference on Advanced Science and Engineering, ICOASE 2020, Institute of Electrical and Electronics Engineers Inc., Dec. 2020, pp. 80–85. doi: 10.1109/ICOASE51841.2020.9436617.

“ISO/IEC/IEEE 32430,” 2025.

M. I. F. Nuzula and S. Rochimah, “Evaluation of Service Quality in Human Resource Information Systems Using the ISO/IEC 25010,” in 2023 International Seminar on Application for Technology of Information and Communication: Smart Technology Based on Industry 4.0: A New Way of Recovery from Global Pandemic and Global Economic Crisis, iSemantic 2023, Institute of Electrical and Electronics Engineers Inc., 2023, pp. 215–220. doi: 10.1109/iSemantic59612.2023.10295365.

Y. A. Khan, M. O. Elish, and M. El-Attar, “A systematic review on the impact of CK metrics on the functional correctness of object-oriented classes,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2012, pp. 258–273. doi: 10.1007/978-3-642-31128-4_19.

G. Singh, “Metrics for measuring the quality of object-oriented software,” ACM SIGSOFT Software Engineering Notes, vol. 38, no. 5, pp. 1–5, Aug. 2013, doi: 10.1145/2507288.2507311.

L. A. Tremasova, V. M. Korovushkina, K. A. Panteleeva, and D. V. Gadasin, “Distributed Information System Software Code Reliability Evaluation,” in Wave Electronics and its Application in Information and Telecommunication Systems, WECONF - Conference Proceedings, Institute of Electrical and Electronics Engineers, 2024. doi: 10.1109/WECONF61770.2024.10564614.

R. Jangra, O. P. Sangwan, and D. Nandal, “A holistic review on optimization strategies for C & K metrics in object oriented testing,” in Proceedings - 2021 4th International Conference on Computational Intelligence and Communication Technologies, CCICT 2021, Institute of Electrical and Electronics Engineers Inc., Jul. 2021, pp. 362–371. doi: 10.1109/CCICT53244.2021.00073.

R. Jangra, O. P. Sangwan, and D. Nandal, “A Novel Approach for Software Effort Estimation using Optimized C&K Metrics,” in Proceedings - 2022 5th International Conference on Computational Intelligence and Communication Technologies, CCICT 2022, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 505–513. doi: 10.1109/CCiCT56684.2022.00095.

P. Bacchiega, D. Rusconi, P. Mereghetti, and F. A. Fontana, “Refactoring of a Microservices Project Driven by Architectural Smell Detection,” in Proceedings - IEEE 21st International Conference on Software Architecture Companion, ICSA-C 2024, Institute of Electrical and Electronics Engineers Inc., 2024, pp. 281–288. doi: 10.1109/ICSA-C63560.2024.00040.

M. Benidris, E. A. O. Elfallah, M. A. Cheema, M. S. A. Alsma, T. Z. Kadiki, and A. Elbarsha, “The Correlation Between Architecture Smells, Package Stability and Reusability: A Case Study,” in 2024 IEEE 4th International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering, MI-STA 2024 - Proceeding, Institute of Electrical and Electronics Engineers Inc., 2024, pp. 1–6. doi: 10.1109/MI-STA61267.2024.10599745.

P. Gnoyke, S. Schulze, and J. Kruger, “An Evolutionary Analysis of Software-Architecture Smells,” in Proceedings - 2021 IEEE International Conference on Software Maintenance and Evolution, ICSME 2021, Institute of Electrical and Electronics Engineers Inc., 2021, pp. 413–424. doi: 10.1109/ICSME52107.2021.00043.

U. Iftikhar, N. Bin Ali, J. Börstler, and M. Usman, “A tertiary study on links between source code metrics and external quality attributes,” Jan. 01, 2024, Elsevier B.V. doi: 10.1016/j.infsof.2023.107348.

J. Lenhard, M. Blom, and S. Herold, “Exploring the suitability of source code metrics for indicating architectural inconsistencies,” Software Quality Journal, vol. 27, no. 1, pp. 241–274, Mar. 2019, doi: 10.1007/s11219-018-9404-z.

K. R. Sampath and D. I. De Silva, “Cognitive-Integrated Complexity Analysis: A Comprehensive Software Visualization Tool,” in Proceedings of ICITR 2024 - 9th International Conference on Information Technology Research: Harnessing the Potential of Information Technology, Institute of Electrical and Electronics Engineers Inc., 2024. doi: 10.1109/ICITR64794.2024.10857757.

R. Jolak, S. Karlsson, and F. Dobslaw, “An empirical investigation of the impact of architectural smells on software maintainability,” Journal of Systems and Software, vol. 225, Jul. 2025, doi: 10.1016/j.jss.2025.112382.

M. Rahmi Dewi, N. Ngaliah, and S. Rochimah, “Maintainability Measurement and Evaluation of myITS Mobile Application Using ISO 25010 Quality Standard,” in 2020 International Seminar on Application for Technology of Information and Communication (iSemantic), IEEE, Sep. 2020, pp. 530–536. doi: 10.1109/iSemantic50169.2020.9234283.

E. Peters and G. K. Aggrey, “An ISO 25010 based quality model for ERP systems,” Advances in Science, Technology and Engineering Systems, vol. 5, no. 2, pp. 578–583, Apr. 2020, doi: 10.25046/aj050272.

W. A. Prabowo, “Developing Compliant Audit Information System for Information Security Index: A Study on Enhancing Institutional and Organizational Audits using Web-based Technology and ISO 25010:2011 Total Quality of Use Evaluation,” JOIV : International Journal on Informatics Visualization, vol. 8, no. 1, p. 343, Mar. 2024, doi: 10.62527/joiv.8.1.1845.

A. A. Pratama and A. B. Mutiara, “Software Quality Analysis for Halodoc Application using ISO 25010:2011,” International Journal of Advanced Computer Science and Applications, vol. 12, no. 8, p. 2021, 2021, doi: 10.14569/IJACSA.2021.0120844.

D. T. Kurniasari and S. Rochimah, “An evaluation model of website testing framework based on ISO 25010 performance efficiency,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 37, no. 2, p. 1130, Feb. 2025, doi: 10.11591/ijeecs.v37.i2.pp1130-1139.

B. Stroustrup, “What is object-oriented programming?,” IEEE Softw, vol. 5, no. 3, pp. 10–20, May 1988, doi: 10.1109/52.2020.

P. Wegner, “Concepts and paradigms of object-oriented programming,” ACM SIGPLAN OOPS Messenger, vol. 1, no. 1, pp. 7–87, Aug. 1990, doi: 10.1145/382192.383004.

R. Subramanyam and M. S. Krishnan, “Empirical analysis of CK metrics for object-oriented design complexity: implications for software defects,” IEEE Transactions on Software Engineering, vol. 29, no. 4, pp. 297–310, Apr. 2003, doi: 10.1109/TSE.2003.1191795.

U. L. Kulkarni, Y. R. Kalshetty, and V. G. Arde, “Validation of CK metrics for object oriented design measurement,” in Proceedings - 3rd International Conference on Emerging Trends in Engineering and Technology, ICETET 2010, 2010, pp. 646–651. doi: 10.1109/ICETET.2010.159.

A. A. Mir, M. Raees, and A. Ahmed, “Object Oriented-Based Metrics to Predict Fault Proneness in Software Design,” Apr. 2025, doi: https://doi.org/10.48550/arXiv.2504.08230.

M. Amarif, “Applying the Genetic Algorithm Concept for Determining the Inheritance Relationship between Objects in Object Oriented Languages,” in Proceeding - 2023 IEEE 3rd International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering, MI-STA 2023, Institute of Electrical and Electronics Engineers Inc., 2023, pp. 276–280. doi: 10.1109/MI-STA57575.2023.10169679.

A. M. Chaniotaki and T. Sharma, “Architecture smells and pareto principle: A preliminary empirical exploration,” in Proceedings - 2021 IEEE/ACM 18th International Conference on Mining Software Repositories, MSR 2021, Institute of Electrical and Electronics Engineers Inc., May 2021, pp. 190–194. doi: 10.1109/MSR52588.2021.00031.

M. Esposito, M. Robredo, F. A. Fontana, and V. Lenarduzzi, “On the correlation between Architectural Smells and Static Analysis Warnings,” Jun. 2024, [Online]. Available: http://arxiv.org/abs/2406.17354

F. Tian, P. Liang, and M. A. Babar, “How developers discuss architecture smells? An exploratory study on stack overflow,” in Proceedings - 2019 IEEE International Conference on Software Architecture, ICSA 2019, Institute of Electrical and Electronics Engineers Inc., Apr. 2019, pp. 91–100. doi: 10.1109/ICSA.2019.00018.

F. A. Fontana, I. Pigazzini, R. Roveda, D. Tamburri, M. Zanoni, and E. Di Nitto, “Arcan: A tool for architectural smells detection,” in Proceedings - 2017 IEEE International Conference on Software Architecture Workshops, ICSAW 2017: Side Track Proceedings, Institute of Electrical and Electronics Engineers Inc., Jun. 2017, pp. 282–285. doi: 10.1109/ICSAW.2017.16.

R. Capilla, F. A. Fontana, T. Mikkonen, P. Bacchiega, and V. Salamanca, “Detecting Architecture Debt in Micro-Service Open-Source Projects,” in Proceedings - 2023 49th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2023, Institute of Electrical and Electronics Engineers Inc., 2023, pp. 394–401. doi: 10.1109/SEAA60479.2023.00066.

Sedgwick P. Pearson’s correlation coefficient BMJ 2012; 345 :e4483 doi:10.1136/bmj.e4483.

H. Pan, X. You, S. Liu, and D. Zhang, “Pearson correlation coefficient-based pheromone refactoring mechanism for multi-colony ant colony optimization,” Applied Intelligence, vol. 51, no. 2, pp. 752–774, Feb. 2021, doi: 10.1007/s10489-020-01841-x.

B. Djordjević, A. S. Mane, and E. Krmac, “Analysis of dependency and importance of key indicators for railway sustainability monitoring: A new integrated approach with DEA and Pearson correlation,” Research in Transportation Business and Management, vol. 41, Dec. 2021, doi: 10.1016/j.rtbm.2021.100650.

J. Hauke and T. Kossowski, “Comparison of values of pearson’s and spearman’s correlation coefficients on the same sets of data,” Quaestiones Geographicae, vol. 30, no. 2, pp. 87–93, Jun. 2011, doi: 10.2478/v10117-011-0021-1.

K. Ali and A. Al-Hameed, “Spearman’s correlation coefficient in statistical analysis,” Int. J. Nonlinear Anal. Appl, vol. 13, pp. 2008–6822, 2022, doi: 10.22075/ijnaa.2022.6079.

H. Yu and A. D. Hutson, “A robust Spearman correlation coefficient permutation test,” Commun Stat Theory Methods, vol. 53, no. 6, pp. 2141–2153, 2024, doi: 10.1080/03610926.2022.2121144.