Enhancing Agile Defect Prediction with Optimized Machine Learning and Feature Selection

Authors

DOI:

https://doi.org/10.29207/resti.v9i4.6713

Keywords:

agile software practices, bug prediction, defect classification, feature selection, metaheuristic optimization

Abstract

In Agile software development, efficient defect prediction is crucial because of the rapid and iterative nature of the delivery. Conventional methods that rely on source code or commit logs often fail to capture the critical contextual signals necessary for early bug detection. This study proposes a hybrid machine learning framework that leverages enriched contextual features from Jira issue tickets and combines them with optimized feature selection techniques. Various classification models, including Random Forest, XGBoost, CatBoost, SVM, and Transformer, are employed to predict defects. To further enhance model performance, metaheuristic-based feature selection methods such as the Bat Algorithm (BA) and Particle Swarm Optimization (PSO) are applied to reduce dimensionality and improve predictive relevance. Experimental results show that Random Forest with BA optimization achieves the highest performance, with an F1-score of 0.83 and an AUC-ROC of 0.86, outperforming other models. While the Transformer model does not surpass tree-based algorithms in all metrics, it shows high recall and competitive F1-scores, making it suitable for high-sensitivity applications. These findings highlight the importance of integrating optimized machine learning models and feature selection techniques to improve model robustness, reduce computational complexity, and meet the needs of Agile development. This approach supports software teams in prioritizing quality assurance tasks, reducing long-term maintenance costs, and optimizing defect management processes.

Downloads

Download data is not yet available.

References

S. Haldar and L. F. Capretz, “Explainable Software Defect Prediction from Cross Company Project Metrics using Machine Learning,” in Proceedings of the 7th International Conference on Intelligent Computing and Control Systems, ICICCS 2023, Institute of Electrical and Electronics Engineers Inc., 2023, pp. 150–157. doi: 10.1109/ICICCS56967.2023.10142534.

U. S. B and R. Sadam, “How Far Does the Predictive Decision Impact the Software Project? The Cost, Service Time, and Failure Analysis from a Cross-Project Defect Prediction Model,” Journal of Systems and Software, vol. 195, no. January, p. 111522, Sep. 2023, doi: 10.1016/j.jss.2022.111522.

R. Fauzan, M. Z. Hamidi, W. A. Safitri, D. O. Siahaan, and M. I. Karimi, “Ontology in Requirements Software Development Method: A Systematic Literature Review,” Journal of Information Technology and Cyber Security, vol. 3, no. 1, pp. 14–32, Jan. 2025, doi: 10.30996/jitcs.12297.

M. A. Al Hilmi, A. Puspaningrum, Darsih, D. O. Siahaan, H. S. Samosir, and A. S. Rahma, “Research Trends, Detection Methods, Practices, and Challenges in Code Smell: SLR,” IEEE Access, vol. 11, pp. 129536–129551, 2023, doi: 10.1109/ACCESS.2023.3334258.

A. Fatwanto, M. Nur Aslam, R. Ndugi, and M. Syafrudin, “An Investigation Towards Resampling Techniques and Classification Algorithms on CM1 NASA PROMISE Dataset for Software Defect Prediction,” Jurnal RESTI, vol. 8, no. 5, pp. 631–643, Oct. 2024, doi: 10.29207/resti.v8i5.5910.

Ö. F. Arar and K. Ayan, “Software defect prediction using cost-sensitive neural network,” Applied Soft Computing Journal, vol. 33, pp. 263–277, Apr. 2015, doi: 10.1016/j.asoc.2015.04.045.

C. W. Yohannese, T. Li, and K. Bashir, “A Three-Stage Based Ensemble Learning for Improved Software Fault Prediction: An Empirical Comparative Study,” International Journal of Computational Intelligence Systems, vol. 11, no. 1, pp. 1229–1247, Jul. 2018, doi: 10.2991/ijcis.11.1.92.

M. Z. F. N. Siswantoro and U. L. Yuhana, “Software Defect Prediction Based on Optimized Machine Learning Models: A Comparative Study,” Teknika, vol. 12, no. 2, pp. 166–172, Jun. 2023, doi: 10.34148/teknika.v12i2.634.

M. Cetiner and O. K. Sahingoz, “A Comparative Analysis for Machine Learning based Software Defect Prediction Systems,” in 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kharagpur, India, 2020, pp. 1–7. doi: 10.1109/ICCCNT49239.2020.9225352.

N. AlNuaimi, M. M. Masud, M. A. Serhani, and N. Zaki, “Streaming feature selection algorithms for big data: A survey,” Applied Computing and Informatics, vol. 18, no. 1–2, pp. 113–135, Jan. 2022, doi: 10.1016/j.aci.2019.01.001.

N. A. A. Khleel and K. Nehez, “Comprehensive Study on Machine Learning Techniques for Software Bug Prediction,” International Journal of Advanced Computer Science and Applications, vol. 12, no. 8, pp. 726–735, 2021, doi: 10.14569/IJACSA.2021.0120884.

D. R. Ibrahim, R. Ghnemat, and A. Hudaib, “Software defect prediction using feature selection and random forest algorithm,” in Proceedings - 2017 International Conference on New Trends in Computing Sciences, ICTCS 2017, Institute of Electrical and Electronics Engineers Inc., Jul. 2017, pp. 252–257. doi: 10.1109/ICTCS.2017.39.

B. R. P. Darnoto, D. Siahaan, and D. Purwitasari, “Automated Detection of Persuasive Content in Electronic News,” Informatics, vol. 10, no. 4, Dec. 2023, doi: 10.3390/informatics10040086.

D. Ariatmanto and A. M. Rifai, “The Impact of Feature Extraction in Random Forest Classifier for Fake News Detection,” Jurnal RESTI, vol. 8, no. 6, pp. 730–736, Dec. 2024, doi: 10.29207/resti.v8i6.6017.

D. I. Ulumi and D. Siahaan, “Weighted knn using grey relational analysis for cross-project defect prediction,” in Journal of Physics: Conference Series, Institute of Physics Publishing, Sep. 2019. doi: 10.1088/1742-6596/1230/1/012062.

D. Siahaan et al., “A scoping review of auto-generating transformation between software development artifacts,” 2023, Frontiers Media SA. doi: 10.3389/fcomp.2023.1306064.

C. Bentéjac, A. Csörgő, and G. Martínez-Muñoz, “A comparative analysis of gradient boosting algorithms,” Artif Intell Rev, vol. 54, no. 3, pp. 1937–1967, Mar. 2021, doi: 10.1007/s10462-020-09896-5.

M. A. Rosid, D. Siahaan, and A. Saikhu, “Sarcasm Detection in Indonesian-English Code-Mixed Text Using Multihead Attention-Based Convolutional and Bi-Directional GRU,” IEEE Access, 2024, doi: 10.1109/ACCESS.2024.3436107.

C. Thapa, S. I. Jang, M. E. Ahmed, S. Camtepe, J. Pieprzyk, and S. Nepal, “Transformer-Based Language Models for Software Vulnerability Detection,” in ACM International Conference Proceeding Series, Association for Computing Machinery (ACM), Apr. 2022, pp. 481–496. doi: 10.1145/3564625.3567985.

Mikko Raatikainen et al., “Improved Management of Issue Dependencies in Issue Trackers of Large Collaborative Projects,” IEEE Transactions on Software Engineering, vol. 49, no. 4, pp. 2128–2148, Apr. 2023, doi: 10.1109/TSE.2022.3212166.

K. Sahoo, A. K. Samal, J. Pramanik, and S. K. Pani, “Exploratory data analysis using python,” International Journal of Innovative Technology and Exploring Engineering, vol. 8, no. 12, pp. 4727–4735, Oct. 2019, doi: 10.35940/ijitee.L3591.1081219.

M. Ichino, “Exploratory Analysis of Distributional Data Using the Quantile Method,” AppliedMath, vol. 4, no. 1, pp. 261–288, Mar. 2024, doi: 10.3390/appliedmath4010014.

F. Bolikulov, R. Nasimov, A. Rashidov, F. Akhmedov, and Y. I. Cho, “Effective Methods of Categorical Data Encoding for Artificial Intelligence Algorithms,” Mathematics, vol. 12, no. 16, Aug. 2024, doi: 10.3390/math12162553.

R. Ambe, “Classification and quantification of timestamp data quality issues and its impact on data quality outcome,” Data Intell, vol. 6, no. 3, pp. 812–833, Dec. 2023, doi: 10.1162/dint_a_00238.

K. Mahmud Sujon, R. Binti Hassan, Z. Tusnia Towshi, M. A. Othman, M. Abdus Samad, and K. Choi, “When to Use Standardization and Normalization: Empirical Evidence From Machine Learning Models and XAI,” IEEE Access, vol. 12, pp. 135300–135314, 2024, doi: 10.1109/ACCESS.2024.3462434.

M. Y. A. Pratama, R. Herteno, M. R. Faisal, R. A. Nugroho, and F. Abadi, “Improving with Hybrid Feature Selection in Software Defect Prediction,” Jurnal Online Informatika, vol. 9, no. 1, pp. 52–60, Apr. 2024, doi: 10.15575/join.v9i1.1307.

A. Arya and S. K. Malik, “An Improved Firefly-Based Feature Selection Method for Software Fault Identification and Classification,” International Journal of Performability Engineering, vol. 19, no. 11, pp. 744–752, Nov. 2023, doi: 10.23940/ijpe.23.11.p5.744752.

B. Bischl et al., “Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges,” Wiley Interdiscip Rev Data Min Knowl Discov, vol. 13, no. 2, Mar. 2023, doi: 10.1002/widm.1484.

M. Martinović, K. Dokic, and D. Pudić, “Comparative Analysis of Machine Learning Models for Predicting Innovation Outcomes: An Applied AI Approach,” Applied Sciences (Switzerland), vol. 15, no. 7, Apr. 2025, doi: 10.3390/app15073636.

A. I. Adler and A. Painsky, “Feature Importance in Gradient Boosting Trees with Cross-Validation Feature Selection,” Entropy, vol. 24, no. 5, May 2022, doi: 10.3390/e24050687.

Downloads

Published

2025-08-17

Issue

Section

Computer Science Applications

How to Cite

Faiq Dhimas Wicaksono, & Daniel Siahaan. (2025). Enhancing Agile Defect Prediction with Optimized Machine Learning and Feature Selection. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 9(4), 814-819. https://doi.org/10.29207/resti.v9i4.6713