Attention-Based Multi-View Fusion YOLO for Non-Destructive Pineapple Sweetness Assessment

Authors

  • Dwi Vernanda Politeknik Negeri Subang
  • Tri Herdiawan Apandi Politeknik Negeri Subang
  • Aisyah Suhailla Binti Jili Politeknik Mukah
  • Desy Triastuti Politeknik Negeri Subang
  • Willy Muhammad Fauzi Politeknik Negeri Subang

DOI:

https://doi.org/10.29207/resti.v10i2.7382

Keywords:

attention mechanism, multi-view fusion, non-destructive testing, pineapple, YOLO

Abstract

Classifying the sweetness level of pineapples is an important part of quality control, but existing methods still face issues of subjectivity and require destructive testing. Manual assessment is often inconsistent, while refractometer measurements require cutting the fruit open. Single-view computer vision offers a non-destructive alternative, yet its performance remains limited because visual cues related to sweetness appear on different sides of the fruit. This study introduces Multi-View Fusion YOLO (MVF-YOLO), a model that combines five viewpoints (full, front, left, right, and back) through an attention mechanism to perform adaptive sweetness classification. The dataset consists of 570 pineapples with TSS/TA ratios as the ground truth, producing 2,850 images grouped into three categories: sour (TSS/TA 10–20), ideal (TSS/TA 20–30), and very sweet (TSS/TA >30). MVF-YOLO achieved an mAP@0.5 of 82.1% and an overall accuracy of 84.2%, outperforming the single-view baseline by 14.3%. Attention weight analysis indicates that the full view contributes the most (0.267). With an inference time of 45.8 ms per fruit, the model is sufficiently efficient for use by farmers, distributors, and consumers. The results demonstrate that a multiview approach enhanced with learned attention can significantly improve sweetness classification accuracy without compromising computational efficiency.

Downloads

Download data is not yet available.

References

Saman and Jalaluddin Mohamad, “Hasil Pencacahan Lengkap Sensus Pertanian 2023,” Subang, 2023.

D. Vernanda, Z. Nurizati, and A. Hidayat, “Klasifikasi Nanas Layak Jual Menggunakan Metode Naive Bayed,” Melek IT Information Technology Journal, vol. 10, pp. 111–120, 2024, doi: https://doi.org/10.30742/melekitjournal.v10i2.355.

D. Wang, X. Wang, Y. Chen, Y. Wu, and X. Zhang, “Strawberry ripeness classification method in facility environment based on red color ratio of fruit rind,” Comput. Electron. Agric., vol. 214, p. 108313, Nov. 2023, doi: 10.1016/J.COMPAG.2023.108313.

S. Ditcharoen et al., “Improving the non-destructive maturity classification model for durian fruit using near-infrared spectroscopy,” Artificial Intelligence in Agriculture, vol. 7, pp. 35–43, Mar. 2023, doi: 10.1016/J.AIIA.2023.02.002.

G. Qiu et al., “Nondestructive Detecting Maturity of Pineapples Based on Visible and Near-Infrared Transmittance Spectroscopy Coupled with Machine Learning Methodologies,” Horticulturae, vol. 9, no. 8, p. 889, Aug. 2023, doi: 10.3390/horticulturae9080889.

Y. Gao et al., “Metabolomic and transcriptomic analyses reveal the mechanism of sweet-acidic taste formation during pineapple fruit development,” Front. Plant Sci., vol. 13, Sep. 2022, doi: 10.3389/fpls.2022.971506.

S. Aras, P. Tanra, and M. Bazhar, “Deteksi Tingkat Kematangan Buah Tomat Menggunakan YOLOv5,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 4, no. 2, pp. 623–628, Mar. 2024, doi: 10.57152/malcom.v4i2.1270.

L. T. Ramos and A. D. Sappa, “A comprehensive analysis of YOLO architectures for tomato leaf disease identification,” Sci. Rep., vol. 15, no. 1, p. 26890, 2025, doi: 10.1038/s41598-025-11064-0.

N. Chitraningrum et al., “Comparison Study of Corn Leaf Disease Detection based on Deep Learning YOLO-v5 and YOLO-v8,” Journal of Engineering and Technological Sciences, vol. 56, no. 1, pp. 61–70, Feb. 2024, doi: 10.5614/j.eng.technol.sci.2024.56.1.5.

M. Alruwaili et al., “Deep Learning-Based YOLO Models for the Detection of People With Disabilities,” IEEE Access, vol. 12, pp. 2543–2566, 2024, doi: 10.1109/ACCESS.2023.3347169.

Sandhya and A. Kashyap, “A novel method for real-time object-based copy-move tampering localization in videos using fine-tuned YOLO V8,” Forensic Science International: Digital Investigation, vol. 48, p. 301663, Mar. 2024, doi: 10.1016/j.fsidi.2023.301663.

R. Wan Nurazwin Syazwani, H. Muhammad Asraf, M. A. Megat Syahirul Amin, and K. A. Nur Dalila, “Automated image identification, detection and fruit counting of top-view pineapple crown using machine learning,” Alexandria Engineering Journal, vol. 61, no. 2, pp. 1265–1276, Feb. 2022, doi: 10.1016/J.AEJ.2021.06.053.

N. Nugraha Purnawan, D. Vernanda, T. Herdiawan Apandi, and Z. Niqotaini, “Non-Destructive Classification Model of Pineapple Sweetness Level,” Jurnal Tekno Kompak, vol. 19, no. 1, 2025.

S. Kanjanawattana, W. Teerawatthanaprapha, P. Praneetpholkrang, G. Bhakdisongkhram, and S. Weeragulpiriya, “Pineapple Sweetness Classification Using Deep Learning Based on Pineapple Images,” Journal of Image and Graphics, vol. 11, no. 1, pp. 47–52, Mar. 2023, doi: 10.18178/joig.11.1.47-52.

D. Li, Z. Song, C. Quan, X. Xu, and C. Liu, “Recent advances in image fusion technology in agriculture,” Comput. Electron. Agric., vol. 191, p. 106491, Dec. 2021, doi: 10.1016/J.COMPAG.2021.106491.

H. Su, S. Maji, E. Kalogerakis, and Er. Learned_miller, “Multi-view Convolutional Neural Networks for 3D Shape Recognition,” Computer Vision and Pattern Recognition, Nov. 2015, doi: https://doi.org/10.48550/arXiv.1505.00880.

P. Moallem, A. Serajoddin, and H. Pourghassem, “Computer vision-based apple grading for golden delicious apples based on surface features,” Information Processing in Agriculture, vol. 4, no. 1, pp. 33–40, Mar. 2017, doi: 10.1016/J.INPA.2016.10.003.

D. Vernanda, N. Nugraha Purnawan, T. Herdiawan Apandi, P. Negeri Subang, and J. Brigjen Katamso No, “Analisis Data untuk Kalsifikasi Tingkat Kematangan Buah Nanas Menggunakan SVM,” Jurnal Ilmiah Ilmu dan Teknologi Rekayasa |, vol. 4, 2022, doi: 10.31962/jiitr.vvii.67.

P. Siricharoen, W. Yomsatieankul, and T. Bunsri, “Fruit maturity grading framework for small dataset using single image multi-object sampling and Mask R-CNN,” Smart Agricultural Technology, vol. 3, p. 100130, Feb. 2023, doi: 10.1016/J.ATECH.2022.100130.

F. Wang et al., “Residual Attention Network for Image Classification,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Jul. 2017, pp. 6450–6458. doi: 10.1109/CVPR.2017.683.

M.-H. Guo et al., “Attention mechanisms in computer vision: A survey,” Comput. Vis. Media (Beijing)., vol. 8, no. 3, pp. 331–368, Sep. 2022, doi: 10.1007/s41095-022-0271-y.

T. B. Shahi, C.-Y. Xu, A. Neupane, and W. Guo, “Recent Advances in Crop Disease Detection Using UAV and Deep Learning Techniques,” Remote Sens. (Basel)., vol. 15, no. 9, p. 2450, May 2023, doi: 10.3390/rs15092450.

A. Vaswani et al., “Attention Is All You Need,” in 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA., Aug. 2023. doi: https://doi.org/10.48550/arXiv.1706.03762.

G. Xue, S. Liu, and Y. Ma, “A hybrid deep learning-based fruit classification using attention model and convolution autoencoder,” Complex & Intelligent Systems, vol. 9, no. 3, pp. 2209–2219, Jun. 2023, doi: 10.1007/s40747-020-00192-x.

R. Singh, R. Nisha, R. Naik, K. Upendar, C. Nickhil, and S. C. Deka, “Sensor fusion techniques in deep learning for multimodal fruit and vegetable quality assessment: A comprehensive review,” Journal of Food Measurement and Characterization, vol. 18, no. 9, pp. 8088–8109, Sep. 2024, doi: 10.1007/s11694-024-02789-z.

T. B. Shahi, C. Sitaula, A. Neupane, and W. Guo, “Fruit classification using attention-based MobileNetV2 for industrial applications,” PLoS One, vol. 17, no. 2, p. e0264586, Feb. 2022, doi: 10.1371/journal.pone.0264586.

X.-H. Lu, D.-Q. Sun, Q.-S. Wu, S.-H. Liu, and G.-M. Sun, “Physico-Chemical Properties, Antioxidant Activity and Mineral Contents of Pineapple Genotypes Grown in China,” Molecules, vol. 19, no. 6, pp. 8518–8532, Jun. 2014, doi: 10.3390/molecules19068518.

L. S. Magwaza and U. L. Opara, “Analytical methods for determination of sugars and sweetness of horticultural products—A review,” Sci. Hortic., vol. 184, pp. 179–192, Mar. 2015, doi: 10.1016/j.scienta.2015.01.001.

J. Deng, W. Dong, R. Socher, L.-J. Li, Kai Li, and Li Fei-Fei, “ImageNet: A large-scale hierarchical image database,” in 2009 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Jun. 2009, pp. 248–255. doi: 10.1109/CVPR.2009.5206848.

R. Khanam and M. Hussain, “YOLOV11: An Overview Of The Key Architectural Enhancements,” Computer Vision and Pattern Recognition, Oct. 2024, doi: https://doi.org/10.48550/arXiv.2410.17725.

R. Sapkota and M. Karkee, “Ultralytics YOLO Evolution: An Overview of YOLO26, YOLO11, YOLOv8 and YOLOv5 Object Detectors for Computer Vision and Pattern Recognition,” Computer Vision and Pattern Recognition, Oct. 2025, doi: https://doi.org/10.48550/arXiv.2510.09653.

A. Paszke et al., “PyTorch: An Imperative Style, High-Performance Deep Learning Library,” in 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), ancouver, Canada., Dec. 2019. doi: https://doi.org/10.48550/arXiv.1912.01703.

J. Bao, K. Luo, Q. Kou, L. He, and G. Zhao, “Multi-Head Structural Attention-Based Vision Transformer with Sequential Views for 3D Object Recognition,” Applied Sciences, vol. 15, no. 6, p. 3230, Mar. 2025, doi: 10.3390/app15063230.

E. Hassan, S. A. Ghazalah, N. El-Rashidy, T. A. El-Hafeez, and M. Y. Shams, “Sustainable deep vision systems for date fruit quality assessment using attention-enhanced deep learning models,” Front. Plant Sci., vol. 16, Jun. 2025, doi: 10.3389/fpls.2025.1521508.

J. Wang et al., “Grading detection of ‘Red Fuji’ apple in Luochuan based on machine vision and near-infrared spectroscopy,” PLoS One, vol. 17, no. 8, p. e0271352, Aug. 2022, doi: 10.1371/journal.pone.0271352.

M. A. Nuño-Maganda et al., “Real-Time Embedded Vision System for Online Monitoring and Sorting of Citrus Fruits,” Electronics (Basel)., vol. 12, no. 18, p. 3891, Sep. 2023, doi: 10.3390/electronics12183891.

Y. Hou, S. Gould, and L. Zheng, “Learning to Select Camera Views: Efficient Multiview Understanding at Few Glances,” Mar. 2023, [Online]. Available: http://arxiv.org/abs/2303.06145

X. Liang et al., “Real-Time Grading of Defect Apples Using Semantic Segmentation Combination with a Pruned YOLO V4 Network,” Foods, vol. 11, no. 19, p. 3150, Oct. 2022, doi: 10.3390/foods11193150.

J. Wang et al., “A cross-domain fruit classification method based on lightweight attention networks and unsupervised domain adaptation,” Complex & Intelligent Systems, vol. 9, no. 4, pp. 4227–4247, Aug. 2023, doi: 10.1007/s40747-022-00955-8.

W. Zhang, K. Chen, J. Wang, Y. Shi, and W. Guo, “Easy domain adaptation method for filling the species gap in deep learning-based fruit detection,” Hortic. Res., vol. 8, no. 1, p. 119, Dec. 2021, doi: 10.1038/s41438-021-00553-8.

S. Yang, Q. Feng, J. Zhang, W. Yang, W. Zhou, and W. Yan, “From laboratory to field: cross-domain few-shot learning for crop disease identification in the field,” Front. Plant Sci., vol. 15, Dec. 2024, doi: 10.3389/fpls.2024.1434222.

L. E. Chuquimarca, B. X. Vintimilla, and S. A. Velastin, “A review of external quality inspection for fruit grading using CNN models,” Artificial Intelligence in Agriculture, vol. 14, pp. 1–20, Dec. 2024, doi: 10.1016/J.AIIA.2024.10.002.

C. Fang et al., “VGG-MFO-orange for sweetness prediction of Linhai mandarin oranges,” Sci. Rep., vol. 15, no. 1, p. 11781, Apr. 2025, doi: 10.1038/s41598-025-96297-9.

E. Mavridou, E. Vrochidou, G. A. Papakostas, T. Pachidis, and V. G. Kaburlasos, “Machine Vision Systems in Precision Agriculture for Crop Farming,” J. Imaging, vol. 5, no. 12, p. 89, Dec. 2019, doi: 10.3390/jimaging5120089.

Z. Khan, S. Rawat, S. Kumar, and A. Sharma, “Using computer vision for automated grading and sorting of fruits and vegetables,” International Journal of Agriculture and Food Science, vol. 7, no. 8, pp. 1056–1065, Aug. 2025, doi: 10.33545/2664844X.2025.v7.i8j.674.

Z. Cao, S. Sun, and X. Bao, “A Review of Computer Vision and Deep Learning Applications in Crop Growth Management,” Applied Sciences, vol. 15, no. 15, p. 8438, Jul. 2025, doi: 10.3390/app15158438.

S. Ghazal, A. Munir, and W. S. Qureshi, “Computer vision in smart agriculture and precision farming: Techniques and applications,” Artificial Intelligence in Agriculture, vol. 13, pp. 64–83, Sep. 2024, doi: 10.1016/j.aiia.2024.06.004.

W. Wang and Y. Kang, “A Review of Computer Vision Technologies in Precision Agriculture,” Theoretical and Natural Science, vol. 101, no. 1, pp. 34–39, Apr. 2025, doi: 10.54254/2753-8818/2025.CH22224.

X. Min, Y. Ye, S. Xiong, and X. Chen, “Computer Vision Meets Generative Models in Agriculture: Technological Advances, Challenges and Opportunities,” Applied Sciences, vol. 15, no. 14, p. 7663, Jul. 2025, doi: 10.3390/app15147663.

Downloads

Published

2026-04-06

Issue

Section

Computer Vision and Pattern Recognition

How to Cite

Vernanda, D., Apandi, T. H., Suhailla Binti Jili, A. ., Triastuti, D., & Muhammad Fauzi, W. (2026). Attention-Based Multi-View Fusion YOLO for Non-Destructive Pineapple Sweetness Assessment. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 10(2), 267-279. https://doi.org/10.29207/resti.v10i2.7382