A  Multispectral YOLOv8-Based System for Real-Time Object Detection and Distance Estimation in Blind Navigation

Ema Utami; Erwin Syahrudin; Anggit Dwi Hartanto; Suwanto Raharjo

doi:10.30595/juita.v14i1.28373

Authors

Ema Utami Universitas Amikom Yogyakarta
Erwin Syahrudin Universitas Amikom Yogyakarta
Anggit Dwi Hartanto Universitas Amikom Yogyakarta
Suwanto Raharjo Universitas AKPRIND Indonesia

DOI:

https://doi.org/10.30595/juita.v14i1.28373

Keywords:

YOLOv8, multispectral imaging, blind navigation, object detection, distance estimation

Abstract

Developing reliable real-time navigation systems for visually impaired individuals remains challenging, particularly in dynamic and low-light environments. This study proposes an integrated framework combining YOLOv8, OpenCV-based monocular distance estimation, and RGB–NIR multispectral imaging to enhance detection robustness and distance awareness. A dataset of 1,700 annotated images collected from diverse indoor and outdoor environments was used for training and evaluation using preprocessing techniques such as resizing, normalization, and data augmentation. System performance was evaluated using Precision, Recall, F1-Score, mean Average Precision (mAP), Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), and Frames Per Second (FPS). Experimental results show that YOLOv8x achieved the best performance with an F1-Score of 0.91, mAP@50 of 0.74, MAE of 0.15 m, RMSE of 0.20 m, and a processing speed of 22 FPS. Multispectral RGB–NIR integration further improved low-light performance, increasing the F1-Score from 0.83 to 0.89 and reducing MAE from 0.28 m to 0.19 m with only a minor reduction in speed. These findings demonstrate that the proposed system provides an effective balance between accuracy and real-time performance for assistive navigation applications.

Author Biographies

Ema Utami, Universitas Amikom Yogyakarta

Magister of Informatics

Erwin Syahrudin, Universitas Amikom Yogyakarta

Magister of Informatics

Anggit Dwi Hartanto, Universitas Amikom Yogyakarta

Magister of Informatics

Suwanto Raharjo, Universitas AKPRIND Indonesia

Informatics

References

[1] H. Wang, C. Liu, Y. Cai, L. Chen, and Y. Li, “YOLOv8-QSD: An Improved Small Object Detection Algorithm for Autonomous Vehicles Based on YOLOv8,” IEEE Trans. Instrum. Meas., vol. 73, pp. 1–16, 2024, doi: 10.1109/TIM.2024.3379090.

[2] M. Swathi Y. and Challa, “YOLOv8: Advancements and Innovations in Object Detection,” in Smart Trends in Computing and Communications, C. and J. A. Senjyu Tomonobu and So–In, Ed., Singapore: Springer Nature Singapore, 2024, pp. 1–13.

[3] A. S. Romadhon and A. K. Husein, “Smart Stick for the Blind Using Arduino,” in Journal of Physics: Conference Series, Institute of Physics Publishing, Jul. 2020. doi: 10.1088/1742-6596/1569/3/032088.

[4] A. L. R. Siriani, V. Kodaira, S. A. Mehdizadeh, I. de Alencar Nääs, D. J. de Moura, and D. F. Pereira, “Detection and tracking of chickens in low-light images using YOLO network and Kalman filter,” Neural Comput. Appl., vol. 34, no. 24, pp. 21987–21997, 2022, doi: 10.1007/s00521-022-07664-w.

[5] M. Safaldin, N. Zaghden, and M. Mejdoub, “An Improved YOLOv8 to Detect Moving Objects,” IEEE Access, vol. 12, pp. 59782–59806, 2024, doi: 10.1109/ACCESS.2024.3393835.

[6] H. V Chakri Shadakshri, V. M. B, and K. V Rudra Gana Dev, “OpenCV Implementation of Grid-based Vertical Safe Landing for UAV using YOLOv5,” IJACSA) International Journal of Advanced Computer Science and Applications, vol. 13, no. 9, 2022, doi: 10.14569/IJACSA.2022.0130957.

[7] F. Wahab, I. Ullah, A. Shah, R. A. Khan, A. Choi, and M. S. Anwar, “Design and implementation of real-time object detection system based on single-shoot detector and OpenCV,” Front. Psychol., vol. 13, Nov. 2022, doi: 10.3389/fpsyg.2022.1039645.

[8] Y. Li, Y. Huang, and Q. Tao, “Improving real-time object detection in Internet-of-Things smart city traffic with YOLOv8-DSAF method,” Sci. Rep., vol. 14, no. 1, p. 17235, 2024, doi: 10.1038/s41598-024-68115-1.

[9] K. Yu, G. Tang, W. Chen, S. Hu, Y. Li, and H. Gong, “MobileNet-YOLO v5s: An Improved Lightweight Method for Real-Time Detection of Sugarcane Stem Nodes in Complex Natural Environments,” IEEE Access, vol. 11, pp. 104070–104083, 2023, doi: 10.1109/ACCESS.2023.3317951.

[10] M. A. Rahman, S. Siddika, M. A. Al-Baky, and M. J. Mia, “An automated navigation system for blind people,” Bulletin of Electrical Engineering and Informatics, vol. 11, no. 1, pp. 201–212, Feb. 2022, doi: 10.11591/eei.v11i1.3452.

[11] E. Syahrudin, E. Utami, and A. D. Hartanto, “Enhanced Yolov8 with OpenCV for Blind-Friendly Object Detection and Distance Estimation,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 8, no. 2, pp. 199–207, Mar. 2024, doi: 10.29207/resti.v8i2.5529.

[12] S. Khan, S. Nazir, and H. U. Khan, “Analysis of Navigation Assistants for Blind and Visually Impaired People: A Systematic Review,” IEEE Access, vol. 9, pp. 26712–26734, 2021, doi: 10.1109/ACCESS.2021.3052415.

[13] P. Pawaskar, D. Chougule, and A. Mali, “Smart Cane for Blind Person Assisted with Android Application and Save Our Souls Transmission,” International Journal of Engineering and Management Research, vol. 8, Mar. 2018, doi: 10.31033/ijemr.8.3.31.

[14] D. S. Bacea and F. Oniga, “Single stage architecture for improved accuracy real-time object detection on mobile devices,” Image Vis. Comput., vol. 130, Feb. 2023, doi: 10.1016/j.imavis.2022.104613.

[15] V. D. Nguyen Ngoc Dung and Thang, “Real-Time Object Detection Based on Yolov8,” in Smart Objects and Technologies for Social Good, C. and D.-T. N. Huynh Hiep Xuan and Pham, Ed., Cham: Springer Nature Switzerland, 2025, pp. 150–160.

[16] T. J. Alahmadi, A. U. Rahman, H. K. Alkahtani, and H. Kholidy, “Enhancing Object Detection for VIPs Using YOLOv4_Resnet101 and Text-to-Speech Conversion Model,” Multimodal Technologies and Interaction, vol. 7, no. 8, Aug. 2023, doi: 10.3390/mti7080077.

[17] E. Syahrudin, E. Utami, and A. D. Hartanto, “Augmentation for Accuracy Improvement of YOLOv8 in Blind Navigation System,” J. RESTI (Rekayasa Sist. Teknol. Inf.), vol. 10, no. 4, pp. 579–588, 2024, doi: 10.29207/resti.v8i4.5931.

[18] Y. Cao, Z. Liu, F. Wang, S. Su, Y. Sun, and W. Wang, “An improved YOLOv7 for the state identification of sliding chairs in railway turnout,” High-speed Railway, Apr. 2024, doi: 10.1016/j.hspr.2024.04.002.

[19] E. Utami, E. Syahrudin, and A. D. Hartanto, “Comparative analysis of YOLOv8 techniques: OpenCV and coordinate attention weighting for distance perception in blind navigation systems,” International Journal of Electrical and Computer Engineering (IJECE), vol. 15, no. 3, p. 3267, Jun. 2025, doi: 10.11591/ijece.v15i3.pp3267-3278.

[20] E. Syahrudin, E. Utami, and A. D. Hartanto, “YOLOv8-Based Distance Estimation for Blind Navigation: Performance Comparison of OpenCV and Coordinate Attention Techniques,” CommIT Journal, vol. 19, no. 1, pp. 45–57, Apr. 2025, doi: https://doi.org/10.21512/commit.v19i1.11820.

[21] D. Rocha, L. Pinto, J. Machado, F. Soares, and V. Carvalho, “Using Object Detection Technology to Identify Defects in Clothing for Blind People,” Sensors, vol. 23, no. 9, May 2023, doi: 10.3390/s23094381.

[22] D. Huang, Y. Tu, Z. Zhang, and Z. Ye, “A Lightweight Vehicle Detection Method Fusing GSConv and Coordinate Attention Mechanism,” Sensors, vol. 24, no. 8, Apr. 2024, doi: 10.3390/s24082394.

[23] E. Syahrudin, E. Utami, A. D. Hartanto, and S. Raharjo, “Evaluating YOLOv8-Based Distance Estimation: A Comparison of OpenCV and Coordinate Attention Weighting in Blind Navigation Systems,” INTENSIF, vol. 9, no. 2, pp. 2549–6824, 2025, doi: 10.29407/intensif.v9i2.24395.

[24] S. Sun, B. Mo, J. Xu, D. Li, J. Zhao, and S. Han, “Multi-YOLOv8: An infrared moving small object detection model based on YOLOv8 for air vehicle,” Neurocomputing, vol. 588, Jul. 2024, doi: 10.1016/j.neucom.2024.127685.

[25] R. Wang, F. Liang, B. Wang, and X. Mou, “ODCA-YOLO: An Omni-Dynamic Convolution Coordinate Attention-Based YOLO for Wood Defect Detection,” Forests, vol. 14, no. 9, Sep. 2023, doi: 10.3390/f14091885.

[26] R. Arifando, S. Eto, and C. Wada, “Improved YOLOv5-Based Lightweight Object Detection Algorithm for People with Visual Impairment to Detect Buses,” Applied Sciences (Switzerland), vol. 13, no. 9, May 2023, doi: 10.3390/app13095802.

[27] Y. Li, Q. Fan, H. Huang, Z. Han, and Q. Gu, “A Modified YOLOv8 Detection Network for UAV Aerial Image Recognition,” Drones, vol. 7, no. 5, May 2023, doi: 10.3390/drones7050304.

[28] S. Wang, “Research towards Yolo-Series Algorithms: Comparison and Analysis of Object Detection Models for Real-Time UAV Applications,” in Journal of Physics: Conference Series, IOP Publishing Ltd, Jun. 2021. doi: 10.1088/1742-6596/1948/1/012021.

[29] E. Casas, L. Ramos, C. Romero, and F. Rivas-Echeverría, “A comparative study of YOLOv5 and YOLOv8 for corrosion segmentation tasks in metal surfaces,” Array, p. 100351, Jun. 2024, doi: 10.1016/j.array.2024.100351.

[30] Z. Cheng, C. Chen, Z. Zhao, P. Qian, X. Li, and X. Yang, “COCO-TEACH: A Contrastive Co-Teaching Network For Incremental 3D Object Detection,” in 2023 IEEE International Conference on Image Processing (ICIP), 2023, pp. 1990–1994. doi: 10.1109/ICIP49359.2023.10222538.

[31] M. Talib, A. H. Y. Al-Noori, and J. Suad, “YOLOv8-CAB: Improved YOLOv8 for Real-time Object Detection,” Karbala International Journal of Modern Science, vol. 10, no. 1, pp. 56–68, 2024, doi: 10.33640/2405-609X.3339.

[32] A. and B. A. K. and X. T. and G. Y. and S. Y.-Z. Chowdhury Pinaki Nath and Sain, “FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Context,” in Computer Vision – ECCV 2022, G. and C. M. and F. G. M. and H. T. Avidan Shai and Brostow, Ed., Cham: Springer Nature Switzerland, 2022, pp. 253–270.

[33] Iqra and K. J. Giri, “SO-YOLOv8: A novel deep learning-based approach for small object detection with YOLO beyond COCO,” Expert Syst. Appl., vol. 280, p. 127447, 2025, doi: https://doi.org/10.1016/j.eswa.2025.127447.

[34] P. Kumar and V. Kumar, “Exploring the Frontier of Object Detection: A Deep Dive into YOLOv8 and the COCO Dataset,” in 2023 IEEE International Conference on Computer Vision and Machine Intelligence (CVMI), 2023, pp. 1–6. doi: 10.1109/CVMI59935.2023.10464837.

[35] A. Narmilan, F. Gonzalez, A. S. A. Salgadoe, U. W. L. M. Kumarasiri, H. A. S. Weerasinghe, and B. R. Kulasekara, “Predicting Canopy Chlorophyll Content in Sugarcane Crops Using Machine Learning Algorithms and Spectral Vegetation Indices Derived from UAV Multispectral Imagery,” Remote Sens. (Basel)., vol. 14, no. 5, 2022, doi: 10.3390/rs14051140.

[36] S. Muhamad Itikap, M. Syahid Abdurrahman, E. B. Soewono, and T. Gelar, “Geometry and Color Transformation Data Augmentation for YOLOV8 in Beverage Waste Detection,” Journal of Software Engineering, Information and Communication Technology (SEICT), vol. 4, no. 2, pp. 123–138, 2023, doi: 10.17509/seict.

[37] A. B. Abadi and S. Tahcfulloh, “Digital Image Processing for Height Measurement Application Based on Python OpenCV and Regression Analysis,” International Journal on Informatics Visualization, pp. 763–769, Dec. 2022, doi: 10.30630/joiv.6.4.1013.

[38] J. Sigut, M. Castro, R. Arnay, and M. Sigut, “OpenCV Basics: A Mobile Application to Support the Teaching of Computer Vision Concepts,” IEEE Transactions on Education, vol. 63, no. 4, pp. 328–335, 2020, doi: 10.1109/TE.2020.2993013.

[39] P. P. Ruwanpathirana et al., “Evaluation of Sugarcane Crop Growth Monitoring Using Vegetation Indices Derived from RGB-Based UAV Images and Machine Learning Models,” Agronomy, vol. 14, no. 9, 2024, doi: 10.3390/agronomy14092059.

[40] M. Hussain, “YOLO-v1 to YOLO-v8, the Rise of YOLO and Its Complementary Nature toward Digital Manufacturing and Industrial Defect Detection,” Jul. 01, 2023, Multidisciplinary Digital Publishing Institute (MDPI). doi: 10.3390/machines11070677.

[41] W. Zhao, M. Syafrudin, and N. L. Fitriyani, “CRAS-YOLO: A Novel Multi-Category Vessel Detection and Classification Model Based on YOLOv5s Algorithm,” IEEE Access, vol. 11, pp. 11463–11478, 2023, doi: 10.1109/ACCESS.2023.3241630.

[42] Y. Hui, J. Wang, and B. Li, “DSAA-YOLO: UAV remote sensing small target recognition algorithm for YOLOV7 based on dense residual super-resolution and anchor frame adaptive regression strategy,” Journal of King Saud University - Computer and Information Sciences, vol. 36, no. 1, Jan. 2024, doi: 10.1016/j.jksuci.2023.101863.

[43] D. Kumar and N. Muhammad, “Object Detection in Adverse Weather for Autonomous Driving through Data Merging and YOLOv8,” Sensors (Basel)., vol. 23, no. 20, Oct. 2023, doi: 10.3390/s23208471.

[44] Y. Dai, D. Kim, and K. Lee, “An Advanced Approach to Object Detection and Tracking in Robotics and Autonomous Vehicles Using YOLOv8 and LiDAR Data Fusion,” Electronics (Switzerland), vol. 13, no. 12, Jun. 2024, doi: 10.3390/electronics13122250.

[45] S. M. Robeson and C. J. Willmott, “Decomposition of the mean absolute error (MAE) into systematic and unsystematic components,” PLoS One, vol. 18, no. 2 February, Feb. 2023, doi: 10.1371/journal.pone.0279774.