Sistem Terintegrasi YOLO dan Logika Fuzzy Mamdani untuk Deteksi APD dan Klasifikasi Respons Keselamatan Kerja

Muhammad Rais Fahd Al Hakim; Tri Joko Wahyu Adi; Yusroniya Eka Putri Rachman Waliulu

doi:10.55681/armada.v4i7.2790

Authors

Muhammad Rais Fahd Al Hakim Institut Teknologi Sepuluh Nopember, Indonesia
Tri Joko Wahyu Adi Institut Teknologi Sepuluh Nopember, Indonesia
Yusroniya Eka Putri Rachman Waliulu Institut Teknologi Sepuluh Nopember, Indonesia

DOI:

https://doi.org/10.55681/armada.v4i7.2790

Keywords:

YOLO, Logika Fuzzy, Alat Pelindung Diri, Deteksi Objek, Keselamatan Konstruksi

Abstract

Kecelakaan kerja di sektor industri dan konstruksi masih sering menyebabkan cedera serius dan kematian. Pemantauan kepatuhan penggunaan Alat Pelindung Diri (APD) secara manual dinilai tidak efisien dan rentan terhadap kesalahan manusia. Penelitian ini mengembangkan sistem deteksi APD dan respons keselamatan adaptif secara real-time dengan mengintegrasikan YOLOv12 dan Sistem Inferensi Logika Fuzzy Mamdani. YOLOv12 digunakan untuk mendeteksi helm, rompi keselamatan, sarung tangan, sepatu bot, masker debu, dan pelindung wajah dari aliran video. Tingkat kepatuhan dihitung melalui pembobotan berdasarkan jenis aktivitas kerja, kemudian diproses oleh sistem fuzzy untuk menentukan empat kategori respons, yaitu aman, peringatan, alarm lokal, dan hentikan pekerjaan. Pengujian pada video konstruksi dunia nyata menghasilkan mAP50 keseluruhan sebesar 0,796 dan mencapai 0,972 pada kelas Sepatu Keselamatan. Sistem fuzzy menghasilkan respons Alarm Lokal bernilai 38,61 pada kepatuhan 50,0% serta respons Aman bernilai 85,4 pada kepatuhan 97,0%. Kerangka YOLO-Fuzzy ini menunjukkan potensi sebagai solusi otomatis, adaptif, dan skalabel untuk pemantauan kepatuhan APD di lingkungan konstruksi.

Downloads

Download data is not yet available.

References

Al-Bayati, A. J., Rener, A. T., Listello, M. P., & Mohamed, M. (2023). PPE non-compliance among construction workers: An assessment of contributing factors utilizing fuzzy theory. Journal of Safety Research, 85, 242–253. https://doi.org/10.1016/j.jsr.2023.02.008

Almaskati, D., Kermanshachi, S., Pamidimukkala, A., Loganathan, K., & Yin, Z. (2024). A review on construction safety: Hazards, mitigation strategies, and impacted sectors. Buildings, 14(2), 526. https://doi.org/10.3390/buildings14020526

Arip, A. A. S., Sazali, N., Kadirgama, K., Jamaludin, A. S., Turan, F. M., & Ab. Razak, N. (2024). Object detection for safety attire using YOLO (You Only Look Once). Journal of Advanced Research in Applied Mechanics, 113(1), 37–51. https://doi.org/10.37934/aram.113.1.3751

Atasoy, M., Temel, B. A., & Basaga, H. B. (2024). A study on the use of personal protective equipment among construction workers in Türkiye. Buildings, 14(8), 2430. https://doi.org/10.3390/buildings14082430

Babalola, A., Manu, P., Cheung, C., Yunusa-Kaltungo, A., & Bartolo, P. (2023). A systematic review of the application of immersive technologies for safety and health management in the construction sector. Journal of Safety Research, 85, 66–85. https://doi.org/10.1016/j.jsr.2023.01.007

Badhan, S. J., & Samsami, R. (2025). Artificial intelligence (AI) in construction safety: A systematic literature review. Buildings, 15(22), 4084. https://doi.org/10.3390/buildings15224084

BlackBoxGuild. (2025). Medium shot, workers are busy in the middle of a big construction [Video]. Freepik. https://www.freepik.com/premium-video/medium-shot-workers-are-busy-middle-big-construction_921115

Fang, W., Ding, L., Luo, H., & Love, P. E. D. (2020). Computer vision applications in construction safety assurance. Automation in Construction, 110, 103013. https://doi.org/10.1016/j.autcon.2019.103013

Gu, X., Han, J., Shen, Q., & Angelov, P. P. (2023). Autonomous learning for fuzzy systems: A review. Artificial Intelligence Review, 56, 7549–7595. https://doi.org/10.1007/s10462-022-10355-6

Ilbahar, E., Karaşan, A., Cebi, S., & Kahraman, C. (2018). A novel approach to risk assessment for occupational health and safety using Pythagorean fuzzy AHP & fuzzy inference system. Safety Science, 103, 124–136. https://doi.org/10.1016/j.ssci.2017.10.025

Jin, H., & Goodrum, P. M. (2024). Prioritization of personal protective equipment plans for construction projects based on an integrated analytic network process and fuzzy VIKOR method. Applied Sciences, 14(21), 9904. https://doi.org/10.3390/app14219904

Khairuddin, S. H., Hasan, M. H., Hashmani, M. A., & Azam, M. H. (2021). Generating clustering-based interval fuzzy type-2 triangular and trapezoidal membership functions: A structured literature review. Symmetry, 13(2), Article 239. https://doi.org/10.3390/sym13020239

Kim, M. S., Park, B., Sippel, G. J., Mun, A. H., Yang, W., McCarthy, K. H., Fernandez, E., Linguraru, M. G., Sarcevic, A., Marsic, I., & Burd, R. S. (2025). Comparative analysis of personal protective equipment nonadherence detection: Computer vision versus human observers. Journal of the American Medical Informatics Association, 32(1), 163–171. https://doi.org/10.1093/jamia/ocae262

Mitrakas, C., Xanthopoulos, A., & Koulouriotis, D. (2025). Techniques and models for addressing occupational risk using fuzzy logic, neural networks, machine learning, and genetic algorithms: A review and meta-analysis. Applied Sciences, 15(4), 1909. https://doi.org/10.3390/app15041909

Mohandes, S. R., & Zhang, X. (2019). Towards the development of a comprehensive hybrid fuzzy-based occupational risk assessment model for construction workers. Safety Science, 115, 294–309. https://doi.org/10.1016/j.ssci.2019.02.013

Muhammad, K., Obaidat, M. S., Hussain, T., Del Ser, J., Kumar, N., Tanveer, M., & Doctor, F. (2021). Fuzzy logic in surveillance big video data analysis. ACM Computing Surveys, 54(3), Article 3444693. https://doi.org/10.1145/3444693

Nor, R. M., Khairunizam, W., Saifizi, S. M., Ayob, M. N., & Wan Yahya, W. M. N. (2013). Design membership functions of a fuzzy logic controller based on experimental study for an obstacle avoidance algorithm. https://doi.org/10.13140/2.1.2179.7128

Ojha, V., Abraham, A., & Snášel, V. (2019). Heuristic design of fuzzy inference systems: A review of three decades of research. Engineering Applications of Artificial Intelligence, 85, 845–864. https://doi.org/10.1016/j.engappai.2019.08.010

Roboflow. (2024). PPE detection dataset. Roboflow Universe. https://universe.roboflow.com/project-uyrxf/ppe_detection-v1x3l

Sabripoor, A., Ghousi, R., Najafi, M., Barzinpour, F., & Makuei, A. (2024). Risk assessment of organ transplant operation: A fuzzy hybrid MCDM approach based on fuzzy FMEA. PLOS ONE, 19(5), Article e0299655. https://doi.org/10.1371/journal.pone.0299655

Sadeghi, H., Mohandes, S. R., Hosseini, M. R., Banihashemi, S., Mahdiyar, A., & Abdullah, A. (2020). Developing an ensemble predictive safety risk assessment model: Case of Malaysian construction projects. International Journal of Environmental Research and Public Health, 17(22), 8395. https://doi.org/10.3390/ijerph17228395

Sapkota, R., Flores-Calero, M., Qureshi, R., Badgujar, C., Nepal, U., Poulose, A., Zeno, P., Vaddevolu, U. B. P., Khan, S., Shoman, M., Yan, H., & Karkee, M. (2025). YOLO advances to its genesis: A decadal and comprehensive review of the You Only Look Once (YOLO) series. Artificial Intelligence Review, 58, Article 274. https://doi.org/10.1007/s10462-025-11253-3

Shah, I. A., & Mishra, S. (2024). Artificial intelligence in advancing occupational health and safety: An encapsulation of developments. Journal of Occupational Health, 66(1), uiad017. https://doi.org/10.1093/joccuh/uiad017

Then Yung, N. D., Wong, W. K., Juwono, F. H., & Sim, Z. A. (2022). Safety helmet detection using deep learning: Implementation and comparative study using YOLOv5, YOLOv6, and YOLOv7. 2022 International Conference on Green Energy, Computing and Sustainable Technology (GECOST). https://doi.org/10.1109/GECOST55694.2022.10010490

Tian, Y., Ye, Q., & Zhang, D. (2025). YOLOv12: Attention-centric real-time object detectors. arXiv preprint arXiv:2502.12524.

Vukicevic, A. M., Petrovic, M., Milosevic, P., Peulic, A., Jovanovic, K., & Novakovic, A. (2024). A systematic review of computer vision-based personal protective equipment compliance in industry practice: Advancements, challenges, and future directions. Artificial Intelligence Review, 57, 319. https://doi.org/10.1007/s10462-024-10978-x

Wenkel, S., Acz, S., Trace, T., Müller, S., & Artz, D. (2021). Confidence score: The forgotten dimension of object detection performance evaluation. Sensors, 21(13), 4350. https://doi.org/10.3390/s21134350

Yankson, I. K., Nsiah-Achampong, N. K., Okyere, P., Afukaar, F., Otupiri, E., Donkor, P., Mock, C., & Owusu-Dabo, E. (2021). On-site personal protective equipment signage and use by road construction workers in Ghana: A comparative study of foreign- and locally-owned companies. BMC Public Health, 21, 12376. https://doi.org/10.1186/s12889-021-12376-2

Zaidi, S. S. A., Ansari, M. S., Aslam, A., Kanwal, N., Asghar, M., & Lee, B. (2024). A survey of modern deep learning based object detection models. Digital Signal Processing, 126, 103514. https://doi.org/10.1016/j.dsp.2022.103514.