Limiting COVID-19 infection by automatic remote face mask monitoring and detection using deep learning with IoT

Authors

DOI:

https://doi.org/10.15587/1729-4061.2021.238359

Keywords:

COVID-19, Computer Vision, Machine Learning, Deep Learning, Remote Control, Embedded System, Big Data, IoT

Abstract

During the current outbreak of the COVID-19 pandemic, controlling and decreasing the possibilities of infections are massively required. One of the most important solutions is to use Artificial Intelligence (AI), which combines both fields of deep learning (DL) and the Internet of Things (IoT). The former one is responsible for detecting any face, which is not wearing a mask. Whereas, the latter is exploited to manage the control for the entire building or a public area such as bus, train station, or airport by connecting a Closed-Circuit Television (CCTV) camera to the room of management. The work is implemented using a Core-i5 CPU workstation attached with a Webcam. Then, MATLAB software is programmed to instruct both Arduino and NodeMCU (Micro-Controller Unit) for remote control as IoT. In terms of deep learning, a 15-layer convolutional neural network is exploited to train 1,376 image samples to generate a reference model to use for comparison. Before deep learning, preprocessing operations for both image enhancement and scaling are applied to each image sample. For the training and testing of the proposed system, the Simulated Masked Face Recognition Dataset ( SMFRD) has been exploited. This dataset is published online. Then, the proposed deep learning system has an average accuracy of up to 98.98 %, where 80 % of the dataset was used for training and 20 % of the samples are dedicated to testing the proposed intelligent system.

The IoT system is implemented using Arduino and NodeMCU_TX (for transmitter) and RX (for receiver) for the signal transferring through long distances. Several experiments have been conducted and showed that the results are reasonable and thus the model can be commercially applied

Author Biographies

Omar Mowaffak Alsaydia, Ninevah University

Master of Science in Computer Network, Assistant Lecturer

Department of Computer and Information

College of Electronics Engineering

Noor Raad Saadallah, Ninevah University

Master, Assistant lecturer

Department of Computer and Information

College of Electronics Engineering

Fahad Layth Malallah, Ninevah University

Master, Lecturer

Department of Computer and Information

College of Electronics Engineering

Maan A. S. AL-Adwany, Ninevah University

Assistant Professor

Department of Computer and Information

College of Electronics Engineering

References

  1. Malallah, F. L., Knymg, S., Abdulameer, S. D. (2018). Vision-based control by hand-directional gestures converting to voice. International Journal of Scientific & Technology Research, 7 (7), 185–190. Available at: https://www.ijstr.org/final-print/july2018/Vision-based-Control-By-Hand-directional-Gestures-Converting-To-Voice.pdf
  2. Jin, X., Liu, C., Xu, T., Su, L., Zhang, X. (2020). Artificial intelligence biosensors: Challenges and prospects. Biosensors and Bioelectronics, 165, 112412. doi: http://doi.org/10.1016/j.bios.2020.112412
  3. Arulprakash, E., Aruldoss, M. (2020). A Study on Fight Against COVID-19 from Latest Technological Intervention. SN Computer Science, 1 (5). doi: http://doi.org/10.1007/s42979-020-00301-0
  4. Chamola, V., Hassija, V., Gupta, V., Guizani, M. (2020). A Comprehensive Review of the COVID-19 Pandemic and the Role of IoT, Drones, AI, Blockchain, and 5G in Managing its Impact. IEEE Access, 8, 90225–90265. doi: http://doi.org/10.1109/access.2020.2992341
  5. Nguyen, T. T. (2021). Artificial intelligence in the battle against coronavirus (COVID-19): a survey and future research directions. arXiv preprint arXiv. doi: http://doi.org/10.36227/techrxiv.12743933
  6. Wang, X., Le, X., Lu, Q. (2020). Analysis of China’s Smart City Upgrade and Smart Logistics Development under the COVID-19 Epidemic. Journal of Physics: Conference Series, 1570, 012066. doi: http://doi.org/10.1088/1742-6596/1570/1/012066
  7. Jignesh Chowdary, G., Punn, N. S., Sonbhadra, S. K., Agarwal, S. (2020). Face Mask Detection Using Transfer Learning of InceptionV3. Lecture Notes in Computer Science, 81–90. doi: http://doi.org/10.1007/978-3-030-66665-1_6
  8. Militante, S. V., Dionisio, N. V. (2020). Real-Time Facemask Recognition with Alarm System using Deep Learning. 2020 11th IEEE Control and System Graduate Research Colloquium (ICSGRC), 106–110. doi: http://doi.org/10.1109/icsgrc49013.2020.9232610
  9. Jiang, M., Fan, X., Yan, H. (2020). RetinaMask: a face mask detector. Available at: https://arxiv.org/pdf/2005.03950.pdf
  10. Rahman, M. M., Manik, M. M. H., Islam, M. M., Mahmud, S., Kim, J.-H. (2020). An Automated System to Limit COVID-19 Using Facial Mask Detection in Smart City Network. 2020 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS). doi: http://doi.org/10.1109/iemtronics51293.2020.9216386
  11. Rahman, A., Hossain, M. S., Alrajeh, N. A., Alsolami, F. (2021). Adversarial Examples – Security Threats to COVID-19 Deep Learning Systems in Medical IoT Devices. IEEE Internet of Things Journal, 8 (12), 9603–9610. doi: http://doi.org/10.1109/jiot.2020.3013710
  12. Kummitha, R. K. R. (2020). Smart technologies for fighting pandemics: The techno- and human- driven approaches in controlling the virus transmission. Government Information Quarterly, 37 (3), 101481. doi: http://doi.org/10.1016/j.giq.2020.101481
  13. Udgata, S. K., Suryadevara, N. K. (2020). Advances in Sensor Technology and IoT Framework to Mitigate COVID-19 Challenges. SpringerBriefs in Applied Sciences and Technology, 55–82. doi: http://doi.org/10.1007/978-981-15-7654-6_4
  14. Baskaran, K., Baskaran, P., Rajaram, V., Kumaratharan, N. (2020). IoT Based COVID Preventive System for Work Environment. 2020 Fourth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), 65–71. doi: http://doi.org/10.1109/i-smac49090.2020.9243471
  15. Petrović, N., Kocić, Đ. (2020). IoT-based System for COVID-19 Indoor Safety Monitoring," preprint). IcETRAN, 1–6.
  16. Malallah, F. L., Shareef, B. T., Saeed, M. G., Yasen, K. N. (2021). Contactless Core-temperature Monitoring by Infrared Thermal Sensor using Mean Absolute Error Analysis. Recent Patents on Engineering, 15 (4). doi: http://doi.org/10.2174/1872212115666201230091420
  17. Zedan, M. J. M., Abduljabbar, A. I., Malallah, F. L., Saeed, M. G. (2020). Controlling Embedded Systems Remotely via Internet-of-Things Based on Emotional Recognition. Advances in Human-Computer Interaction, 2020, 1–10. doi: http://doi.org/10.1155/2020/8895176
  18. Ndiaye, M., Oyewobi, S. S., Abu-Mahfouz, A. M., Hancke, G. P., Kurien, A. M., Djouani, K. (2020). IoT in the Wake of COVID-19: A Survey on Contributions, Challenges and Evolution. IEEE Access, 8, 186821–186839. doi: http://doi.org/10.1109/access.2020.3030090
  19. Knysh, B., Kulyk, Y. (2021). Improving a model of object recognition in images based on a convolutional neural network. Eastern-European Journal of Enterprise Technologies, 3 (9 (111)), 40–50. doi: http://doi.org/10.15587/1729-4061.2021.233786
  20. Awadallah, S., Moure, D., Torres-González, P. (2019). An Internet of Things (IoT) Application on Volcano Monitoring. Sensors, 19 (21), 4651. doi: http://doi.org/10.3390/s19214651
  21. Shahidul Islam, M., Islam, M. T., Almutairi, A. F., Beng, G. K., Misran, N., Amin, N. (2019). Monitoring of the Human Body Signal through the Internet of Things (IoT) Based LoRa Wireless Network System. Applied Sciences, 9 (9), 1884. doi: http://doi.org/10.3390/app9091884
  22. Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., Lew, M. S. (2016). Deep learning for visual understanding: A review. Neurocomputing, 187, 27–48. doi: http://doi.org/10.1016/j.neucom.2015.09.116
  23. Malallah, F., Al-Jubouri, A., Sabaawi, A. (2020). Smiling and Non-smiling Emotion Recognition Based on Lower-half Face using Deep-Learning as Convolutional Neural Network. Proceedings of the Proceedings of the 1st International Multi-Disciplinary Conference Theme: Sustainable Development and Smart Planning, IMDC-SDSP 2020. Cyperspace. doi: http://doi.org/10.4108/eai.28-6-2020.2298175
  24. Kashyap, M., Sharma, V., Gupta, N. (2018). Taking MQTT and NodeMcu to IOT: Communication in Internet of Things. Procedia Computer Science, 132, 1611–1618. doi: http://doi.org/10.1016/j.procs.2018.05.126
  25. Al Dahoud, A., Fezari, M. (2018). NodeMCU V3 For Fast IoT Application Development. Notes, 5.
  26. Bhandary, P. Mask Classifier. Available at: https://github.com/prajnasb/observations
  27. Sokolova, M., Lapalme, G. (2009). A systematic analysis of performance measures for classification tasks. Information Processing & Management, 45 (4), 427–437. doi: http://doi.org/10.1016/j.ipm.2009.03.002
  28. Visa, S., Ramsay, B., Ralescu, A. L., Van Der Knaap, E. (2011). Confusion matrix-based feature selection. MAICS, 710, 120–127. Available at: http://ceur-ws.org/Vol-710/paper37.pdf

Downloads

Published

2021-10-31

How to Cite

Alsaydia, O. M., Saadallah, N. R., Malallah, F. L., & AL-Adwany, M. A. S. (2021). Limiting COVID-19 infection by automatic remote face mask monitoring and detection using deep learning with IoT. Eastern-European Journal of Enterprise Technologies, 5(2 (113), 29–36. https://doi.org/10.15587/1729-4061.2021.238359

Issue

Vol. 5 No. 2 (113) (2021): Information technology. Industry control systems

Section

Information technology

License

Copyright (c) 2021 Omar Mowaffak Alsaydia, Noor Raad Saadallah, Fahad Layth Malallah, Maan A. S. AL-Adwany

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The consolidation and conditions for the transfer of copyright (identification of authorship) is carried out in the License Agreement. In particular, the authors reserve the right to the authorship of their manuscript and transfer the first publication of this work to the journal under the terms of the Creative Commons CC BY license. At the same time, they have the right to conclude on their own additional agreements concerning the non-exclusive distribution of the work in the form in which it was published by this journal, but provided that the link to the first publication of the article in this journal is preserved.

A license agreement is a document in which the author warrants that he/she owns all copyright for the work (manuscript, article, etc.).
The authors, signing the License Agreement with TECHNOLOGY CENTER PC, have all rights to the further use of their work, provided that they link to our edition in which the work was published.
According to the terms of the License Agreement, the Publisher TECHNOLOGY CENTER PC does not take away your copyrights and receives permission from the authors to use and dissemination of the publication through the world's scientific resources (own electronic resources, scientometric databases, repositories, libraries, etc.).
In the absence of a signed License Agreement or in the absence of this agreement of identifiers allowing to identify the identity of the author, the editors have no right to work with the manuscript.
It is important to remember that there is another type of agreement between authors and publishers – when copyright is transferred from the authors to the publisher. In this case, the authors lose ownership of their work and may not use it in any way.