Detection of human respiration patterns using deep convolution neural networks

Authors

DOI:

https://doi.org/10.15587/1729-4061.2018.139997

Keywords:

accelerometer, deep learning, respiration patterns, convolution neural networks, machine learning

Abstract

The method for real­time recognition of respiration types (patterns) of a patient to monitor his conditions and threats to his health, which is a special case of the problem of human activities recognition (HAR), was proposed. The method is based on application of deep machine learning using the convolution neural network (CNN) to classify the chest motion speed. It was shown that the decisions, taken in this case, are coordinated with mobile medicine technology (mHealth) of the use of body sensors and smartphones for signals processing, but CNN offer important additional opportunities at improving the quality of processing the accelerometer­sensor signals in the presence of interfering signals (noise) from other sources and instrumental errors of devices. We proposed the method of transformation of one­dimensional (1D) accelerometer signals into two­dimensional (2D) graphic images, processed using CNN with multiple processing layers, due to which the accuracy of determining the respiration pattern in various situations for different physical states of patients increases compared with the case when two­dimensional accelerometer signal conversion is not used. In this case, an increase in accuracy (or quality) of determining different types of respiration occurs while maintaining a sufficient speed of performing procedures of the planned method, which allows classification of respiration types in real time. This technique was tested as a component of the Body Sensor Network (BSN) and high accuracy (88 %) of determining the patient’s respiration state was established, which in combination with contextual data, obtained from other BSN nodes, makes it possible to determine the patient’s state and a signal of the aggravation of their respiratory diseases.

Author Biographies

Anatoly Petrenko, National Technical University of Ukraine "Igor Sikorsky Kiev Polytechnic Institute" Peremohy ave., 37, Kyiv, Ukraine, 03056

Doctor of Technical Sciences, Professor, Head of Department

Department of System Design

Institute of Applied Systems Analysis

Roman Kyslyi, National Technical University of Ukraine "Igor Sikorsky Kiev Polytechnic Institute" Peremohy ave., 37, Kyiv, Ukraine, 03056

Postgraduate student

Department of System Design

Institute of Applied Systems Analysis

Ihor Pysmennyi, National Technical University of Ukraine "Igor Sikorsky Kiev Polytechnic Institute" Peremohy ave., 37, Kyiv, Ukraine, 03056

Postgraduate student

Department of System Design

Institute of Applied Systems Analysis

References

  1. Goodfellow, I., Bengio, Y., Courville, A. Deep Learning. Available at: http://www.deeplearningbook.org/
  2. Huynh, T., Schiele, B. (2005). Analyzing features for activity recognition. Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence Innovative Context-Aware Services: Usages and Technologies – sOc-EUSAI ’05. doi: https://doi.org/10.1145/1107548.1107591
  3. Larson, E. C., Goel, M., Boriello, G., Heltshe, S., Rosenfeld, M., Patel, S. N. SpiroSmart: Using a Microphone to Measure Lung Function on a Mobile Phone. Available at: https://homes.cs.washington.edu/~shwetak/papers/SpiroSmart.CR.Final.pdf
  4. Shephard, R. J. (1966). The oxygen cost of breathing during vigorous exercise. Quarterly Journal of Experimental Physiology and Cognate Medical Sciences, 51 (4), 336–350. doi: https://doi.org/10.1113/expphysiol.1966.sp001868
  5. Rakhimov, A. Abnormal breathing pattern causes asthma and attacks. Available at: https://www.worldwidehealth.com/health-article-Abnormal-breathing-pattern-causes-asthma-and-attacks.html
  6. Fekr, A. R., Janidarmian, M., Radecka, K., Zilic, Z. (2005). Movement analysis of the chest compartments and a real-time quality feedback during breathing therapy. In Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence: Innovative Context-aware Services: Usages and Technologies.
  7. Bates, A., Ling, M. J., Mann, J., Arvind, D. K. (2010). Respiratory Rate and Flow Waveform Estimation from Tri-axial Accelerometer Data. 2010 International Conference on Body Sensor Networks. doi: https://doi.org/10.1109/bsn.2010.50
  8. Que, C.-L., Kolmaga, C., Durand, L.-G., Kelly, S. M., Macklem, P. T. (2002). Phonospirometry for noninvasive measurement of ventilation: methodology and preliminary results. Journal of Applied Physiology, 93 (4), 1515–1526. doi: https://doi.org/10.1152/japplphysiol.00028.2002
  9. Liu, G.-Z., Guo, Y.-W., Zhu, Q.-S., Huang, B.-Y., Wang, L. (2011). Estimation of Respiration Rate from Three-Dimensional Acceleration Data Based on Body Sensor Network. Telemedicine and e-Health, 17 (9), 705–711. doi: https://doi.org/10.1089/tmj.2011.0022
  10. Yoon, J.-W., Noh, Y.-S., Kwon, Y.-S., Kim, W.-K., Yoon, H.-R. (2014). Improvement of Dynamic Respiration Monitoring Through Sensor Fusion of Accelerometer and Gyro-sensor. Journal of Electrical Engineering and Technology, 9 (1), 334–343. doi: https://doi.org/10.5370/jeet.2014.9.1.334
  11. Jin, A., Yin, B., Morren, G., Duric, H., Aarts, R. M. (2009). Performance evaluation of a tri-axial accelerometry-based respiration monitoring for ambient assisted living. 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. doi: https://doi.org/10.1109/iembs.2009.5333116
  12. Uddin, J., Van, D. N., Kim, J.-M. (2015). Accelerating 2D Fault Diagnosis of an Induction Motor using a Graphics Processing Unit. International Journal of Multimedia and Ubiquitous Engineering, 10 (1), 341–352. doi: https://doi.org/10.14257/ijmue.2015.10.1.32
  13. Ciobotariu, R., Adochiei, F., Rotariu, C., Costin, H. (2011). Wireless breathing system for long term telemonitoring of respiratory activity. Advanced topics in electrical engineering, Proceedings of the 7th international symposium ATEE, 635–638.
  14. Bulling, A., Blanke, U., Schiele, B. (2014). A tutorial on human activity recognition using body-worn inertial sensors. ACM Computing Surveys, 46 (3), 1–33. doi: https://doi.org/10.1145/2499621
  15. Zhang, J., Mitliagkas, I. YellowFin and the Art of Momentum Tuning. Available at: https://arxiv.org/pdf/1706.03471.pdf
  16. Yang, J. B., Nguyen, M. N., San, P. P., Li, X. L., Krishnaswamy, S. (2015). Deep Convolutional Neural Networks On Multichannel Time Series For Human Activity Recognition. Proceeding IJCAI'15 Proceedings of the 24th International Conference on Artificial Intelligence, 3995–4001.
  17. Zeng, M., Nguyen, L. T., Yu, B., Mengshoel, O. J., Zhu, J., Wu, P., Zhang, J. (2014). Convolutional Neural Networks for Human Activity Recognition using Mobile Sensors. Proceedings of the 6th International Conference on Mobile Computing, Applications and Services. doi: https://doi.org/10.4108/icst.mobicase.2014.257786
  18. Jiang, W., Yin, Z. (2015). Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks. Proceedings of the 23rd ACM International Conference on Multimedia – MM ’15. doi: https://doi.org/10.1145/2733373.2806333
  19. Ordóñez, F., Roggen, D. (2016). Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition. Sensors, 16 (1), 115. doi: https://doi.org/10.3390/s16010115

Downloads

Published

2018-08-02

How to Cite

Petrenko, A., Kyslyi, R., & Pysmennyi, I. (2018). Detection of human respiration patterns using deep convolution neural networks. Eastern-European Journal of Enterprise Technologies, 4(9 (94), 6–13. https://doi.org/10.15587/1729-4061.2018.139997

Issue

Vol. 4 No. 9 (94) (2018): Information and controlling system

Section

Information and controlling system

License

Copyright (c) 2018 Anatoly Petrenko, Roman Kyslyi, Ihor Pysmennyi

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The consolidation and conditions for the transfer of copyright (identification of authorship) is carried out in the License Agreement. In particular, the authors reserve the right to the authorship of their manuscript and transfer the first publication of this work to the journal under the terms of the Creative Commons CC BY license. At the same time, they have the right to conclude on their own additional agreements concerning the non-exclusive distribution of the work in the form in which it was published by this journal, but provided that the link to the first publication of the article in this journal is preserved.

A license agreement is a document in which the author warrants that he/she owns all copyright for the work (manuscript, article, etc.).
The authors, signing the License Agreement with TECHNOLOGY CENTER PC, have all rights to the further use of their work, provided that they link to our edition in which the work was published.
According to the terms of the License Agreement, the Publisher TECHNOLOGY CENTER PC does not take away your copyrights and receives permission from the authors to use and dissemination of the publication through the world's scientific resources (own electronic resources, scientometric databases, repositories, libraries, etc.).
In the absence of a signed License Agreement or in the absence of this agreement of identifiers allowing to identify the identity of the author, the editors have no right to work with the manuscript.
It is important to remember that there is another type of agreement between authors and publishers – when copyright is transferred from the authors to the publisher. In this case, the authors lose ownership of their work and may not use it in any way.