Signal correction in accordance with the movement of the optimum listening area

Authors

  • Сергей Михайлович Порошин National Technical University "Kharkiv Polytechnic Institute" Str. Frunze 21, Kharkov, Ukraine, 61002, Ukraine
  • Игорь Сергеевич Беликов National Technical University "Kharkiv Polytechnic Institute" Str. Frunze 21, Kharkov, Ukraine, 61002, Ukraine

DOI:

https://doi.org/10.15587/1729-4061.2013.14840

Keywords:

OpenNI, Native Interaction, VST-plug-in, OpenCV

Abstract

Interactive participation of a human is becoming more and more popular in the management interface. The human motion capture is the next step in computer information control. Regular controls such as keyboards and ”mice” will be replaced by a more interactive input-output control method. Now web cameras can detect human faces, human gestures and follow their movements in a frame.

The revolutionary technology of OpenCV is one of these developments. The essence of this technology is the detection of facial features in an image-tracking and capturing hand movements, certain gestures and non-verbal commands.

OpenNI algorithm can convert human movements from a central location in a set of three-dimensional coordinate data. It can be converted to midi-messages and sent to the soundcard which makes adjustments to the volume of the acoustic signal from each of a sound system five cannels. It greatly expands opportunities of the stereo while listening the music and watching movies.

The aim of this research work is to combine the developments in the field of acoustic signal at the loudspeaker system 5.1 and the person location recognition system OpenNI. Knowing the coordinates of the 5.1 speaker system satellites and tracking human movements in the area, surrounded by these speakers, an engineer can further restore the pressure effect while listening to the audio tracks.

It improves the perception of sounds and music which come from the speakers, enhances the interactive human presence effect.

Author Biographies

Сергей Михайлович Порошин, National Technical University "Kharkiv Polytechnic Institute" Str. Frunze 21, Kharkov, Ukraine, 61002

Doctor of Technical Sciences, Professor

The department of information technology and multimedia systems

Игорь Сергеевич Беликов, National Technical University "Kharkiv Polytechnic Institute" Str. Frunze 21, Kharkov, Ukraine, 61002

Graduate student

The department of information technology and multimedia systems

References

  1. Miles, R. Start Here! Learn Microsoft Kinect API [Текст] / Rob Miles; O’Reilly Media, Inc. // Gravenstein Highway North Sebastopol, California 95472. – 2012. – c. 272.
  2. Spors, S. Spatial aliasing artifacts produced by linear and circular loudspeaker arrays used for wave field synthesis. [Текст] / S. Spors, R. Rabenstein // Deutsche Telekom Laboratories, Ernst-Reuter Platz 7, 10587 Berlin, Germany. – 2006. – c. 14
  3. Wittek, H. Perceptual difference between wavefield synthesis and stereophony [Текст] / H. Wittek // Department of music and sound recording school of Arts, Communication and Humanities, University of Surrey. – 2007. – c. 228.
  4. Jana, A. Kinect for Windows SDK Programming Guide. [Текст] / A. Jana; Published by Packt Publishing Ltd. // Livery Place, 35 Livery Street, Birmingham B3 2PB, UK. ISBN 978-1-84969-238-0. – 2012. – c. 392.
  5. Catuhe, D. Programming with the Kinect for Windows. [Текст] / D. Catuhe // Microsoft Press, Redmond, Washington 98052-6399. – 2012. – c. 224.
  6. Bradski, G. Learning OpenCV. [Текст] / G. Bradski, A. Kaehler; O’Reilly Media, Inc., // 1005 Gravenstein Highway North, Sebastopol, CA 95472. – 2008. – c. 571.
  7. Kinect for Windows. Human Interface Guidelines v1.7 [Текст] / Microsoft Corporation. – 2013. – c. 135.
  8. Кононович, Л. М. Стереофоническое восприятие звука. [Текст] / Л.М. Кононович, Ю.А. Ковалгин. – М.: Радио и связь, 1981. – 184 с., ил.
  9. Крылов, В. В. Основы теории излучения и рассеяния звука. [Текст] – М.: Издательство Моск. ун-та, 1989. – с.118.
  10. OpenAL 1.1 Specification and Reference [Текст] / – 2005. – с. 62.
  11. Rob Miles (2012). Start Here! Learn Microsoft Kinect API. O’Reilly Media, Inc. 1005 Gravenstein Highway North Sebastopol, California 95472.
  12. Sasha Spors and Rudolf Rabenstein (2006). Spatial aliasing artifacts produced by linear and circular loudspeaker arrays used for wave field synthesis. Deutsche Telekom Laboratories, Ernst-Reuter Platz 7, 10587 Berlin, Germany.
  13. Helmut Wittek (2007). Perceptual difference between wavefield synthesis and stereophony / Department of music and sound recording school of Arts, Communication and Humanities, University of Surrey.
  14. Abhijit Jana (2012). Kinect for Windows SDK Programming Guide. Published by Packt Publishing Ltd. Livery Place, 35 Livery Street, Birmingham B3 2PB, UK. ISBN 978-1-84969-238-0.
  15. David Catuhe (2012). Programming with the Kinect for Windows. Microsoft Press, Redmond, Washington 98052-6399.
  16. Gary Bradski and Adrian Kaehler (2008). Learning OpenCV. O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472.
  17. Kinect for Windows (2013). Human Interface Guidelines v1.7 / Microsoft Corporation.
  18. Л. М. Кононович, Ю. А. Ковалгин (1981). Стереофоническое восприятие звука / Москва: Радио и связь.
  19. В. В. Крылов (1989) Основы теории излучения и рассеяния звука. М.: Издательство Моск. ун-та.
  20. OpenAL 1.1 Specification and Reference (2005).

Published

2013-06-19

How to Cite

Порошин, С. М., & Беликов, И. С. (2013). Signal correction in accordance with the movement of the optimum listening area. Eastern-European Journal of Enterprise Technologies, 3(9(63), 4–6. https://doi.org/10.15587/1729-4061.2013.14840

Issue

Section

Information and controlling system