Signal correction in accordance with the movement of the optimum listening area
DOI:
https://doi.org/10.15587/1729-4061.2013.14840Keywords:
OpenNI, Native Interaction, VST-plug-in, OpenCVAbstract
Interactive participation of a human is becoming more and more popular in the management interface. The human motion capture is the next step in computer information control. Regular controls such as keyboards and ”mice” will be replaced by a more interactive input-output control method. Now web cameras can detect human faces, human gestures and follow their movements in a frame.
The revolutionary technology of OpenCV is one of these developments. The essence of this technology is the detection of facial features in an image-tracking and capturing hand movements, certain gestures and non-verbal commands.
OpenNI algorithm can convert human movements from a central location in a set of three-dimensional coordinate data. It can be converted to midi-messages and sent to the soundcard which makes adjustments to the volume of the acoustic signal from each of a sound system five cannels. It greatly expands opportunities of the stereo while listening the music and watching movies.
The aim of this research work is to combine the developments in the field of acoustic signal at the loudspeaker system 5.1 and the person location recognition system OpenNI. Knowing the coordinates of the 5.1 speaker system satellites and tracking human movements in the area, surrounded by these speakers, an engineer can further restore the pressure effect while listening to the audio tracks.
It improves the perception of sounds and music which come from the speakers, enhances the interactive human presence effect.
References
- Miles, R. Start Here! Learn Microsoft Kinect API [Текст] / Rob Miles; O’Reilly Media, Inc. // Gravenstein Highway North Sebastopol, California 95472. – 2012. – c. 272.
- Spors, S. Spatial aliasing artifacts produced by linear and circular loudspeaker arrays used for wave field synthesis. [Текст] / S. Spors, R. Rabenstein // Deutsche Telekom Laboratories, Ernst-Reuter Platz 7, 10587 Berlin, Germany. – 2006. – c. 14
- Wittek, H. Perceptual difference between wavefield synthesis and stereophony [Текст] / H. Wittek // Department of music and sound recording school of Arts, Communication and Humanities, University of Surrey. – 2007. – c. 228.
- Jana, A. Kinect for Windows SDK Programming Guide. [Текст] / A. Jana; Published by Packt Publishing Ltd. // Livery Place, 35 Livery Street, Birmingham B3 2PB, UK. ISBN 978-1-84969-238-0. – 2012. – c. 392.
- Catuhe, D. Programming with the Kinect for Windows. [Текст] / D. Catuhe // Microsoft Press, Redmond, Washington 98052-6399. – 2012. – c. 224.
- Bradski, G. Learning OpenCV. [Текст] / G. Bradski, A. Kaehler; O’Reilly Media, Inc., // 1005 Gravenstein Highway North, Sebastopol, CA 95472. – 2008. – c. 571.
- Kinect for Windows. Human Interface Guidelines v1.7 [Текст] / Microsoft Corporation. – 2013. – c. 135.
- Кононович, Л. М. Стереофоническое восприятие звука. [Текст] / Л.М. Кононович, Ю.А. Ковалгин. – М.: Радио и связь, 1981. – 184 с., ил.
- Крылов, В. В. Основы теории излучения и рассеяния звука. [Текст] – М.: Издательство Моск. ун-та, 1989. – с.118.
- OpenAL 1.1 Specification and Reference [Текст] / – 2005. – с. 62.
- Rob Miles (2012). Start Here! Learn Microsoft Kinect API. O’Reilly Media, Inc. 1005 Gravenstein Highway North Sebastopol, California 95472.
- Sasha Spors and Rudolf Rabenstein (2006). Spatial aliasing artifacts produced by linear and circular loudspeaker arrays used for wave field synthesis. Deutsche Telekom Laboratories, Ernst-Reuter Platz 7, 10587 Berlin, Germany.
- Helmut Wittek (2007). Perceptual difference between wavefield synthesis and stereophony / Department of music and sound recording school of Arts, Communication and Humanities, University of Surrey.
- Abhijit Jana (2012). Kinect for Windows SDK Programming Guide. Published by Packt Publishing Ltd. Livery Place, 35 Livery Street, Birmingham B3 2PB, UK. ISBN 978-1-84969-238-0.
- David Catuhe (2012). Programming with the Kinect for Windows. Microsoft Press, Redmond, Washington 98052-6399.
- Gary Bradski and Adrian Kaehler (2008). Learning OpenCV. O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472.
- Kinect for Windows (2013). Human Interface Guidelines v1.7 / Microsoft Corporation.
- Л. М. Кононович, Ю. А. Ковалгин (1981). Стереофоническое восприятие звука / Москва: Радио и связь.
- В. В. Крылов (1989) Основы теории излучения и рассеяния звука. М.: Издательство Моск. ун-та.
- OpenAL 1.1 Specification and Reference (2005).
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2014 Сергей Михайлович Порошин, Игорь Сергеевич Беликов
This work is licensed under a Creative Commons Attribution 4.0 International License.
The consolidation and conditions for the transfer of copyright (identification of authorship) is carried out in the License Agreement. In particular, the authors reserve the right to the authorship of their manuscript and transfer the first publication of this work to the journal under the terms of the Creative Commons CC BY license. At the same time, they have the right to conclude on their own additional agreements concerning the non-exclusive distribution of the work in the form in which it was published by this journal, but provided that the link to the first publication of the article in this journal is preserved.
A license agreement is a document in which the author warrants that he/she owns all copyright for the work (manuscript, article, etc.).
The authors, signing the License Agreement with TECHNOLOGY CENTER PC, have all rights to the further use of their work, provided that they link to our edition in which the work was published.
According to the terms of the License Agreement, the Publisher TECHNOLOGY CENTER PC does not take away your copyrights and receives permission from the authors to use and dissemination of the publication through the world's scientific resources (own electronic resources, scientometric databases, repositories, libraries, etc.).
In the absence of a signed License Agreement or in the absence of this agreement of identifiers allowing to identify the identity of the author, the editors have no right to work with the manuscript.
It is important to remember that there is another type of agreement between authors and publishers – when copyright is transferred from the authors to the publisher. In this case, the authors lose ownership of their work and may not use it in any way.