PURPOSE: To obtain a multichannel decoder matrix in a decoder apparatus without storing a decoder... more PURPOSE: To obtain a multichannel decoder matrix in a decoder apparatus without storing a decoder matrix table containing many matrixes. CONSTITUTION: The present encoder matrix is first reconstituted in a decoder by using related transmitted information instead of addressing a necessary data matrix stored in a decoder memory. Then the necessary decoder matrix is calculated from the reconstituted encoder matrix. This is possible from such a fact that the necessary calculating time is remarkably shorter than the calculating time required for the audio signal filter of the decoder.
PURPOSE: To improve a signal transmitting method of the concept of a demanded item 1 in order to ... more PURPOSE: To improve a signal transmitting method of the concept of a demanded item 1 in order to obtain the optimum frequency selection property of an encoded and decoded signals and high subjective quality. CONSTITUTION: In the method for transmitting a signal which is successively divided into continuous blocks by a window, partial signals included in the blocks are respectively converted into one spectrum by conversion, the spectrum is successively encoded after that so as to be transmitted and, then, decoded, they are returned to the partial signals again by reverse conversion, the blocks including the partial signals are superimposed, mutually connected and arrayed, an area where the blocks are superimposed is weighted at that time and the generation value of the window function is made to be one. In this method, the window function is selected by relying on the frequency change of the signal. The window function and the length of it are selected by relying on the frequency cha...
Dolby AC-3 and MPEGZ Audio are two different standards for the compression of up to six independe... more Dolby AC-3 and MPEGZ Audio are two different standards for the compression of up to six independent digital audio channels into a single serial bit stream. This paper describes a DSP-based integrated circuit which implements the two decoding algorithms, allowing original pulse code modulation (PCM) information to be recovered from an encoded bit stream. In this paper we mainly describe the methodology which was employed to design and validate the software embedded on the chip.
Videorecorder oder Lesegerat fur eine Kassette mit einem Halbleiterspeicher zum Schreiben und Les... more Videorecorder oder Lesegerat fur eine Kassette mit einem Halbleiterspeicher zum Schreiben und Lesen von kassettentypischen Daten, dadurch gekennzeichnet, das Mittel vorgesehen sind, die wahrend eines Aufnahmevorgangs nach einer manuellen Betatigung (4) oder selbsttatig das Signal eines Bildes in den Speicher (3) schreiben.
Spatial audio processing is a key feature of the European funded FascinatE project. The FascinatE... more Spatial audio processing is a key feature of the European funded FascinatE project. The FascinatE project will develop a system to allow end-users to interactively navigate and view around an ultra-high resolution video panorama showing a live event, with the accompanying audio automatically changing to match the selected view. The output will be adapted to their particular kind of device, covering anything from a mobile handset to an immersive panoramic display. The audio part of this project makes a spatial sound description available to the user. The facilitated technologies include Higher Order Ambisonics as well as Wave Field Synthesis. For Ambisonics, sound field information is recorded using microphone arrays like the SoundField microphone for first order signals or the Eigenmike for Higher Order Ambisonics representations. A Premier League match at the Stamford Bridge, London, was captured to provide audio-visual content form a live event. For the audio recording a number of s...
The media industry is currently being pulled in the often-opposing directions of increased realis... more The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalisation (selection and control of content, availability on many devices). A capture, production and delivery system capable of supporting both these trends is being developed by a consortium of European organisations in the EU-funded FascinatE project. This paper reports on the latest developments and presents results obtained from a test shoot at a UK Premier League football match. These include the use of imagery from broadcast cameras to add detail to key areas of the panoramic scene, and the automated generation of spatial audio to match the selected view. The paper explains how a 3D laser scan of the scene can help register the cameras and microphones into a common reference frame.
FascinatE is a European funded project that aims at developing a system to allow end users to int... more FascinatE is a European funded project that aims at developing a system to allow end users to interactively navigate around a video panorama showing a live event, with the accompanying audio automatically changing to match the selected view. The audiovisual content will be ...
Proceedings of the 4th ACM Multimedia Systems Conference on - MMSys '13, 2013
The media industry is currently being pulled in the often-opposing directions of increased realis... more The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalization (selection and control of content, availability on many devices). We investigate the feasibility of an end-to-end format-agnostic approach to support both these trends. In this paper, different aspects of a formatagnostic capture, production, delivery and rendering system are discussed. At the capture stage, the concept of layered scene representation is introduced, including panoramic video and 3D audio capture. At the analysis stage, a virtual director component is discussed that allows for automatic execution of cinematographic principles, using feature tracking and saliency detection. At the delivery stage, resolution-independent audiovisual transport mechanisms for both managed and unmanaged networks are treated. In the rendering stage, a rendering process that includes the manipulation of audiovisual content to match the connected display and loudspeaker properties is introduced. Different parts of the complete system are revisited demonstrating the requirements and the potential of this advanced concept.
An end-to-end AV broadcast system providing an immersive, interactive experience for live events ... more An end-to-end AV broadcast system providing an immersive, interactive experience for live events is the development aim for the EU FP7 funded project, FascinatE. The project has developed real time audio object event detection and localisation, scene modelling and processing methods for multimedia data including 3D audio, which will allow users to navigate the event by creating their own unique user-defined scene. As part of the first implementation of the system a test shoot was carried out capturing a live Premier League football game and methods have been developed to detect, analyse, extract and localise salient audio events from a range of sensors and represent them within an audio scene in order to allow free navigation within the scene.
The media industry is currently being pulled in the often-opposing directions of increased realis... more The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalisation (selection and control of content, availability on many devices). A capture, production and delivery system capable of supporting both these trends is being developed by a consortium of European organisations in the EU-funded FascinatE project. This paper reports on the latest developments and presents results obtained from a test shoot at a UK Premier League football match. These include the use of imagery from broadcast cameras to add detail to key areas of the panoramic scene, and the automated generation of spatial audio to match the selected view. The paper explains how a 3D laser scan of the scene can help register the cameras and microphones into a common reference frame.
PURPOSE: To obtain a multichannel decoder matrix in a decoder apparatus without storing a decoder... more PURPOSE: To obtain a multichannel decoder matrix in a decoder apparatus without storing a decoder matrix table containing many matrixes. CONSTITUTION: The present encoder matrix is first reconstituted in a decoder by using related transmitted information instead of addressing a necessary data matrix stored in a decoder memory. Then the necessary decoder matrix is calculated from the reconstituted encoder matrix. This is possible from such a fact that the necessary calculating time is remarkably shorter than the calculating time required for the audio signal filter of the decoder.
PURPOSE: To improve a signal transmitting method of the concept of a demanded item 1 in order to ... more PURPOSE: To improve a signal transmitting method of the concept of a demanded item 1 in order to obtain the optimum frequency selection property of an encoded and decoded signals and high subjective quality. CONSTITUTION: In the method for transmitting a signal which is successively divided into continuous blocks by a window, partial signals included in the blocks are respectively converted into one spectrum by conversion, the spectrum is successively encoded after that so as to be transmitted and, then, decoded, they are returned to the partial signals again by reverse conversion, the blocks including the partial signals are superimposed, mutually connected and arrayed, an area where the blocks are superimposed is weighted at that time and the generation value of the window function is made to be one. In this method, the window function is selected by relying on the frequency change of the signal. The window function and the length of it are selected by relying on the frequency cha...
Dolby AC-3 and MPEGZ Audio are two different standards for the compression of up to six independe... more Dolby AC-3 and MPEGZ Audio are two different standards for the compression of up to six independent digital audio channels into a single serial bit stream. This paper describes a DSP-based integrated circuit which implements the two decoding algorithms, allowing original pulse code modulation (PCM) information to be recovered from an encoded bit stream. In this paper we mainly describe the methodology which was employed to design and validate the software embedded on the chip.
Videorecorder oder Lesegerat fur eine Kassette mit einem Halbleiterspeicher zum Schreiben und Les... more Videorecorder oder Lesegerat fur eine Kassette mit einem Halbleiterspeicher zum Schreiben und Lesen von kassettentypischen Daten, dadurch gekennzeichnet, das Mittel vorgesehen sind, die wahrend eines Aufnahmevorgangs nach einer manuellen Betatigung (4) oder selbsttatig das Signal eines Bildes in den Speicher (3) schreiben.
Spatial audio processing is a key feature of the European funded FascinatE project. The FascinatE... more Spatial audio processing is a key feature of the European funded FascinatE project. The FascinatE project will develop a system to allow end-users to interactively navigate and view around an ultra-high resolution video panorama showing a live event, with the accompanying audio automatically changing to match the selected view. The output will be adapted to their particular kind of device, covering anything from a mobile handset to an immersive panoramic display. The audio part of this project makes a spatial sound description available to the user. The facilitated technologies include Higher Order Ambisonics as well as Wave Field Synthesis. For Ambisonics, sound field information is recorded using microphone arrays like the SoundField microphone for first order signals or the Eigenmike for Higher Order Ambisonics representations. A Premier League match at the Stamford Bridge, London, was captured to provide audio-visual content form a live event. For the audio recording a number of s...
The media industry is currently being pulled in the often-opposing directions of increased realis... more The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalisation (selection and control of content, availability on many devices). A capture, production and delivery system capable of supporting both these trends is being developed by a consortium of European organisations in the EU-funded FascinatE project. This paper reports on the latest developments and presents results obtained from a test shoot at a UK Premier League football match. These include the use of imagery from broadcast cameras to add detail to key areas of the panoramic scene, and the automated generation of spatial audio to match the selected view. The paper explains how a 3D laser scan of the scene can help register the cameras and microphones into a common reference frame.
FascinatE is a European funded project that aims at developing a system to allow end users to int... more FascinatE is a European funded project that aims at developing a system to allow end users to interactively navigate around a video panorama showing a live event, with the accompanying audio automatically changing to match the selected view. The audiovisual content will be ...
Proceedings of the 4th ACM Multimedia Systems Conference on - MMSys '13, 2013
The media industry is currently being pulled in the often-opposing directions of increased realis... more The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalization (selection and control of content, availability on many devices). We investigate the feasibility of an end-to-end format-agnostic approach to support both these trends. In this paper, different aspects of a formatagnostic capture, production, delivery and rendering system are discussed. At the capture stage, the concept of layered scene representation is introduced, including panoramic video and 3D audio capture. At the analysis stage, a virtual director component is discussed that allows for automatic execution of cinematographic principles, using feature tracking and saliency detection. At the delivery stage, resolution-independent audiovisual transport mechanisms for both managed and unmanaged networks are treated. In the rendering stage, a rendering process that includes the manipulation of audiovisual content to match the connected display and loudspeaker properties is introduced. Different parts of the complete system are revisited demonstrating the requirements and the potential of this advanced concept.
An end-to-end AV broadcast system providing an immersive, interactive experience for live events ... more An end-to-end AV broadcast system providing an immersive, interactive experience for live events is the development aim for the EU FP7 funded project, FascinatE. The project has developed real time audio object event detection and localisation, scene modelling and processing methods for multimedia data including 3D audio, which will allow users to navigate the event by creating their own unique user-defined scene. As part of the first implementation of the system a test shoot was carried out capturing a live Premier League football game and methods have been developed to detect, analyse, extract and localise salient audio events from a range of sensors and represent them within an audio scene in order to allow free navigation within the scene.
The media industry is currently being pulled in the often-opposing directions of increased realis... more The media industry is currently being pulled in the often-opposing directions of increased realism (high resolution, stereoscopic, large screen) and personalisation (selection and control of content, availability on many devices). A capture, production and delivery system capable of supporting both these trends is being developed by a consortium of European organisations in the EU-funded FascinatE project. This paper reports on the latest developments and presents results obtained from a test shoot at a UK Premier League football match. These include the use of imagery from broadcast cameras to add detail to key areas of the panoramic scene, and the automated generation of spatial audio to match the selected view. The paper explains how a 3D laser scan of the scene can help register the cameras and microphones into a common reference frame.
Uploads
Papers by Jens Spille