Ambisonics

Not to be confused with Ambiophonics.

Ambisonic trademark

Ambisonics is a full-sphere surround sound technique: in addition to the horizontal plane, it covers sound sources above and below the listener.

Unlike other multichannel surround formats, its transmission channels do not carry speaker signals. Instead, they contain a speaker-independent representation of a sound field called B-format, which is then decoded to the listener's speaker setup. This extra step allows the producer to think in terms of source directions rather than loudspeaker positions, and offers the listener a considerable degree of flexibility as to the layout and number of speakers used for playback.

Ambisonics was developed in the UK in the 1970s under the auspices of the British National Research Development Corporation.

Despite its solid technical foundation and many advantages, Ambisonics has not been a commercial success, and survived only in niche applications and among recording enthusiasts.

With the easy availability of powerful digital signal processing (as opposed to the expensive and error-prone analog circuitry that had to be used during its early years) and the successful market introduction of home theatre surround sound systems since the 1990s, interest in Ambisonics among recording engineers, sound designers, composers, media companies, broadcasters and researchers has returned and continues to increase.

Introduction

Ambisonics can be understood as a three-dimensional extension of M/S (mid/side) stereo, adding additional difference channels for height and depth. The resulting signal set is called B-format. Its component channels are labelled $W$ for the sound pressure (the M in M/S), $X$ for the front-minus-back sound pressure gradient, $Y$ for left-minus-right (the S in M/S) and $Z$ for up-minus-down.

The $W$ signal corresponds to an omnidirectional microphone, whereas $XYZ$ are the components that would be picked up by figure-of-eight capsules oriented along the three spatial axes.

Panning a source

File:Spherical Harmonics deg3.png

Visual representation of the Ambisonic B-format components up to third order. Dark portions represent regions where the polarity is inverted. Note how the first two rows correspond to omnidirectional and figure-of-eight microphone polar patterns.

A simple Ambisonic panner (or encoder) takes a source signal $S$ and two parameters, the horizontal angle $\theta$ and the elevation angle $\phi$. It positions the source at the desired angle by distributing the signal over the Ambisonic components with different gains:

$W=S \cdot \frac{1}{\sqrt{2}}$

$X=S \cdot \cos\theta\cos\phi$

$Y=S \cdot \sin\theta\cos\phi$

$Z=S \cdot \sin\phi$

Being omnidirectional, the $W$ channel always gets the same constant input signal, regardless of the angles. So that is has more-or-less the same average energy as the other channels, W is attenuated by about 3 dB (precisely, divided by the square root of two). The terms for $XYZ$ actually produce the polar patterns of figure-of-eight microphones (see illustration on the right, second row). We take their value at $\theta$ and $\phi$, and multiply the result with the input signal. The result is that the input ends up in all components exactly as loud as the corresponding microphone would have picked it up.

Virtual microphones

File:Virtual Microphone Animation.gif

Morphing between different virtual microphone patterns (click to see animation).

The B-format components can be combined to derive virtual microphones with any first-order polar pattern (omnidirectional, cardioid, hypercardioid, figure-of-eight or anything in between) pointing in any direction. Several such microphones with different parameters can be derived at the same time, to create coincident stereo pairs (such as a Blumlein) or surround arrays.

$p$	Pattern
$0$	Figure-of-eight
$[0,0.5]$	Hyper- and Supercardioids
$0.5$	Cardioid
$[0.5,1.0]$	Wide cardioids
$1.0$	Omnidirectional

A horizontal virtual microphone at horizontal angle $\Theta$ with pattern $0 \leq p \leq 1$ is given by

$M(\Theta, p) = p\sqrt{2} W + (1-p)(\cos\Theta X + \sin\Theta Y)$.

This virtual mic is free-field normalised, which means it has a constant gain of one for on-axis sounds. The illustration on the left shows some exampled created with this formula.

Virtual microphones can be manipulated in post-production: desired sounds can be picked out, unwanted ones suppressed, and the balance between direct and reverberant sound can be fine-tuned during mixing.

Decoding

File:Naive Ambisonic Square Decoder Example.png

Naive single-band in-phase decoder for a square loudspeaker layout.

A basic Ambisonic decoder is very similar to a set of virtual microphones. For perfectly regular layouts (but only there!), a simplified decoder can be generated by pointing a virtual cardioid microphone in the direction of each speaker. Here is a square:

$LF = (2W + X + Y)\sqrt{8}$

$LB = (2W - X + Y)\sqrt{8}$

$RB = (2W - X - Y)\sqrt{8}$

$RF = (2W + X - Y)\sqrt{8}$

The signs of the $X$ and $Y$ components are the important part, the rest are gain factors. The $Z$ component is discarded, because it is not possible to reproduce height cues with just four loudspeakers in one plane.

Please do not implement this example – in practice, a real Ambisonic decoder requires a number of psycho-acoustic optimisations to work properly.

Higher-order Ambisonics

The spatial resolution of first-order Ambisonics as described above is quite low. In practice, that translates to slightly blurry sources, but also to a comparably small usable listening area or sweet spot. The resolution can be increased and the sweet spot enlarged by adding groups of more selective directional components to the B-format. These no longer correspond to conventional microphone polar patterns, but rather look like clover leaves. The resulting signal set is then called Second-, Third-, or collectively, Higher-order Ambisonics.

For a given order $\ell$, full-sphere systems require $(\ell+1)^2$ signal components, and $2\ell+1$ components are needed for horizontal-only reproduction.

See also: Mixed-order Ambisonics

There are several different format conventions for higher-order Ambisonics, for details see Ambisonic data exchange formats.

Comparison to other surround formats

Ambisonics differs from other surround formats in a number of aspects:

• It is isotropic: sounds from any direction are treated equally, as opposed to assuming that the main sources of sound are frontal and that rear channels are only for ambience or special effects.
• All speakers contribute to any one sound in any direction, as opposed to conventional pan-potted (pair-wise mixing) techniques which use only two adjacent speakers. This gives better localisation, particularly to the sides and rear.
• The stability and imaging of the reproduced soundfield vary less with listener position than with most other surround systems. The soundfield can even be appreciated by listeners outside the speaker array, although with reduced localisation performance.
• It requires only three channels for basic horizontal surround, and four channels for a full-sphere soundfield. Basic full-sphere replay requires a minimum of six loudspeakers (a minimum of four for horizontal).
• The Ambisonic signal is decoupled from the playback system: loudspeaker placement is flexible (within reasonable limits), and the same program material can be decoded for varying numbers of loudspeakers. Moreover, a with-height mix can be played back on horizontal-only, stereo or even mono systems without losing content entirely (it will be folded to the horizontal plane and to the frontal quadrant, respectively). This allows producers to embrace with-height production without worrying about loss of information.
• Ambisonics can be scaled to any desired spatial resolution at the cost of additional transmission channels and more speakers for playback. Higher-order material remains downwards compatible and can be played back at lower spatial resolution without requiring a special downmix.
• The core technology of Ambisonics is free of patents, and a complete tool chain for production and listening is available as free software for all major operating systems.

On the downside, Ambisonics is

• not supported by any major record label or media company;
• not widely known, since it has never been marketed well;
• conceptually difficult for people to grasp, as opposed to the conventional "one channel,one speaker" paradigm;
• more complicated for the consumer to set up, because of the decoding stage;
• prone to phasing artifacts when the listener moves or turns, since any one virtual source will be reproduced by several speakers with strong correlation (a situation which is usually avoided in N.1 production).

Theoretical foundation

Soundfield analysis (encoding)

The B-format signals comprise a truncated spherical harmonic decomposition of the sound field. They correspond to the sound pressure $W$, and the three components of the pressure gradient $XYZ$ (not to be confused with the related particle velocity) at a point in space. Together, these approximate the sound field on a sphere around the microphone; formally the first-order truncation of the multipole expansion. $W$ (the mono signal) is the zero-order information, corresponding to a constant function on the sphere, while $XYZ$ are the first-order terms (the dipoles or figures-of-eight). This first-order truncation is only an approximation of the overall sound field.

The higher orders correspond to further terms of the multipole expansion of a function on the sphere in terms of spherical harmonics. In practice, higher orders require more speakers for playback, but increase the spatial resolution and enlarge the area where the sound field is reproduced perfectly (up to an upper boundary frequency).

The radius $r$ of this area for Ambisonic order $\ell$ and frequency $f$ is given by

$r\approx\frac{\ell c}{2 \pi f}$,

where $c$ denotes the speed of sound.

This area becomes smaller than a human head above 600 Hz for first order or 1800 Hz for third-order. Accurate reproduction in a head-sized volume up to 20 kHz would require an order of 32 or more than 1000 loudspeakers.

At those frequencies and listening positions where perfect soundfield reconstruction is no longer possible, Ambisonic reproduction has to focus on delivering correct directional cues to allow for good localisation even in the presence reconstruction errors.

Psychoacoustics

The human hearing apparatus has very keen localisation on the horizontal plane (as fine as 2° source separation in some experiments). Two predominant cues, for different frequency ranges, can be identified:

Low frequency localisation

At low frequencies, where the wavelength is large compared to the human head, an incoming sound diffracts around it, so that there is virtually no acoustic shadow and hence no level difference between the ears. In this range, the only available information is the phase relationship between the two ear signals, called interaural time difference, or ITD. Evaluating this time difference allows for precise localisation within a cone of confusion: the angle of incidence is unambiguous, but the ITD is the same for sounds from the front or from the back. As long as the sound is not totally unknown to the subject, the confusion can usually be resolved by perceiving the timbral front-back variations caused by the ear flaps (or pinnae).

High-frequency localisation

As the wavelength approaches twice the size of the head, phase relationships become ambiguous, since it is no longer clear whether the phase difference between the ears corresponds to one, two, or even more periods as the frequency goes up. Fortunately, the head will create a significant acoustic shadow in this range, which causes a slight difference in level between the ears. This is called the interaural level difference, or ILD (the same cone of confusion applies). Combined, these two mechanisms provide localisation over the entire hearing range.

ITD and ILD reproduction in Ambisonics

Gerzon has shown that the quality of localisation cues in the reproduced sound field corresponds to two objective metrics: the length of the particle velocity vector $\vec{r_V}$ for the ITD, and the length of the energy vector $\vec{r_E}$ for the ILD. Gerzon and Barton (1992) define a decoder for horizontal surround to be Ambisonic if

• the directions of $\vec{r_V}$ and $\vec{r_E}$ agree up to at least 4 kHz,
• at frequencies below about 400 Hz, $\|\vec{r_V}\|=1$ for all azimuth angles, and
• at frequencies from about 700 Hz to 4 kHz, the magnitude of $\vec{r_E}$ is "substantially maximised across as large a part of the 360° sound stage as possible".

In practice, satisfactory results are achieved at moderate orders even for very large listening areas.

Soundfield synthesis (decoding)

In principle, the loudspeaker signals are derived by using a linear combination of the Ambisonic component signals, where each signal is dependent on the actual position of the speaker in relation to the center of an imaginary sphere the surface of which passes through all available speakers. In practice, slightly irregular distances of the speakers may be compensated with delay.

True Ambisonic decoding however requires spatial equalization of the signals to account for the differences in the high- and low-frequency sound localization mechanisms in human hearing. A further refinement accounts for the distance of the listener from the loudspeakers (near-field compensation).

For more details on this topic, see Ambisonic decoding and Ambisonic reproduction systems.

Compatibility with existing distribution channels

Ambisonic decoders are not currently being marketed to end users in any significant way, and no native Ambisonic recordings are commercially available. Hence, content that has been produced in Ambisonics must be made available to consumers in stereo or discrete multichannel formats.

Stereo

Ambisonic content can be folded down to stereo automatically, without requiring a dedicated downmix. The most straightforward approach is to sample the B-format with a virtual stereo microphone. The result is equivalent to a coincident stereo recording. Imaging will depend on the microphone geometry, but usually rear sources will be reproduced more softly and diffuse. Vertical information (from the $Z$ channel) is omitted.

Alternatively, the B-format can be matrix-encoded into UHJ format, which is suitable for direct playback on stereo systems. As before, the vertical information will be discarded, but in addition to left-right reproduction, UHJ tries to retain some of the horizontal surround information by translating sources in the back into out-of-phase signals. This gives the listener some sense of rear localisation.

Two-channel UHJ can also be decoded back into horizontal Ambisonics (with some loss of accuracy), if an Ambisonic playback system is available. Lossless UHJ up to four channels (including height information) exists but has never seen wide use. In all UHJ schemes, the first two channels are conventional left and right speaker feeds.

Multichannel formats

Likewise, it is possible to pre-decode Ambisonic material to arbitrary speaker layouts, such as Quad, 5.1, 7.1, Auro 11.1, or even 22.2, again without manual intervention. The LFE channel is either omitted, or a special mix is created manually. Pre-decoding to 5.1 media has been known as G-Format during the early days of DVD audio, although the term is not in common use anymore.

The obvious advantage of pre-decoding is that any surround listener can be able to experience Ambisonics; no special hardware is required beyond that found in a common home theatre system. The main disadvantage is that the flexibility of rendering a single, standard Ambisonic signal to any target speaker array is lost: the signal is assumes a specific "standard" layout and anyone listening with a different array may experience a degradation of localisation accuracy.

Target layouts from 5.1 upwards usually surpass the spatial resolution of first-order Ambisonics, at least in the frontal quadrant. For optimal resolution, to avoid excessive crosstalk, and to steer around irregularities of the target layout, pre-decodings for such targets should be derived from source material in Higher-order Ambisonics.

Production workflow

Ambisonic content can be created in two basic ways: by recording a sound with a suitable first- or higher-order microphone, or by taking separate monophonic sources and panning them to the desired positions. Content can also be manipulated while it is in B-format.

Ambisonic microphones

Native B-format arrays

File:Nimbus-Halliday-Microphone-A.jpg

The array designed and made by Dr Jonathan Halliday of Nimbus Records

Since the components of first-order Ambisonics correspond to physical microphone pickup patterns, it is entirely practical to record B-format directly, with a collection of coincident microphones: an omnidirectional capsule, one forward-facing and one left-facing figure-of-eight, yielding the $W$, $X$ and $Y$ components. This is referred to as a native or Nimbus/Halliday microphone array, after its designer Dr Jonathan Halliday at Nimbus Records, where it is used to record their extensive and continuing series of Ambisonic releases.

The primary difficulty inherent in this approach is that high-frequency localisation and clarity relies on the diaphragms approaching true coincidence. By stacking the capsules vertically, perfect coincidence for horizontal sources is obtained. However, sound from above or below will suffer from subtle comb filtering effects in the highest frequencies.

Native arrays are most commonly used for horizontal-only surround, because of increasing positional errors and shading effects when adding a fourth microphone.

The tetrahedral microphone

Since it is impossible to build a perfectly coincident microphone array, the next-best approach is to minimize and distribute the positional error as uniformly as possible. This can be achieved by arranging four cardioid or sub-cardioid capsules in a tetrahedron and equalising for uniform diffuse-field response. The capsule signals are then converted to B-format with a matrix operation. Outside Ambisonics, tetrahedral microphones have become popular with location recording engineers working in stereo or 5.1 for their flexibility in post-production; here, the B-format is only used as an intermediate to derive virtual microphones.

Higher order microphones

Above first-order, it is no longer possible to obtain Ambisonic components directly with single microphone capsules. Instead, higher-order difference signals are derived from several spatially distributed (usually omnidirectional) capsules using very sophisticated digital signal processing.

Due to the aggressive equalisation necessary, the timbral and noise performance of higher-order arrays is not currently comparable to traditional high-quality recording microphones, and the resulting B-format is increasingly band-limited towards higher orders, raising issues of up- and downwards compatibility.

A recent paper by Peter Craven et al. (subsequently patented) describes the use of bi-directional capsules for higher order microphones to reduce the extremity of the equalisation involved. No microphones have yet been made using this idea.

Ambisonic panning

The most straightforward way to produce Ambisonic mixes of arbitrarily high order is to take monophonic sources and position them with an Ambisonic encoder.

A full-sphere encoder usually has two parameters, azimuth (or horizon) and elevation angle. The encoder will distribute the source signal to the Ambisonic components such that, when decoded, the source will appear at the desired location. More sophisticated panners will additionally provide a radius parameter that will take care of distance-dependent attenuation and bass boost due to near-field effect.

Hardware panning units and mixers for first-order Ambisonics have been available since the 1980s and have been used commercially. Today, panning plugins and other related software tools are available for all major digital audio workstations, often as free software. However, due to arbitrary bus width restrictions, few professional DAWs support orders higher than second. Notable exceptions are REAPER and Ardour.

For more details on this topic, see List of Ambisonic Software and List of Ambisonic Hardware#Legacy hardware.

Ambisonic manipulation

First order B-format can be manipulated in various ways to change the contents of an auditory scene. Well known manipulations include "rotation" and "dominance" (moving sources towards or away from a particular direction).

Additionally, linear time-invariant signal processing such as equalization can be applied to B-format without disrupting sound directions, as long as it applied to all component channels equally.

More recent developments in Higher Order Ambisonics enable a wide range of manipulations including rotation, reflection, movement, 3D reverb, upmixing from legacy formats such as 5.1 or first order, visualization and directionally-dependent masking and equalization.

For more details on this topic, see List of Ambisonic Software.

Data exchange

Transmitting Ambisonic B-format between devices and to end-users requires a standardized exchange format. While traditional first-order B-format is well-defined and universally understood, there are numerous conflicting conventions for Higher-order Ambisonics, differing both in channel order and weighting, which might need to be supported for some time. The most widespread is Furse-Malham higher order format in the .amb container based on Microsoft's WAVE-EX file format. It scales up to third order and has a file size limitation of 4GB.

Future implementations and productions might want to consider the AmbiX proposal, which adopts the .caf file format and does away with the 4GB limit. It scales to arbitrarily high orders.

History of Ambisonics

Ambisonics was invented by Michael Gerzon of the Mathematical Institute, Oxford, who – with Professor Peter Fellgett of the University of Reading, David Brown, John Wright and John Hayes of the now defunct IMF Electronics, and building on the work of other researchers – developed the theoretical and practical aspects of the system in the early 1970s.

Current development

Research

Recent conferences dedicated to or including Ambisonics or spherical harmonic analysis illustrate the current research interest:

• Ambisonics Symposium 2009 at IEM, Graz, Austria, 2009.
• 2nd International Symposium on Ambisonics and Spherical Acoustics at IRCAM, Paris, France, 2010
• Ambisonics Symposium 2011 at Vis Center, Lexington(KY), USA, 2011
• International Conference on Spatial Audio at Hochschule für Musik Detmold, Germany, 2011
• 25th AES UK Conference/4th International Symposium on Amisonics and Spherical Acoustics, University of York, UK
• 52nd AES Conference on Sound Field Control - Engineering and Perception, University of Surrey, Guildford, UK, 2013.
• EAA Joint Symposium on Auralization and Ambisonics, TU Berlin, Germany, 2014
• 55th AES Conference on Spatial Audio, Helsinki 2014
• 2nd International Conference on Spatial Audio at Fraunhofer IIS, Erlangen, Germany, 2014
• 3rd International Conference on Spatial Audio at IEM Graz, Austria 2015

An increasing number of institutions world-wide are maintaining permanent Ambisonic playback systems for research, production, and concert use.

Corporate interest

A number of companies are currently conducting research in Ambisonics:

• BBC
• Technicolor Research and Innovation/Thomson Licensing

Dolby Laboratories have expressed "interest" in Ambisonics by acquiring (and liquidating) Barcelona-based Ambisonics specialist imm sound prior to launching Dolby Atmos, which, although its precise workings are undisclosed, does implement decoupling between source direction and actual loudspeaker positions. Atmos takes a fundamentally different approach in that it does not attempt to transmit a sound field; it transmits discrete premixes or stems (i.e., raw streams of sound data) along with metadata about what location and direction they should appear to be coming from. The stems are then decoded, mixed, and rendered in real time using whatever loudspeakers are available at the playback location.

Use in gaming

Higher-order Ambisonics has found a niche market in video games developed by Codemasters. Their first game to use an Ambisonic audio engine was Colin McRae: DiRT, however, this only used Ambisonics on the PlayStation 3 platform. Their game Race Driver: GRID extended the use of Ambisonics to the Xbox 360 platform, and Colin McRae: DiRT 2 uses Ambisonics on all platforms including the PC.

The recent games from Codemasters, F1 2010, Dirt 3, F1 2011 and Dirt: Showdown, use fourth-order Ambisonics on faster PCs, rendered by Blue Ripple Sound's Rapture3D OpenAL driver.

Patents and Trademarks

Most of the patents covering Ambisonic developments have now expired (including those covering the Soundfield microphone) and, as a result, the basic technology is available for anyone to implement. Exceptions to this include Dr Geoffrey Barton's Trifield technology, which is a three-speaker stereo rendering system based on Ambisonic theory (US 5594800 ), and so-called "Vienna" decoders, based on Gerzon and Barton's Vienna 1992 AES paper, which are intended for decoding to irregular speaker arrays (US 5757927 ).

The "pool" of patents comprising Ambisonics technology was originally assembled by the UK Government's National Research & Development Corporation (NRDC), which existed until the late 1970s to develop and promote British inventions and license them to commercial manufacturers – ideally to a single licensee. The system was ultimately licensed to Nimbus Records (now owned by Wyastone Estate Ltd).

The "interlocking circles" Ambisonic logo (UK trademarks UK00001113276 and UK00001113277), and the text marks "AMBISONIC" and "A M B I S O N" (UK trademarks UK00001500177 and UK00001112259), formerly owned by Wyastone Estate Ltd., have expired as of 2010.

See also

• Ambisonic reproduction systems
• Ambisonic decoding
• Ambisonic UHJ Format
• List of Ambisonic Software
• List of Ambisonic Hardware
• List of permanent Ambisonic playback systems
• List of Ambisonic Source Texts
• Nimbus Records
• Soundfield microphone

External links

• Ambisonic.net website
• Ambisonia, a repository of Ambisonic recordings and compositions
• Ambisonic.info, website of Ambisonic field recordist Paul Hodges
• Ambisonics resources at the University of Parma
• Ambisonic resources at the University of York
• Higher Order Ambisonic Technical Notes at Blue Ripple Sound