MPEG-H Audio: Fitting Every Device

June 5, 2015

This article was originally written in May 2015 for the IABM Engineering Student Awards.


While “linear” or traditionnal TV is getting stuck because of the expanding variety of media (such as TV, computers, tablets or phones) and new means of consumption, MPEG-H has been defined to be flexible; this is especially true when talking about the audio part of MPEG-H.


Born in 2013, MPEG-H is the successor of MPEG-4. Still under development, it has yet got its main standards: “MPEG Media Transport”, “High Efficiency Video Coding” and “3D Audio”. These three first parts (formerly known as “Systems”, “Video”, and “Audio” in MPEG-2 and MPEG-4) constitute the core of MPEG-H. Widely known for its video part (H.265/HEVC), MPEG-H defines nevertheless a very interesting audio part. Three main audiovisual stakeholders, to wit Fraunhofer IIS, Technicolor and Qualcomm form the “MPEG-H Audio Alliance”, responsible for this part.

1. Object-oriented audio

Let us consider a usual audio broadcasting framework, composed of three parts:

  1. Recording, either capturing or creating audio information.
  2. Channel transporting the recorded information with an efficient representation.
  3. Playback re-creating the original information.

Traditionally, when working with multichannel audio, we try to match the number and position of microphones for the recording and channels for the playback.
It means that we have to provide as many different mixes as there are different configurations. This way of thinking worked until now with mono, stereo and 5.1 signals but does not really suit the new needs of the audiovisual industry in this day and age: flexibility, mobility, immersion.

Traditional audio framework

Here comes the object-oriented audio which, instead of working with channels, uses entities (as soundscape, commentary, sound FX, music, etc.).
The sound mixer creates only one mix by placing these entities in a 3D soundfield.
Then, these entities can be sent in the channel as data and position metadata.
Finally, the original audio can be re-created “easily” by remapping the objects in our given 3D audio soundfield.

There are some direct advantages coming from this method:

Nonetheless, one can quickly understand the issues tackled by this method:

An intermediate approach between channel-based solutions (with a high coupling between the recording and playback parts, but low complexity) and object-based solutions (with good decoupling, but high complexity) should be found.

2. High-Order Ambisonics

Invented in the UK in the early 1970s, ambisonics is a surround-sound technique which consists of giving a speaker-independent representation of a soundfield. This representation, also called B-format is then decoded to any specific speaker setup.

At a given point M(r,θ,φ)M\left(r,\theta,\varphi\right) of a 3D space, ambisonics give us the following equation defining the sound pressure:

[n=0Njn(kr)m=nnanm(t)Ynm(θ,φ)]ejφN+p(r,θ,φ,t)\left[\sum_{n=0}^{N}j_n\left(kr\right)\sum_{m=-n}{n}a^m_n\left(t\right)Y^m_n\left(\theta,\varphi\right)\right]\mathrm{e}^{\mathrm{j}\varphi}\xrightarrow[N \to +\infty]{}p\left(r,\theta,\varphi,t\right)


As technology did not enable real-time computation of HOA when it was created, we now have enough power to go until 4th-order.
Considering the 4th-order, it would give us 25 coefficients and by extension, 25 PCM 48kHz signals (if we consider sampling the soundfield at the usual 48kHz frequency).

Spherical harmonics up to degree 3 (source Wikipedia)

However, these 25 signals are often highly correlated and allow a reduction to 6 PCM channels and some metadata, which can then optionally go through the MPEG-H compression engine.


Hence, MPEG-H Audio “only” gathers the previous parts together. In fact, MPEG-H Audio allows to work with HOA, audio objects and traditional audio, together.

MPEG-H audiovisual framework

We can imagine the following scenarios or use cases, as described in the following figures:

Broadcast workflow

Movie workflow


We covered through this paper main aspects of the multichannel audio part of MPEG-H, which seems to answer most of the expectations of the current broadcast industry and to stay flexible enough to stay the standard during a long time. MPEG-H Audio is now ratified by DVB, ATSC 3.0 and Internet streaming, even though Youtube uses with its VP9 another multichannel audio codec: Opus. Aside from the audio part, the two first parts of MPEG-H also show that it stands by itself as the new top-notch codec for the broadcast industry.

Download this article.