Speex Description Feature Description Sampling Rate

The Speex coder uses the Ogg bitstream format, and the Speex designers see their project as complementary to the Vorbis general-purpose audio compression project.

Applications designers looking for a general-purpose speech codec should consider Speex.

1 Description

Unlike many other speech codecs, Speex is not targeted at cell phones but rather at voice over IP (VoIP) and file-based compression. The design goals have been to make a codec that would allow both very good quality speech and low bit-rate, which led to the development of a codec with multiple bit-rates. Very good quality also meant the support of wideband (16 kHz sampling rate) in addition to narrowband (telephone quality, 8 kHz sampling rate). Designing for VoIP instead of cell phone use means that Speex must be robust to lost packets, but not to corrupted ones since packets either arrive unaltered or don't arrive. All this led to the choice of CELP as the encoding technique to use for Speex. One of the main reasons is that CELP has long proved that it could do the job and scale well to both low bit-rates (think DoD CELP@4.8 kbit/s) and high bit-rates (think G.728 @ 16 kbit/s). The main characteristics can be summarized as follows:

1.1 Feature description

1.1.1 Sampling rate

Speex is mainly designed for 3 different sampling rates: 8 kHz, 16 kHz, and 32 kHz. These are respectively refered to as narrowband, wideband and ultra-wideband.

1.1.2 Quality

Speex encoding is controlled most of the time by a quality parameter that ranges from 0 to 10. In constant bit-rate (CBR) operation, the quality parameter is an integerThe integers consist of the positive natural numbers (1, 2, 3, …) the negative natural numbers (−1, −2, −3,. and the number zero. The set of all integers is usually denoted in mathematics by Z (or Z in blackboard bold, ), which st, while for variable bit-rate (VBR), the parameter is a floatThere are several meanings of float Buoyancy Float (project management) Floating point, short for number Floats are used by seaplanes to land on water. Insurance (investable policyholder funds)..

1.1.3 Complexity (variable)

With Speex, it is possible to vary the complexity allowed for the encoder. This is done by controlling how the search is performed with an integer ranging from 1 to 10 in a way that's similar to the -1 to -9 options to gzipgzip is short for GNU Zip, a GNU open-source replacement for the Unix compress program. Gzip is based on the deflate algorithm, which is a combination of LZ77 and Huffman coding. Deflate' was developed in response to patents that covered LZW and other com and bzip2bzip2 is an open source data compression algorithm and program developed by Julian Seward. bzip2 compresses most files more effectively than more traditional gzip or Zip, but is slower. Nonetheless, with the constant effect of Moore's Law making computer compressionThere are several types of compression physical compression data compression multimedia compression image compression audio compression video compression bandwidth compression audio level compression compression (functional analysis). utilities. For normal use, the noise level at complexity 1 is between 1 and 2 dB higher than at complexity 10, but the CPU requirements for complexity 10 is about 5 times higher than for complexity 1. In practice, the best trade-off is between complexity 2 and 4, though higher settings are often useful when encoding non-speech sounds like DTMF tones.

1.1.4 Variable Bit-Rate (VBR)

Variable bit-rate (VBR) allows a codec to change its bit-rate dynamically to adapt to the "difficulty" of the audio being encoded. In the example of Speex, sounds like vowels and high-energy transients require a higher bit-rate to achieve good quality, while fricatives (e.g. s,f sounds) can be coded adequately with less bits. For this reason, VBR can achieve lower bit-rate for the same quality, or a better quality for a certain bit-rate. Despite its advantages, VBR has two main drawbacks: first, by only specifying quality, there's no guaranty about the final average bit-rate. Second, for some real-time applications like voice over IP (VoIP), what counts is the maximum bit-rate, which must be low enough for the communication channel.

1.1.5 Average Bit-Rate (ABR)

Average bit-rate solves one of the problems of VBR, as it dynamically adjusts VBR quality in order to meet a specific target bit-rate. Because the quality/bit-rate is adjusted in real-time (open-loop), the global quality will be slightly lower than that obtained by encoding in VBR with exactly the right quality setting to meet the target average bitrate.

1.1.6 Voice Activity Detection (VAD)

When enabled, voice activity detection detects whether the audio being encoded is speech or silence/background noise. VAD is always implicitly activated when encoding in VBR, so the option is only useful in non-VBR operation. In this case, Speex detects non-speech periods and encode them with just enough bits to reproduce the background noise. This is called "comfort noise generation" (CNG).

1.1.7 Discontinuous Transmission (DTX)

Discontinuous transmission is an addition to VAD/VBR operation, that allows to stop transmitting completely when the background noise is stationary. In file-based operation, since we cannot just stop writing to the file, only 5 bits are used for such frames (corresponding to 250 bit/s).

1.1.8 Perceptual enhancement

Perceptual enhancement is a part of the decoder which, when turned on, tries to reduce (the perception of) the noise produced by the coding/decoding process. In most cases, perceptual enhancement make the sound further from the original objectively (if you use SNR), but in the end it still sounds better (subjective improvement).

1.1.9 Algorithmic delay

Every speech codec introduces a delay in the transmission. For Speex, this delay is equal to the frame size, plus some amount of "look-ahead" required to process each frame. In narrowband operation (8 kHz), the delay is 30 ms, while for wideband (16 kHz), the delay is 34 ms. These values don't account for the CPU time it takes to encode or decode the frames.

2 Large application base

There is already a large base of applications supporting the speex codec, from teleconference software to streaming, P2P, and audio processing applications. Most of these are based on the DirectDS filter, OpenACM codec (for example Netmeeting) on Microsoft Windows, or OpenH323 on Linux (for GnomeMeeting)). There are also plugins for the Winamp and XMMS players.

The MIME type for Speex is audio/x-speex. The type audio/speex will be applied for in the near future.

See the plugin and software page on speex.org site for more details.

3 External links

This article uses material from the Speex Codec Manual which is copyright (c) Jean-Marc Valin and licensed under the terms of the GFDL

Audio codecs Speech codecs

<Hide>

Home > Speex