Editing Vector quantization (section)

== Applications ==

Vector quantization is used for lossy data compression, lossy data correction, pattern recognition, density estimation and clustering.

Lossy data correction, or prediction, is used to recover data missing from some dimensions. It is done by finding the nearest group with the data dimensions available, then predicting the result based on the values for the missing dimensions, assuming that they will have the same value as the group's centroid.

For [[density estimation]], the area/volume that is closer to a particular centroid than to any other is inversely proportional to the density (due to the density matching property of the algorithm).

=== Use in data compression ===

Vector quantization, also called "block quantization" or "pattern matching quantization" is often used in [[lossy data compression]].  It works by encoding values from a multidimensional [[vector space]] into a finite set of values from a discrete [[linear subspace|subspace]] of lower dimension. A lower-space vector requires less storage space, so the data is compressed.  Due to the density matching property of vector quantization, the compressed data has errors that are inversely proportional to density.

The transformation is usually done by [[projection (mathematics)|projection]] or by using a [[codebook]]. In some cases, a codebook can be also used to [[entropy code]] the discrete value in the same step, by generating a [[prefix code]]d variable-length encoded value as its output.

The set of discrete amplitude levels is quantized jointly rather than each sample being quantized separately.  Consider a ''k''-dimensional vector <math>[x_1,x_2,...,x_k]</math> of amplitude levels.  It is compressed by choosing the nearest matching vector from a set of ''n''-dimensional vectors <math>[y_1,y_2,...,y_n]</math>, with ''n'' < ''k''.

All possible combinations of the ''n''-dimensional vector <math>[y_1,y_2,...,y_n]</math> form the [[vector space]] to which all the quantized vectors belong.
<!--Block Diagram:
A simple vector quantizer is shown below

 Image with unknown copyright status removed: [[Image:Vector_quantization.JPG]] -->

Only the index of the codeword in the codebook is sent instead of the quantized values. This conserves space and achieves more compression.

[[TwinVQ#TwinVQ in MPEG-4|Twin vector quantization]] (VQF) is part of the [[MPEG-4]] standard dealing with time domain weighted interleaved vector quantization.

=== Video codecs based on vector quantization ===
{{Expand list|date=August 2008}}
* [[Bink video]]<ref>{{cite web
  | title = Bink video
  | work = Book of Wisdom
  | date = 2009-12-27
  | url = http://lists.mplayerhq.hu/pipermail/bow/2009-December/000058.html
  | access-date = 2013-03-16 }}
</ref>
* [[Cinepak]]
* [[Daala]] is transform-based but uses [[pyramid vector quantization]] on transformed coefficients<ref>{{cite IETF |title= Pyramid Vector Quantization for Video Coding | first1= JM. |last1= Valin | draft=draft-valin-videocodec-pvq-00 | date=October  2012 |publisher=[[Internet Engineering Task Force|IETF]] |access-date=2013-12-17 |url=http://tools.ietf.org/html/draft-valin-videocodec-pvq-00}} See also arXiv:1602.05209</ref>
* [[Digital Video Interactive]]: Production-Level Video and Real-Time Video
* [[Indeo]]
* [[Microsoft Video 1]]
* [[QuickTime#QuickTime 1.x|QuickTime]]: [[Apple Video]] (RPZA) and [[QuickTime Graphics Codec|Graphics Codec]] (SMC)
* [[Sorenson codec|Sorenson]] SVQ1 and SVQ3
* [[Smacker video]]
* [[.VQA|VQA]] format, used in many games
The usage of video codecs based on vector quantization has declined significantly in favor of those based on [[Motion compensation#Block motion compensation|motion compensated]] prediction combined with [[Transform coding#Digital|transform coding]], e.g. those defined in [[MPEG]] standards, as the low decoding complexity of vector quantization has become less relevant.

=== Audio codecs based on vector quantization ===
{{Expand list|date=August 2008}}
* [[AMR-WB+]]
* [[CELP]]
* [[CELT]] (now part of [[Opus (codec)|Opus]]) is transform-based but uses [[pyramid vector quantization]] on transformed coefficients
* [[Codec 2]]
* [[DTS Coherent Acoustics|DTS]]
* [[G.729]]
* [[iLBC]]
* [[Ogg Vorbis]]<ref>
{{cite web
  | title = Vorbis I Specification
  | publisher = Xiph.org
  | date = 2007-03-09
  | url = http://xiph.org/vorbis/doc/Vorbis_I_spec.html
  | access-date = 2007-03-09 }}
</ref>
* [[TwinVQ]]

=== Use in pattern recognition ===
VQ was also used in the eighties for speech<ref>{{cite book|last=Burton|first=D. K.|author2=Shore, J. E. |author3=Buck, J. T. |title=ICASSP '83. IEEE International Conference on Acoustics, Speech, and Signal Processing |chapter=A generalization of isolated word recognition using vector quantization |volume=8|year=1983|pages=1021–1024|doi=10.1109/ICASSP.1983.1171915}}</ref>  and [[speaker recognition]].<ref>{{cite book|last=Soong|first=F.|author2=A. Rosenberg |author3=L. Rabiner |author4=B. Juang |title=ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing |chapter=A vector quantization approach to speaker recognition |year=1985|volume=1|pages=387–390|doi=10.1109/ICASSP.1985.1168412|s2cid=8970593}}</ref>
Recently it has also been used for efficient [[nearest neighbor search]] 
<ref>{{cite journal|author=H. Jegou |author2=M. Douze |author3=C. Schmid|title=Product Quantization for Nearest Neighbor Search|journal=IEEE Transactions on Pattern Analysis and Machine Intelligence|year=2011|volume=33|issue=1|pages=117–128|doi=10.1109/TPAMI.2010.57|pmid=21088323 |url=http://hal.archives-ouvertes.fr/docs/00/51/44/62/PDF/paper_hal.pdf |archive-url=https://web.archive.org/web/20111217142048/http://hal.archives-ouvertes.fr/docs/00/51/44/62/PDF/paper_hal.pdf |archive-date=2011-12-17 |url-status=live|citeseerx=10.1.1.470.8573 |s2cid=5850884 }}</ref>
and on-line signature recognition.<ref>{{cite journal|last=Faundez-Zanuy|first=Marcos|title=offline and On-line signature recognition based on VQ-DTW|journal=Pattern Recognition|year=2007|volume=40|issue=3|pages=981–992|doi=10.1016/j.patcog.2006.06.007}}</ref> 
In [[pattern recognition]] applications, one codebook is constructed for each class (each class being a user in biometric applications) using acoustic vectors of this user. In the testing phase the quantization distortion of a testing signal is worked out with the whole set of codebooks obtained in the training phase. The codebook that provides the smallest vector quantization distortion indicates the identified user.

The main advantage of VQ in [[pattern recognition]] is its low computational burden when compared with other techniques such as [[dynamic time warping]] (DTW) and [[hidden Markov model]] (HMM). The main drawback when compared to DTW and HMM is that it does not take into account the temporal evolution of the signals (speech, signature, etc.) because all the vectors are mixed up. In order to overcome this problem a multi-section codebook approach has been proposed.<ref>{{cite journal|last=Faundez-Zanuy|first=Marcos|author2=Juan Manuel Pascual-Gaspar |title=Efficient On-line signature recognition based on Multi-section VQ|journal=Pattern Analysis and Applications|year=2011|volume=14|issue=1|pages=37–45|doi=10.1007/s10044-010-0176-8|s2cid=24868914}}</ref> The multi-section approach consists of modelling the signal with several sections (for instance, one codebook for the initial part, another one for the center and a last codebook for the ending part).

=== Use as clustering algorithm ===
As VQ is seeking for centroids as density points of nearby lying samples, it can be also directly used as a prototype-based clustering method: each centroid is then associated with one prototype. 
By aiming to minimize the expected squared quantization error<ref>{{cite journal|last=Gray|first=R.M.|title=Vector Quantization|journal=IEEE ASSP Magazine|year=1984|volume=1|issue=2|pages=4–29|doi=10.1109/massp.1984.1162229}}</ref> and introducing a decreasing learning gain fulfilling the Robbins-Monro conditions, multiple iterations over the whole data set with a concrete but fixed number of prototypes converges to the solution of [[k-means]] clustering algorithm in an incremental manner.

=== Generative Adversarial Networks (GAN) ===
VQ has been used to quantize a feature representation layer in the discriminator of [[Generative adversarial network]]s. The feature quantization (FQ) technique performs implicit feature matching.<ref>Feature Quantization Improves GAN Training https://arxiv.org/abs/2004.02088</ref> It improves the GAN training, and yields an improved performance on a variety of popular GAN models: BigGAN for image generation, StyleGAN for face synthesis, and U-GAT-IT for unsupervised image-to-image translation.