Introduction To Quantizer and Llyod Max Quantizer
Introduction To Quantizer and Llyod Max Quantizer
There are two types of quantization - Scalar Quantization and Vector Quantization.
In scalar quantization, each input symbol is treated separately in producing the
output, while in vector quantization the input symbols are clubbed together in
groups called vectors, and processed to give the output. This clubbing of data and
treating them as a single unit increases the optimality of the vector quantizer, but at
the cost of increased computational complexity. Here, we'll take a look at scalar
quantization.
A quantizer can be specified by its input partitions and output levels (also called
reproduction points). If the input range is divided into levels of equal spacing, then
the quantizer is termed as a Uniform Quantizer, and if not, it is termed as a Non-
Uniform Quantizer. A uniform quantizer can be easily specified by its lower bound
and the step size. Also, implementing a uniform quantizer is easier than a non-
uniform quantizer. Take a look at the uniform quantizer shown below. If the input
falls between n*r and (n+1)*r, the quantizer outputs the symbol n.
Mathematically, the decision and the reconstruction levels are solutions to the
above set of nonlinear equations. In general, closed form solutions to equations
(6.3) and (6.4) do not exist and they need to be solved by numerical techniques.
Using numerical techniques, these equations could be solved in an iterative way
by first assuming an initial set of values for the decision levels{di}. For
simplicity, one can start with decision levels corresponding to uniform
quantization, where decision levels are equally spaced. Based on the initial set
of decision levels, the reconstruction levels can be computed using equation
(6.3) if the pdf of the input variable to the quantizer is known. These
reconstruction levels are used in equation (6.4) to obtain the updated values
of{di}. Solutions of equations (6.3) and (6.4) are iteratively repeated until a
convergence in the decision and reconstruction levels are achieved. In most of
the cases, the convergence is achieved quite fast for a wide range of initial
values.
WAVEFORM
CASE STUDY
LLYOD MAX QUANTIZER PROPERTIES:
Uniform and non-uniform quantization
Lloyd-Max quantizers described above perform non-uniform quantization if the
pdf of the input variable is not uniform. This is expected, since we should
perform finer quantization (that is, the decision levels more closely packed and
consequently more number of reconstruction levels) wherever the pdf is large
and coarser quantization (that is, decision levels widely spaced apart and hence,
less number of reconstruction levels), wherever pdf is low. In contrast, the
reconstruction levels are equally spaced in uniform quantization, i.e.,
Information theoretic analysis