# Information Theory & Coding Notes VSSUT | ITC Notes VSSUT

5
(14)

## Information Theory & Coding Notes VSSUT – ITC Notes VSSUT of Total Complete Notes

Information Theory & Coding Notes VSSUT – ITC Notes VSSUT

Module – 1

Information Theory and Source Coding

Introduction to Information Theory, Uncertainty and Information,

Average Mutual Information and Entropy,

Information Measures for Continuous Random Variables,

waveform sources Amplitude Quantizing: quantizing noise, uniform quantizing,

non-uniform quantizing Differential Pulse Code Modulation: one – tap prediction,

N-tap prediction, delta modulation, sigma delta modulation,

sigma delta A-to-D convertor(ADC), sigma delta D-to -A convertor(DAC) Block coding:

vector quantizing, Transform Coding: quantization for transform coding,

Module – 2

Waveform coding

Antipodal and Orthogonal signals, Orthogonal and Biorthogonal codes,

waveform coding system example, Types of error control: Terminal connectivity,

automatic repeat request Structured Sequence: Channel models,

Channel capacity, Channel coding, Information Capacity Theorem,

The Shannon Limit, Introduction to Error correcting codes, code rate & redundancy,

parity check codes: Single parity check code, Rectangular code Linear Block codes:

Module – 3

Convolutional Encoding

Convolutional Encoder Representation: connection representation,

state representation & the state diagram, the tree diagram,

the trellis diagram Formulation of the Convolutional Decoding Problem:

maximum likelihood decoding, channel models: hard versus soft decisions,

Viterbi Convolutional Decoding Algorithm, an example of viterbi convolutional decoding,

decoder implementation, path memory and synchronization Properties of Convolutional Codes:

distance properties of convolutional codes, systematic & nonsystematic convolutional codes,

Module – 4

Reed-Solomon Codes

Reed-Solomon Error Probability, Why R-S codes perform well against burst noise,

R-S performance as a function of size, redundancy,

and code rate Interleaving & Concatenated Codes: Block interleaving, Convolutional interleaving,

concatenated codes Coding & Interleaving Applied to CD Digital Audio System:

CIRC encodings, CIRC decoding, interpolation & muting Turbo Codes:

turbo code concepts, log-likelihood algebra