BTech/PE-702/EC-1/21

iodie
B.Tech 7th Semester Exam., 2021
Held in 2022 )
x 0 9iny

INFORMATION THEORY AND CODING

59wd Paper PE-702/EC-1itsbl (o

Stetslhse Bab /sn 20119og
Full Marks : 60H s

Time: 2 hours

3o g marks
The figures in the margin indicate full
for the questionsS

and any one

Answer Question No. 1
from each Module
orble
qmo WAT
Answer the folowing questions :e 20 1x12=12
1.
id pneieib no
is efficiency important in coding?
(a) Why
iatsnt 3oodoi
(b) What is the Hamming distance between
0000 and 1111?

(c) What do you mean by constraint lengtha

in convolutional code?

d Define a ilela.,
orolo2-bo7 1o
O O 22M/373 (Turn Over)
REDMI NOTE 10 PRO MAX | ANANYA
ES-0sOT-g( 2)
(3)
(e) A DMS can generate three symbols

with probability' What is the dme a9iMoDULE-1 eide

value of z? 2a Define entropy with example. State the
properties of entropy.

Whatis prefix code example?AMOORAT (b) Compute entropy of a DMS with

Source alphabet S={So, S, S2, Sa}
(9) Identify the relationship between with probabilities P= 4'4'6
1
generator matrix G and parity check
(c) Consider a DMS with source symbols
matrix H. o iu
S So.S1. S2}with probabilities

(h) In an (7, 4) LBC, what Compute the entropy of the

is the length of
message vector? extension of source HsT) with n =2.
4+3+5-12
(i) What do you mean by primitive 3. (a)Define mutual information and channel
polynomial?o 1o291591o2sA capacity.
(b) Consider a message ensemble
6) Compute the error correction
ofan LBCwith minimum capability S= {S%, S1, S2, S3, S4, Ss, Se with
distance, dnin =5 bit. Hamming o probabilities P={0-45,0-15,0-12,0-08,
0
0-08, 0-08, 0-04). Find the Shannon-
Fano code and determine its efficiency.
(k) Which of the following two statements
carries more information? (c)Construct the Huffman code for the
symbols with given probabilities
Statement 1: With
probability Pi= 0:3. S So, S, S2, S3, S4, Ss, So
dar Statement 2.: With
probability P2 =0.9. P {O 25, 0-25, 0 125, 0:125, 0-125,
S00 2000 0 13b09. ioptovnoo ni 0-0625, 0-0625}
()
() What is the value of
minimum distance m Compute the efficiency of the code.
of Reed-Solomon code? 3+4+5-12
otte
22M/373 (Turm Over)
(Continued) 22M/373
 (4)
5)

80 MoDULE 2 5. (a) The parity check matrix of an (7, 4) LBC

is given by
Consider (6, 3) linear block code
4. (a) a

whose generator matrix is given by

|11 1 0 1 0 0
g.ro0 H=1 1 0 1 0 1
1 0 0 1 0 1oE 1 0 1 1 0 0 1
G=0 1 01 1
7O13 (i) Find the generator matrix.
L0 0 1 0 1 1
M roia (1) List all codewords.

Find the parity check matrix. (ti) How many errors can be detected
and how many errors can be
Ot Corrected?
(t) Find the minimum distance of the
code.
(b) The received vector for the (7, 4) code is
y [1001101). Find the transmitted
(tti) Draw the encoder of the LBC.
sldio codeword using syndrome decoding
I Stechnique. Given that
(b) In a (15, 5) cyclic code, the generator . reg 1 0 1 11 0 0
polymomial is given by er H 1 1 0 1 0 1 0
1 1 1 0 0 0 1
gX) =1+ X +X+X*+x5 +x8 +xl0
of cExplain the features of (7, 4) Hamming
(i) Draw the block diagram Code. wE 6+4+2-12
encoder. huh l Joum2no
19V iw 2lodare
(i) Draw the syndrome calculator. toteisos MODULE 3 3
6. (a) Define a group with example.
(ii) Findwhether3P0asPoLeq
Prove that () the identity element in a
(b)
3ocenovo rX)=1+X* +X +x +xl4
d

(i) the inverse ofa

and O
is a valid codeword or
not. 6+6 12
81e group is unique
S-84tgroup is unique.Eesp piasive 2
O
22M/373 22M/373 ec/P 7 (Turn Over
(Continued )
 (6)
( 7)
(c) Construct the group under modulo-6
9. (a) Consider the (3, 1,2)convolutional
addition. code with g= (110), g=(101) and

(d) Define order of a group with example. g=(111).

2+4+4+2=12 (i) Draw the encoder block diagram.
the generator matrix, G.
(i) Find
7. (a) Construct addition and multiplication (it) Find the codeword V corresponding
tables over GF(7), then show how you to the information sequence
can make subtraction and division U = (11101).

bol operations over this field.

(b) Explain the Viterbi decoding algorithm
numbers of polynomials with necessary diagram.
(b) Identify over
GF 2) with degree 2. What are they?
(c) Compare linear block code with
convolutional code. 6+4+2-12
(c)Show that x +X +1 is irreducible
over GF(2).d vio opiaro 6+2+4=12

O 0 MODULE-4
0
8. (a) Draw a convolutional encoder with
20igenerator sequences g=100 and
Sltweg=101. Draw and state Trellis
diagrams. Find the output sequence for
10011].

(b) Explain the concept of maximum

likelihood decoding.
vanst (d
(c) Describe briefly about turbo code using O
suitable diagram, oiquuon 6+3+3=12 O
22M/373 22M-100/373 BTech/PE-702/EC-1/21
(Continued) L
 EC
BTech/PE-702/XEC1/19
0
B.Tech 7th Semester Exam., 2019

INFORMATION THEORY AND CODING

Paper: PE-702-XEC-1
Full Marks : 60
o vortebgor
Time: 2 hours
The figuTes in themargin indicate full marks
OL for the questions A
Answer Question No. 1 and any one
from each Module
orNE
1. Answer the
following questionssb 2x6=12
(a) What is the information content in the
event having probability of occurrence is
0-25?

(b) What are the advantages of entropy

coding? How can you differentiate
source coding with
entropy coding?
(c) A DMS can generate eight symbols with
equal probability. What is the entropy of
the source? (6

O o 20M/34 (Turn Over)

REDMI NOTE 10 PRO MAX | ANANYA
 er\roaxSOs-9( 2) (3)
(d) Show
that C= and

tocode and C= {000,

{000, 111)i
00, 111) is IK; Y)
for a
=05

linear code. 001, 10 a

linear
C a l c u l a t e

(i) also

(e)
Mention the criteria 101)is not a o ts b oP = 0 1 .

Repeat
the
same
for a
=0-5
and

linear block to be
i)
code to
qualify satisfied
P-05.
code. A0, Al,
by a symbols

( OaX-O-a9
Define the code 1qa as
Hamming
()
(c)
A
DMS
generates

and
A4
five
with
corresponding

{0-3,
0-1, 0-4,
also
derive efficiency and from this
A3 occurrence
A2, of

redundancy2115onfof thetheexpression
code.expression for
0 p r o b a

0-05, 0-15
b i l i t y

the symbols
using
brsowro ( Encode
Shannon-Fano coding
2 IlS si0oitODULE -1
s o u r c e .

ofthe
2. (a) entropy
An the ot

is
analog signal band (i)
Compute
coding
efiiciency,

3+4+5-12

quantized in 8 levels limited +CHC the

to 10 kHz D e t e r m i n e

of a (ii)
with PCM t h e code.

1/10, probabilities of
1/4, 1/5, 1/5, system
1/10, 1/20, 1/20 and Zjy
respectively. Find
the 1/20
entropy and the
rate of informationoa What is the
advantages
of Lempel
Encode
the
coding?
3. (a) over
Huff
Lempel Ziy
b)Given a binary
coding
sequence
using

s9n8hown in the figure symmetric

following
2
channel coding technique
and P(x)=1-d below with P(x) =g A B A B B B A B
A ABA
BBBABBABB
A
1-P
Ygot 10 P)-dD channel
with 4 kHz

918391ilpx-1-d
Rgniboo vgoins 2 (b) Given and
Given an
AWGN

the
noise
lower
spectrum

The signal
b/w W/Hz.
1-P n/2=10 the receiver
receiver
is
1s
density
diw elo() Show that the mutual at the
this
required of
10
vgots I(K; Y)is given by information power
Calculate
the capacity
0-1 mW.
I(X; Y)=
HY)+Plog2 P+(1- P}log,(1- P) channel. 0 (Turn Over)

20M/340
(Continued) 20M/340
 4) (5)
(c) A DMS H
Huum
mmmi
inng
g

Xhas five by code

equally likely
me
m ea
ann

Calculate do you
For
the
a
symbols.
What

and calculateShannon-Fano code

can

le (b)
(b) distance min many
errors

the for X how

efficiency
c o r r e c t e d ?

11), and
of the
(d) code.
e n o X = ( 0 0 0 detected

A ol
memoryless (7, 4)
s u c c e s s f u l l y

be
messages source
Source enits
emits to
implement

G in
with five
five encoder

soibn probabilities (04,

matrix
the
0-2, 0:1, 0-1. (c)Design

by
generator 5 + 2 + 5 - 1 2

0.2,
O 14
d e s c r i b e d

Compute brs EA LBC

the Hufman (b) a b o v e .

( code tree.
atiet
Determine the
length. average codeword code,
c ode?
For a
determine
systematic

the
ttioon
(n) Compute What is cyclic
d e t e r m i n e

99102 odt lo vgotascoding (a) code, check

check

efficiency.
sdi 531io
5.
(7,4)
Cyclic
matrix
and
and
parity
parity

CI-++E 3+2+3+4-12 generator

matrix.
It is given
G(P) Ps +P+1

MODULE-2 code
whose

block
4.
(a)In a (7,
LBC, the 4) Give a
systematic
are

us given
byiboo TiH generator (b) equations

matrix is parity
check

13v0
Ssgue 2n1 1 0 1 0 0 2rihoa
C =
m
+ m2 t m 4 message
digits
01 m
+ma t m4 C parity digits
G
AaA =1 1 01 0o C2 m
+m2 + m3
1 m
a aAa 1 0 0 1
o Ui C
A1 o 1 0 0 0
1 0 C =m2 t m3 +m4
matrix
and

sH () Determine the Find

the
generator

codeword for the 9 (i) parity check matrix.

Ismete
50message(i) Compute
word u =
(1101). How m a n y
errors
can
be
detected

H-matrix for given G. ag (i) a n d corrected?

word
(ii) Compute the code

received vector syndrome

received 5+7=12

for the (i) If the syndrome.

1 find the
valid code vector?101101. Is this a
10101010,

(Turn Over)
20M/340o

(Continued) 20M/340
 VANVNV XVW 0dd 0L 31ON
OC
6) 7)

6. (a) What is
MODULE-3 ob JeW MODULE 4
general
diagram of
a a

be
satisfiedgroup?
Block
State the 8. (a)
Explain

group.by a conditions to convolutional encoder.

(b) Show diagram

and tree

that the state

over GF 2). X +X +1
Draw encoder
b) convolutional

is diagram ofthe
39droeob irreducible >C
(c)(c Prove that ods
field the set R=
w.r.t.
modulo 5. addition and{0,1,2,3,4} is a x D

losdo s 3D02 multiplication

3+4+5-12
decode
the
to
7. (a) Write Viterbi
algorithm

short notes on (c)

(c)
Use

sequencei
Golay codes 10 11 00 00 000
SG 3+4+5-12

(i) Bose-Chaudhri-Hocquenghem code Oenoden

01

bwoe ae shown in
(b) What is c o n v o l u t i o n a l
encoder

Reed-Solomon code? 9. (a For the

the figure b e l o w
Output
(c) Construct a
prime field GF
module-11 addition
Input MSB

and (11) with

Find all the
multiplication.
determine the primitive elements D D LSB

orders of other and

(d) Construct the elements. encoder

over GF vector (2, 1, 2)

convolutional

(3). Form aspace of all

3-types for the

subspace and its dual two-dimensional

sequence

the output
determine

1001101.
Assume initial
space.
9010 e brt.got0.2x2)+1+4+3=12 input
sequence

is 00.
content of register Turn Over)

20M/340o 20M/340O-9dosT9

(Continued)
 8

(b) Sketch the Trellis diagram for

the input
sequence 1001101 and zero initial
condition.

(c) Determine the state diagram for the

convolutional encoder shown in the
figurebelow
input

Draw the -output

Trellis
first set of diagram through the
the second steady state transitions. On
Trellis
termination of the diagram, show the
state to all-zero
Trellis to all-zero
3+3+6-12
**