M-Unit 02 Notes
M-Unit 02 Notes
M-Unit 02 Notes
RANDOM PROCESS
The ensemble cosprised of functions of time is called as random or stochastic process.
Classification :
1. Stationary and Non-stationary random process.
2. Wide sense stationary process.
3. Ergodic process.
Q.2. State Bay’s Theorem and its purpose. [2 Marks]
(UPTU 2012-13 16-17)
Sol. : Bay’s Theorem
Probability of Joint Occurence :
P( AB ) = P( A) P ( B / A)
Conditional probability
P( AB )
P( B / A) =
P( A)
P( A) P( B / A)
or P( A / B ) = ...(1)
P( B )
P( B ) P( A / B )
P( B / A) = ...(2)
P( A)
Equation (1) and (2) are the Bay’s Rule.
Q. 3. Explain and proof Central Limit Theorem. [5 Marks]
(UPTU 2010-11, 12-13, 16-17)
Sol. : Central Limit Theorem
The central limit theorem is used when PDF of several independent random variables
is to be obtained. Under certain conditions, the probability density function of sum of a
large number of independent random variables tends to approach Gaussian PDF variable
independent of probability densities of variables
Proof : Z = X +4
or Y =Z −X
P( Z ≤ z ) = P[( x + 4) ≤ z ]
Unit-2 [21] (Buddha Series) Digital Communication
or P( Z ≤ z ) = Fz ( Z )
or P( x1 < X ≤ x 2 , y1 < Y ≤ y2 )
x2 y2
= ∫x1 ∫y1 fxy ( x , y) dx dy
∞ (z − x )
FZ ( z ) = ∫−∞ ∫−∞ fxy( x , y) dx dy
∞ z−x
FZ ( z ) = ∫−∞ ∫−∞ fxy ( x , z − x ) dx dy
d
FZ ( z ) = FZ ( z )
dz
∞
or f Z ( z ) = f X ( x ) ⋅ fY ( y) = ∫−∞ fxy ( x , z − x ) dx
Q.4. Explain the importance of probability of Error. [2 Marks] [UPTU 2015-16]
Sol. The probability of error may be considered as being the probability of making
wrong decision and which would have a different value for each type of error.
The probability of error may refer to the probabilities of various amounts of error
occuring.
The error is taken to be a random variable and as such has a probability distribution.
Q.5. Define mean variable and standard deviation or random variables.
[5 Marks] [UPTU 2015-16]
Sol. Standard Deviation and Mean Variable
Mean Value : Consider a discrete random variable X which has the possible values of
x1 , x 2 with the probabilities of occurrence to be P( x1 ), P( x 2 )...
If there are N independent observations of the discrete random variable X , then
outcome X = x1 will occur NP( x1 ), the outcome X = x 2 would occur NP( x 2 ) times
k
Mean value of X = Σ x i P( x1 )
i =1
Standard deviation ( x ) :
x = E [ x 2 ] − mx2
standard deviation ( x ) of a random variable is defined as the square root of the
variance x 2
The value of standard deviation indicate the deviation in the value of the random
variable from its mean value.
Q.6. Supose that a certain random variable has the CDF
0 x≤0
2
FX ( x ) = Kx 0 < x ≤ 10
100K for x > 10
Evaluate K, Find the values of P ( X ≤ 5) and P (5 ≤ X ≤ 7) [5 Marks]
Digital Communication [22] (Buddha Series) Unit-2
P( X ≤ 1, Y ≤ 0) = P( −∞ < X ≤ 1, − ∞ < Y ≤ 0)
0 1
= ∫ ∫ f X ( x , y) dx dy
−∞ −∞
0 1
1 − | x| − | y|
= ∫ ∫ 4
e dx dy
−∞ −∞
0 1
1 − | y| 1
= ∫ e dy ⋅ ∫ e − | x | dx
−∞
2 −∞
2
Unit-2 [23] (Buddha Series) Digital Communication
0
1 0 e − x
= e| y |−∞ [ e x ]0−∞ +
4 −1 −∞
1
= ( 2 − e −1 ) Ans.
4
Q.8. The Pdf of a random variable is given as :
K for a ≤ x ≤ b
fX ( x ) =
0 otherwise
(i) Value of K = ? (ii) If a = − 1, b = + 2 [10 Marks] [UPTU Sem 2009-10, 2007-08]
1
Sol. Calculate P (| x | ≤ c) for c =
2
to obtain the value of K :
∞
∫ f X ( x ) dx = 1
−∞
b
∫ K dx = 1
a
K [ x ]ba = 1
K ( b − a) = 1
1
K =
b−a
1 for a ≤ x ≤ b
f X ( x ) = ( b − a )
0 otherwise
1
(ii) To determine P(| x | ≤ C ) for C =
2
1 1
P− ≤ X ≤
2 2
fx(x)
1
(b – a)
a X
O b
Fig. 1
Digital Communication [24] (Buddha Series) Unit-2
x2
P( x1 < X ≤ x 2 ) = ∫ f X ( x ) dx
x1
1
2
1 1 1
P− ≤ X < = ∫ dx
2 2 1
b − a
−
2
1
= [ x ]1−/12/2
( b − a)
1 1 1
= +
( b − a ) 2 2
If b = 2, a = − 1
1 1
= ×1=
2+1 3
1 1
P | X | < = Ans.
2 3
Q.9. Probability density function of a Random variable X is defined as :
Kx 2 ; 1 ≤ x ≤ 2
fX ( x ) = Kx ; 2 < x ≤ 3
0 ; otherwise
[10 Marks]
[UPTU Sem-2011-12, 2014-15]
∞
Sol. ∫ fX ( x ) dx = 1
−∞
2 3
2
∫ Kx dx + ∫ Kx dx = 1
1 2
x 3 3 x2
3
K + K = 1
3 1 2 2
6
K =
29
∞
(ii) P( X ≥ 2) = ∫ fX ( x ) dx
2
∞ 3
= ∫ Kx dx = ∫ Kx dx
2 2
Unit-2 [25] (Buddha Series) Digital Communication
5 15
= K =
2 29
2
P( X ≤ 2) = ∫ f X ( x ) dx
−∞
2
14
= ∫ Kx 2 dx =
1
29
3 /2
1 3
P < X ≤ = ∫ Kx 2 dx
2 2 1/2
13
=
58
x
(iii) FX ( x ) = ∫ dx
−∞
x
For 1 < x < 2, FX ( x ) = ∫ Kx 2 dx
1
2
= ( x 3 − 1)
29
For 2 < x ≤ 3; FX ( x ) = 5
2 x
2
∫ Kx dx + ∫ Kx dx
1 2
14 3
= + ( x 2 − 4) Ans.
29 29
Q. 10. A random variable X has PDF
6x − 6x 2 0≤ x ≤1
fX ( x ) =
0 otherwise
Find constant b such that
P (X ≤ b) = P (X > b)
where b, is constant, 0 ≤ b ≤ 1 [10 Marks] [UPTU Sem- 2011-12, 2014-15]
b
Sol. P( X ≤ b) = ∫ f X ( x ) dx
−∞
∞
and P( X > b) = ∫ f X ( x ) dx
b
P( X ≤ b) = P( X > b)
Digital Communication [26] (Buddha Series) Unit-2
b ∞
∫ f X ( x ) dx = ∫ f X ( d ) dx
−∞ b
b 1
2
∫ ( 6x − 6x ) dx = ∫ ( 6x − 6x 2 ) dx
0 b
b b 1 1
6 ∫ x dx − ∫ x2 dx = 6 ∫ a dx − ∫ x 2 dx
0 0 b b
x2 x 3 b
x2 x 3 1
− = −
2 3
0
2 3
b
b 2 b 3 1 1 b 2 b 3
− = − − −
2 3 2 3 2 3
b2 b3 1
2 − =
2 3 6
6b 2 − 4b 3 = 1
1 1 1
b= or P X ≤ = P X >
2 2 2
Q. 11. Explain the term Ergodic random process. [5 Marks]
[UPTU Sem 2006-07, 2010-11, 2014-15]
Sol. Ergodic Process
A random process is called ergodic process if time averages are equal to ensemble
averages. Thus for ergodic process.
mX ( t) = mx (T )
and R X ( t1t2 ) = R x (T , T )
The process is ergodic in mean if following two conditions are satisfied :
lim mx (T ) = mx ( t)
T → ∞
fx(α)
1
2
X
a = –1 O b=1
( a − b)2 ( −1 − 1)2
Variance x = =
12 12
1
=
3
Q. 13. A binary symmetric channel (BSC) error probability is Pe . The
probability of transmitting 1 is Q and that of transmitting O is (1 − Q ). Determine
the probabilities of receiving 1 and 0 at the receiver. [5 Marks]
[UPTU Sem 2008-09, 2006-07, 2015-16, 2011-12]
A0 B0
P(A0) = Q 1 – Pe
Pe
Pe
A1 B1
P(A1) = 1 – Q 1 – Pe
Fig. 3
Sol. P( B 0 / A1 ) = P( B1 / A0 ) = Pe
P( B 0 / A0 ) = P( B1 / A1 ) = 1 − Pe
P( B 0 ) = P( B 0 / A0 ) P( A0 ) + P( B 0 / A1 ) P( A1 )
= ( 1 − Pe )Q + Pe( 1 − Q )
= Pe + Q − 2PeQ Probability of receiving 0
P( B1 ) = P( B1 / A0 ) P( A0 ) + P( B1 / A1 ) P( A1 )
= Pe Q + ( 1 − Pe )( 1 − Q )
= 1 − Q − Pe + 2PeQ
Probability of receiving t
Digital Communication [28] (Buddha Series) Unit-2
x2 :
∞
2 2
x = E[ x ] = ∫ x 2 f X ( x ) dx
−∞
2π
2 1
= ∫x ×
2π
dx
0
2π
1 x3
= p
2 3
0
1 4
[ 8π 3 − 0] = π 2
=
6π 3
4
σ 2x : E[ x 2 ] − mx2 = π 2 − π 2
3
1 2
σ x = σ 2x = π
3
π
or = Ans.
3
Q. 16. If 3 of 20 tubes are defective and 4 of them are randomly chosen for
inspection. What is the probability that only one of the defective tubes will be
included? [2 Marks]
Sol. Four tubes can be selected out of 20 in 20C 4 ways.
n n!
By Cr =
r !( n − r )!
20 !
=
4 !( 20 − 4)!
20 ! 20 × 19 × 18 × 17 × 16 !
⇒ =
4 ! 16 ! 16 ! × 4 × 3 × 2 × 1
= 4845
Now there are 3 defective tubes. Now since only one defective tube should be included
in set of 4, this tube can be chosen in 3C1 ways.
In the set of 4 defective tubes one tube should be defective and 3 tubes are
non-defective. Selection for those 3 tubes can be 17C 3 ways.
N A = 3C1 × 17
C3
No. of favourable ways
P( A) =
Total possible ways
N A 2040
⇒ =
N 4845
Digital Communication [30] (Buddha Series) Unit-2
= 042
.
Q.17. An information source produces 0 and 1 with probabilities 0.3 nad 0.7
respectively. The output of the source is transmitted via a channel that has a
probability of error (turning a1 into 0 and a0 into 1) is equal to 0.2.
(i) What is the probability that at output 1 is observed?
(ii) What is the probability that a1 was the output of source if at the output
of channel a1 is observed? [10 Marks] [UPTU 2015-16]
Sol. Let ‘0’ be represented by A0 and ‘1’ be represented by A1 at the input.
Let B 0 and B1 represent ‘0’ and ‘1’ at output
. , P ( A1 ) = 0.7
P ( A0 ) = 03
P ( B 0 A1 ) = P ( B1 A0 ) = 02
.
A0 B0
P(B0/A0)
P(A0)
)
P( /A 1
B B0
1 /A P(
0)
A1 B1
P(A1) P(B1/A1)
Fig. 4
P ( B1 ) = P ( B1 A1 ) + P( A1 ) + P( B1 A0 ) P ( A0 )
Q P ( B1 A1 ) + P( B 0 A1 ) = 1
P ( B1 A1 ) = 1 − P( B 0 A1 )
⇒ 1 − 02
. = 08
.
∴ P ( B1 ) = 08
. × 0.7 + 02
. × 03
.
P ( B1 ) = 062
. Ans.
This is the probability of getting 1 at output.
Q.18. Three students A, B and C are given a problem in maths. The
probabilities of their solving the problem ae 3/4, 2/3 and 1/4 respectively.
Determine the probability that the problem is solved if all of them try to solve the
problem. [5 Marks] [UPTU 2009-10]
3 2 1
Sol. P ( A) = , P ( B ) = , P ( C ) =
4 3 4
P ( ABC ) = P ( A) . P ( B ) . P ( C )
Unit-2 [31] (Buddha Series) Digital Communication
3 2 1 1
⇒ × × =
4 3 4 8
P ( ABC ) 1 8 1
P ( A ABC ) = = =
P ( A) 34 6
P ( ABC ) 1 8 3
P ( B ABC ) = = =
P ( B) 2 3 16
P ( ABC ) 1 8 1
P ( C ABC ) = = =
P (C ) 14 2
1 3 1
P ( A ABC ) + P ( B ABC ) + P ( C ABC ) = + +
6 16 2
= 0854
. Ans.
o