Signals
Signals
Spring 2011
Lecture #1
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
1
Signals and Systems
2
Different Types of Signals
3
Signal Classification
Type of Independent Variable
4
Cervical MRI
5
Independent Variable Dimensionality
6
Continuous Time (CT) and Discrete-
Time (DT) Signals
7
8
Mandril Example
Blurred Image
9
Mandril Example
Unblurred Image – No Noise
10
Mandril Example
Unblurred Image – 0.1% Noise
11
Real and Complex Signals
12
13
Periodic and A-periodic Signals
14
Right- and Left-Sided Signals
15
Bounded and Unbounded Signals
16
Even and Odd Signals
17
18
Building Block Signals
Eternal Complex Exponentials
19
20
21
22
Why are eternal complex
exponentials so important
23
Cervical Spine MRI
24
Unit Impulse Function
25
Narrow Pulse Approximation
26
Intuiting Impulse Definition
27
Uses of the Unit Impulse
28
Robot Arm System
29
30
Unit Step Function
31
Successive Integrations of the Unit
Impulse Function
32
Building Block Signals can be used to
create a rich variety of Signals
33
Conclusions
34
Signals and Systems
Spring 2011
Lecture #2
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
35
Outline - Systems
• How do we construct complex systems
– Using Hierarchy
– Composing simpler elements
• System Representations
– Physical, differential/difference Equations, etc.
• System Properties
– Causality, Linearity and Time-Invariance
36
Hierarchical Design
Robot Car
37
Robot Car Block Diagram
Top Level of Abstraction
38
Wheel Position Controller Block Diagram
39
Motor Dynamics Differential Equations
3nd Level of the Hierarchy
40
Observations
• If we “flatten” the hierarchy, the
system becomes very complex
• Human designed systems are often
created hierarchically.
• Block input/output relations provide
communication mechanisms for team
projects
41
Compositional Design
Mechanics - Sum Element Forces
42
Circuit - Sum Element Currents
43
System Representation
Differential Equation representation
– Mechanical and Electrical Systems Dynamically
Analogous
44
Integrator-Adder-Gain Block Diagram
45
Four Representations for the same
dynamic behavior
46
Discrete-Time Example - Blurred Mandril
Blurrer (system
model)
Blurred
Original
Image
Image
Deblurred
Deblurrer System Image
47
Difference Equation Representation
• Difference Equation Representation of the
model of a Blurring System
• Deblurring System
How do we get ?
48
Observations
• CT System representations include circuit and
mechanical analogies, differential equations, and
Integrator-Adder-Gain block diagram.
• Discrete-Time Systems can be represented by
difference equations.
• The Difference Equation representation does not
help us design the mandril deblurring
• New representations and tools for manipulating
are needed!
49
System Properties
• Important practical/physical implications
• Help us select appropriate representations
• They provide us with insight and
structure that we can exploit both to
analyze and understand systems more
deeply.
50
Causal and Non-causal Systems
51
Observations on Causality
• A system is causal if the output does not anticipate future
values of the input, i.e., if the output at any time depends
only on values of the input up to that time.
53
Key Property of Linear Systems
• Superposition
If
Then
54
Linearity and Causality
• A linear system is causal if and only if it satisfies the
conditions of initial rest:
“Proof”
a) Suppose system is causal. Show that (*) holds.
b) Suppose (*) holds. Show that the system is causal.
55
Time-Invariance
• Mathematically (in DT): A system x[n] y[n] is TI if for
any input x[n] and any time shift n0,
If x[n] y[n]
then x[n - n0] y[n - n0] .
56
Interesting Observation
Fact: If the input to a TI System is periodic, then the output is
periodic with the same period.
57
Example - Multiplier
58
Multiplier Linearity
59
Multiplier – Time Varying
60
Example – Constant Addition
61
62
Linear Time-Invariant (LTI) Systems
63
Example – DT LTI System
64
Conclusions
65
Signals and Systems
Spring 2011
Lecture #3
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
66
Amazing Property of LTI Systems
67
Outline
• Superposition Sum for DT Systems
– Representing Inputs as sums of unit samples
– Using the Unit Sample Response
• Superposition Integral for CT System
– Use limit of tall narrow pulse
• Unit Sample/Impulse Response and Systems
– Causality, Memory, Stability
68
Representing DT Signals with Sums of Unit Samples
69
Written Analytically
70
The Superposition Sum for DT Systems
Graphic View of Superposition Sum
71
Derivation of Superposition Sum
72
Convolution Sum
73
Convolution Notation
74
Convolution Computation Mechanics
75
DT Convolution Properties
Commutative Property
76
Associative Property
77
Distributive Property
78
Delay Accumulation
79
Superposition Integral for CT Systems
Graphic View of Staircase Approximation
80
Tall Narrow Pulse
81
Derivation of Staircase Approximation of
Superposition Integral
82
The Superposition Integral
83
Sifting Property of Unit Impulse
84
CT Convolution Mechanics
85
CT Convolution Properties
86
Computing Unit Sample/Impulse Responses
Circuit Example
87
Narrow pulse approach
88
Narrow pulse response
89
Narrow pulse response cont’d
90
Convergence of Narrow pulse
response
91
Alternative Approach – Use
Differentiation
92
Alternative Approach – Use
Differentiation cont’d
93
How to measure Impulse Responses
94
Unit Sample/Impulse Responses of
Different Classes of Systems
95
Bounded-Input Bounded-Output Stability
96
Conclusions
97
Signals and Systems
Spring 2011
Lecture #4
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
98
Outline
• Unfiltering (Deconvolving)
– Candidate Unit Sample Responses
– Causality and BIBO stability
– Additional Conditions for Difference Equations
• Compute Impulse responses of a CT System
– Use limit of tall narrow pulse
– Differentiating the step response
99
“Unfiltering an Audio Signal”
Problem Statement
Original “Filtered”
Audio Audio
100
DT LTI System Specification?
Unit Sample Response!
1.0
n
-0.9
DT LTI
Original
Filtered
Audio
Audio
“Unfiltered”
Audio
102
Associative Property
103
Use Associative Property
104
A Candidate Unfilterer
1.0
n
-0.9
n
......
105
Unit Sample/Impulse Responses of
Different Classes of Systems
106
Bounded-Input Bounded-Output Stability
107
Candidate Unfilterer is Causal and
definitely not BIBO stable
n
......
108
Give Up Causality to Gain Stabilty
1.0
n
-0.9
...... n
109
Convolving is expensive
...... m
110
Use A Difference Equation
111
A Difference Equation Does Not
Uniquely Determine a system!
Need Additional Conditions:
• Causal or Anti-causal
OR
• BIBO Stability
OR
• Some values of the output
112
Computing Impulse Responses
Circuit Example
113
Narrow pulse approach
114
Narrow pulse response
115
Narrow pulse response cont’d
116
Convergence of Narrow pulse
response
117
Alternative Approach – Use
Differentiation
118
Alternative Approach – Use
Differentiation cont’d
119
How to measure Impulse Responses
120
Conclusions
• Unfiltering (Deconvolving)
– There can be multiple deconvolving systems
– Causality and BIBO stability are issues
– Difference Equations need similar constraints
• Computing Impulse responses of a CT
System
– Use limit of tall narrow pulse
– Differentiating the step response
121
Signals and Systems
Spring 2011
Lecture #5
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
122
Outline
Complex Exponentials as Eigenfunctions
of LTI Systems
Fourier Series representation of CT
periodic signals
How do we calculate the Fourier
coefficients?
Convergence and Gibbs’ Phenomenon
123
The eigenfunctions k(t) and their properties
(Focus on CT systems now, but results apply to DT systems as well.)
eigenvalue eigenfunction
124
125
Two Key Questions
126
A specific LTI system can have more than one type of eigenfunction
Ex. #1: Identity system
(for this
system)
127
that work for any and all
Complex Exponentials are the only Eigenfunctions of any LTI Systems
eigenvalue eigenfunction
eigenvalue eigenfunction
128
129
DT:
130
What kinds of signals can we represent as
“sums” of complex exponentials?
CT:
Magnitude 1
DT:
CT & DT Fourier Series and Transforms
Periodic Signals
131
Joseph Fourier (1768-1830)
132
133
Fourier Series Representation of CT Periodic Signals
periodic with period T
{ak} are the Fourier (series) coefficients
k = 0 DC
k = ±1 first harmonic
k = ±2 second harmonic
134
Question #1: How do we find the Fourier coefficients?
Euler's relation
(memorize!)
0 – no dc component
0
0
135
(periodic)
• For real signals, there are two other commonly used forms for
CT Fourier series:
136
137
Now, the complete answer to Question #1
138
139
Ex: Periodic Square Wave
DC
component
is just the
average
140
141
Convergence of CT Fourier Series
• How can the Fourier series for the square wave possibly make
sense?
• The key is: What do we mean by
142
• Under a different, but reasonable set of conditions
(the Dirichlet conditions)
Condition 1. x(t) is absolutely integrable over one period, i. e.
And
Condition 2. In a finite time interval,
x(t) has a finite number
of maxima and minima.
Ex. An example that violates
Condition 2.
And
Condition 3. In a finite time interval, x(t) has only a finite
number of discontinuities.
Ex. An example that violates
Condition 3.
143
• Dirichlet conditions are met for most of the signals we will
encounter in the real world. Then
144
145
Conclusions
• Exponentials are Eigenfunctions of CT
Systems
• zn are Eigenfunctions of DT Systems
• Periodic CT Functions Can Be Represented
with a Fourier Series
– Synthesis and analysis formulas using
orthogonality
– Series convergence for square wave
146
Signals and Systems
Spring 2011
Lecture #6
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
147
Representation with Fourier Series
• CT Fourier Series
– Energy View and Parsevals
– Convergence Rate
• Periodic Impulse Train
• Differentiation, Linearity and Time Shift
• DT Fourier Series
– Finite Frequency Set
– System of Equations
148
Fourier Series for Periodic CT Functions
149
150
Two Uses for Fourier Series
Use
Eigenfunction
property to
simplify LTI
system
analysis
Compress
Data using
truncated
Fourier Series
151
Fourier Representation Issue
Not Infinite Enough
Uncountably Infinite
number of “points”
152
Energy View
• Signals are equal “Energy-wise”
153
154
Truncated Fourier Series for Square Wave
155
Square Wave From Series Matches in Energy
x(t)
Equal energy-wise
Not equal pointwise
156
Fourier Convergence Rate: Useful Result
Impulse Train or Sampling Function
157
158
Truncated Fourier Series for Impulse Train
159
Truncated Impulse Train Series Cont’d
160
Truncated Impulse Train Series Cont’d
161
162
Fourier Convergence Rate: Useful
Properties
• Linearity
• Time Shift
163
Square Wave Convergence Rate
164
Triangle Wave Convergence Rate
167
DT Fourier Series Representation
k N
Sum over any N consecutive values of k
Questions:
168
Computing Fourier Series Coefficients
Any DT periodic signal has a Fourier series representation
169
170
Using Orthogonality to Solve for ak
Finite geometric series
171
Computing Coefficients Cont’d
172
DT Fourier Series Pair
175
Conclusions
• CT Fourier Series
– Fourier Series Converge energy-wise not ptwise
– Coefficient Decay
• Periodic Impulse Train Coeffs do not decay
• Decay rate related to differentiability
• DT Fourier Series
– Finite Frequency Set
– System of Equations
176
Signals and Systems
Spring 2011
Lecture #7
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
177
Frequency Response
• Filters
– Application Examples
– Types of filters
• High Pass, Low Pass
• DT Filters
– Finite Unit Sample Response - FIR
– Infinite Unit Sample Response - IIR
178
The Eigenfunction Property of Complex Exponentials
CT:
DT:
179
180
Fourier Series and LTI Systems
181
The Frequency Response of an LTI System
182
Finite Set of Discrete-Time Frequencies
183
184
Frequency Shaping and Filtering
- Preferential amplification
- Selective filtering of some frequencies
Audio System
185
Signal Processing with Filters
186
Touch Tone Phone
187
188
189
190
191
192
Low and High Pass Circuit Filters
X Y X Y
193
Frequency Selective Filters
— Filter out signals outside of the frequency range of interest
Lowpass Filters:
only look at
amplitude here.
194
Highpass Filters
Remember:
195
196
Bandpass Filters
LP HP BPF if
cl ch
197
Idealized Filters
CT
c — cutoff
frequency
DT
CT
DT
199
200
Bandpass
CT
DT
201
DT Averager/Smoother
LPF
202
Nonrecursive DT (FIR) filters
203
204
Simple DT “Edge” Detector
— DT 2-points “differentiator”
205
Edge enhancement using DT differentiator
206
Notch Filter - IIR
207
208
Conclusions
• Filters
– Signal Seperation
– Types of filters
• High Pass, Low Pass
• DT Filters
– FIR Edge Detector
– IIR Notch
209
Signals and Systems
Spring 2011
Lecture #8
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
210
Fourier Transform
211
The Frequency Response of an LTI System
212
213
First Order CT Low Pass Filter
Direct Solution of Differential Equation
214
Using Impulse Response
215
Fourier’s Derivation of the CT Fourier
Transform
• x(t) - an aperiodic signal
- view it as the limit of a periodic signal as T ! 1
216
217
Square Wave Example
Discret
e
frequen
cy
points
become
denser
in
as T
218 increas
“Periodify” a non-periodic signal
For simplicity, assume
x(t) has a finite duration.
219
Fourier Series For Periodified x(t)
220
221
Limit of Large Period
222
What Signals have Fourier Transforms?
223
Fourier Transform Examples
Impulses
(a)
(b)
224
225
Fourier Transform of Right-Sided Exponential
Note the inverse relation between the two widths Uncertainty principl
Useful facts about CTFT’s
227
Fourier Transform of a Gaussian
2
x(t) e at — A Gaussian, important in
probability, optics, etc.
228
229
CT Fourier Transforms of Periodic Signals
230
Fourier Transform of Cosine
231
Impulse Train (Sampling Function)
Note: (period in t) T
(period in ) 2/T
232
233
Properties of the CT Fourier Transform
1) Linearity
2) Time Shifting
FT magnitude unchanged
234
Properties (continued)
3) Conjugate Symmetry
Even
Odd
Even
Or
Odd
When x(t) is real (all the physically measurable signals are real), the
negative frequency components do not carry any additional information
beyond the positive frequency components: ≥ 0 will be sufficient.
235
More Properties
4) Time-Scaling
c)
236
237
Conclusions
• System Frequency Response and Unit
Sample Response
• Derivation of CT Fourier Transform pair
• CT Fourier Transforms of pulses,
exponentials
• FT of Periodic Signals Impulses
• Time shift, Scaling, Linearity
238
Signals and Systems
Spring 2011
Lecture #9
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
239
Fourier Transform
• Fourier Transforms of Periodic
Functions
• The convolution Property of the CTFT
• Frequency Response and LTI Systems
Revisited
• Multiplication Property and
Parseval’s Relation
240
Fourier Transform Duality
Fourier Transform Synthesis and Analysis formulas
241
242
Narrow in Time – Wide in Frequency
243
CT Fourier Transforms of Periodic Signals
244
Fourier Transform of Cosine
245
246
Impulse Train (Sampling Function)
Note: (period in t) T
(period in ) 2/T
247
Convolution Property
248
Reminder
249
250
Computing General Responses
251
Periodic Response Using Fourier Transforms
252
Ideal Low Pass Filter Example
253
254
Cascading Nonideal Filters
255
Cascading Ideal Filters
Cascading Gaussians
256
Differentiation Property
257
258
LTI Systems of LCCDE’s
(Linear-constant-coefficient differential equations)
Multiplication Property
Since FT is highly symmetric,
thus if
261
262
Example (continued)
263
Conclusions
• Fourier Transforms of Periodic Functions are
series of impulses
• Convolution in Time, Multiplication in
Fourier and vice-versa.
• Fourier picture makes filters easy to
manipulate
• Multiplication Property and
Parseval’s Relation
264
Signals and Systems
Spring 2011
Lecture #10
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
265
Discrete-Time Fourier Transform
266
The Discrete-Time Fourier Transform
267
268
DTFT Derivation (Continued)
Define
269
DTFT Derivation (Home Stretch)
270
DT Fourier Transform Equations
– Analysis Equation
– DTFT
– Synthesis Equation
– Inverse DTFT
271
272
Transform Requirements
• Synthesis Equation:
– Finite Integration Interval, X must be finite
• Analysis Equation:
– Need conditions analogous to CTFT, e.g.
— Finite energy
— Absolutely summable
273
Examples
Unit Samples
274
Decaying Exponential
275
276
Rectangular Pulse
FIR LPF
277
Ideal DT LPF
278
DTFTs of Periodic Functions
Complex Exponentials
Recall CT result:
279
280
DTFT of General Periodic Functions Using FS
FS
by
superposition
281
DTFT of Sine Function
282
DTFT of DT Unit Sample Train
285
Time and Frequency Shifting
Example
286
Time Reversal and Conjugate Symmetry
287
288
Time Expansion
7) Time Expansion Time scale in CT is
Recall CT property: infinitely fine
But in DT: x[n/2] makes no sense
x[2n] misses odd values of x[n]
But we can “slow” a DT signal down by inserting zeros:
k — an integer ≥ 1
x(k)[n] — insert (k - 1) zeros between successive values
289
Time Expansion (continued)
— Stretched by a factor
of k in time domain
— compressed by a factor
of k in frequency domain
290
Differentiation and Parsevals
8) Differentiation in Frequency
Multiplication Differentiation
by n in frequency
9) Parseval’s Relation
293
Ideal Low Pass Filter
(Reminder)
294
Composing Filters Using DTFT
295
Conclusions
• DTFT maps from discrete-time function to
continuous frequency function.
• DTFT is 2pi periodic.
• Many similar properties to CTFT (linearity, time-
frequency shifting) with small differences
• Convolution in Time, Multiplication in Fourier and
vice-versa.
• Fourier picture makes filters easy to manipulate
296
Signals and Systems
Spring 2011
Lecture #11
Jacob White
(Slides thanks to A. Willsky, T. Weiss,
Q. Hu, and D. Boning)
297
Fourier Transform Review
298
DT and CT Fourier Transform Equations
DT Transform CT Transform
301
DTFT of Rectangular Pulse
FIR LPF
302
Ideal DT LPF
303
304
CT Fourier Transform of Cosine
305
DTFT of Sine Function
306
CT FT Impulse Train (Sampling Function)
Note: (period in t) T
(period in ) 2/T
307
308
DTFT of DT Unit Sample Train
CT
DT
310
CT Convolution Example
311
312
DT Convolution Example
313
Differentiation/Shift Property
CT
DT
314
CT LTI Systems of LCCDE’s
(Linear-constant-coefficient differential equations)
Rational
function of e-
j
,
use PFE to get
h[n]
317
CT Multiplication Property
thus if
318
Examples of the CTFT Multiplication Property
319
320
CTFT Multiplication Property Example (continued)
321
DTFT Multiplication Property
322
Example:
323
324
CT and DT Parsevals
CT:
DT:
325
DT Time and Frequency Shifting
Example
326
DT Time Expansion
7) Time Expansion Time scale in CT is
Recall CT property: infinitely fine
But in DT: x[n/2] makes no sense
x[2n] misses odd values of x[n]
But we can “slow” a DT signal down by inserting zeros:
k — an integer ≥ 1
x(k)[n] — insert (k - 1) zeros between successive values
327
328
DT Time Expansion (continued)
— Stretched by a factor
of k in time domain
— compressed by a factor
of k in frequency domain
329
Conclusions
• DTFT maps from discrete-time function to
continuous frequency function CTFT maps from a
continuous function to a continuous function.
• CTFT has duality.
• DTFT is 2pi periodic.
• DTFT and CTFT have many properties in common.
• Next time – Sampling (Chapter 7).
330