Digital Signal Processing and Applications (eBook)

Cover 1
Digital Signal Processing and Applications 4
Contents 6
Preface 10
1 Introduction 12
Background 12
Objectives 12
1.1 The history of digital signal processing 12
1.1.1 Measurements and analysis 13
1.1.2 Telecommunications 14
1.1.3 Audio and television 14
1.1.4 Household appliances and toys 15
1.1.5 Automotive 15
1.2 Digital signal processing basics 15
1.2.1 Continuous and discrete signals 15
1.2.2 Sampling and reconstruction 16
1.2.3 Quantization 19
1.2.4 Processing models for discrete-time series 20
1.2.4.1 Linear systems 20
1.2.4.2 The difference equation model 22
1.2.4.3 The state–space model 23
1.2.4.4 The convolution model 24
1.2.4.5 The transfer function model 25
1.2.4.6 The frequency function model 26
1.3 Common filters 28
1.3.1 Filter architectures 28
1.3.1.1 The non-recursive filter 29
1.3.1.2 The recursive filter 29
1.3.1.3 The lattice filter 32
1.3.2 Filter synthesis 33
1.3.2.1 Indirect filter synthesis 37
1.3.2.2 Direct filter synthesis 40
1.4 Digital control systems 43
1.4.1 Proportional-integral-derivate controllers 46
1.4.2 Advanced controllers 47
1.4.2.2 Pole placement controller 47
Summary 49
Review questions 49
Solved problems 50
2 The analog–digital interface 52
Background 52
Objectives 52
2.1 System considerations 52
2.1.1 Encoding and modulation 52
2.1.2 Number representation and companding systems 55
2.2 Digital-to-analog conversion 58
2.2.1 Multiplying digital-to-analog converters 60
2.2.2 Integrating digital-to-analog converters 64
2.2.3 Bitstream digital-to-analog converters 65
2.2.4 Sample-and-hold and reconstruction filters 67
2.3 Analog-to-digital conversion 69
2.3.1 Anti-aliasing filters and sample-and-hold 71
2.3.2 Flash analog-to-digital converters 72
2.3.3 Successive approximation analog-to-digital converters 73
2.3.4 Counting analog-to-digital converters 75
2.3.5 Integrating analog-to-digital converters 76
2.3.6 Dither 79
2.3.7 Sigma–delta analog-to-digital converters 79
Summary 81
Review questions 82
Solved problems 82
3 Adaptive digital systems 84
Background 84
Objectives 84
3.1 Introduction 84
3.1.1 System structure 85
3.2 The processor and the performance function 86
3.2.1 The adaptive linear combiner 86
3.2.2 The performance function 88
3.3 Adaptation algorithms 91
3.3.1 The method of steepest descent 91
3.3.2 Newton's method 92
3.3.3 The least mean square algorithm 94
3.4 Applications 95
3.4.1 Adaptive interference canceling 95
3.4.2 Equalizers 97
3.4.3 Adaptive beamforming 100
Summary 104
Review questions 104
Solved problems 104
4 Non-linear applications 106
Background 106
Objectives 106
4.1 The median filter 106
4.1.1 Basics 106
4.1.2 Threshold decomposition 107
4.1.3 Performance 109
4.1.4 Applications 110
4.2 Artificial neural networks 111
4.2.1 Background 111
4.2.2 The models 111
4.2.3 Some historical notes 112
4.2.4 Feedforward networks 113
4.2.4.1 Nodes 113
4.2.4.2 Network topology 114
4.2.4.3 Training and adaptation 118
4.2.4.4 Applications 121
4.2.5 Feedback networks 123
4.2.5.1 Nodes 123
4.2.5.2 Network topology 124
4.2.5.3 Local and global minimum 125
4.2.5.4 Applications 126
4.2.6 An example application 127
4.2.6.1 The problem 127
4.2.6.2 The Hamming net 127
4.2.6.3 The feedforward input layer 128
4.2.6.4 The feedback layer, MAXNET 130
4.3 Fuzzy logic 132
4.3.1 General 132
4.3.2 Membership functions 133
4.3.3 Fuzzy rules and inference 134
4.3.4 Defuzzification 138
4.3.5 Applications 139
Summary 140
Review questions 140
Solved problems 141
5 Spectral analysis and modulation 142
Background 142
Objectives 142
5.1 Discrete Fourier transform and fast Fourier transform 142
5.2 Spectral analysis 145
5.2.1 Discrete Fourier transform and fast Fourier transform approaches 146
5.2.2 Using the auto-correlation function 148
5.2.3 Periodogram averaging 149
5.2.4 Parametric spectrum analysis 151
5.2.5 Wavelet analysis 154
5.3 Modulation 157
5.3.1 Amplitude shift keying (ASK) 157
5.3.2 Frequency shift keying (FSK) 159
5.3.3 Phase shift keying (PSK) 162
5.3.4 Complex modulation 165
5.3.5 The Hilbert transformer 167
Summary 168
Review questions 169
Solved problems 169
6 Introduction to Kalman filters 170
Background 170
Objectives 170
6.1 An intuitive approach 170
6.1.1 Recursive least square estimation 171
6.1.2 The pseudo-inverse 174
6.2 The Kalman filter 176
6.2.1 The signal model 176
6.2.2 The filter 178
6.2.3 Kalman filter properties 184
6.2.4 Applications 187
Summary 187
Review questions 188
Solved problems 188
7 Data compression 190
Background 190
Objectives 190
7.1 An information theory primer 190
7.1.1 Historic notes 190
7.1.2 Information and entropy 191
7.1.2.1 Some concluding remarks about the concept of entropy 195
7.2 Source coding 195
7.2.1 Huffman algorithm 196
7.2.2 Delta modulation, adaptive delta modulation and continuously variable slope delta modulation 199
7.2.3 Differential pulse code modulation and adaptive differential pulse code modulation 201
7.2.4 Speech coding, adaptive predictive coding and sub-band coding 203
7.2.5 Vocoders and linear predictive coding 204
7.2.6 Image coding, joint photographics expert group (JPEG), moving pictures expert group (MPEG) 208
7.2.7 The layer-3 of MPEG-1 algorithm (MP3) 211
7.2.8 The Lempel–Ziv algorithm 212
7.3 Recognition techniques 214
7.3.1 A general problem formulation 214
7.3.2 Speech recognition 216
7.3.3 Image recognition 216
Summary 217
Review questions 218
Solved problems 218
8 Error-correcting codes 220
Background 220
Objectives 220
8.1 Channel coding 220
8.1.1 The channel model 221
8.1.2 The channel capacity 224
8.2 Error-correcting codes 226
8.2.1 Hamming distance and error correction 226
8.2.2 Linear block codes 229
8.2.3 Cyclic codes, Bose, Chaudhuri, Hocquenghem codes 234
8.2.4 Convolution codes 240
8.2.5 Viterbi decoding 241
8.2.6 Interleaving 245
8.2.7 Concatenated codes and turbo codes 247
Summary 249
Review questions 249
Solved problems 250
9 Digital signal processors 252
Background 252
Objectives 252
9.1 System considerations 252
9.1.1 Applications and requirements 252
9.1.2 Hardware implementation 254
9.2 Digital signal processors versus conventional microprocessors 257
9.2.1 Conventional microprocessors 257
9.2.1.1 Architecture 257
9.2.1.2 Instruction repertoire 258
9.2.1.3 Interface 259
9.2.2 Digital signal processors 259
9.2.2.1 Architecture 259
9.2.2.2 Instruction repertoire 261
9.2.2.3 Interface 261
9.3 Programming digital signal processors 262
9.3.1 The development process 262
9.3.2 Digital signal processing programming languages 263
9.3.3 The program structure 264
9.3.4 Arithmetic issues 265
9.3.5 Data structures and addressing modes 268
9.3.6 The state machine 270
9.4 Implementation examples 276
9.4.1 Finite impulse response-type filter 276
9.4.2 Infinite impulse response-type filter 283
9.5 Future systems and chips 286
Summary 287
Review questions 287
Solved problems 287
Appendix 1 Solutions to problems 290
Appendix 2 A MATLAB’/Simulink’ primer 324
A2.1 Introduction 324
A2.1.1 The software 324
A2.2 Basics 324
A2.2.1 Some simple math 326
A2.2.2 Variables, scalars, vectors and matrices 327
A2.2.2.1 Scalars 327
A2.2.2.2 Vectors and matrices 328
A2.2.2.3 Vector and matrix computations 329
A2.2.2.4 Addressing vectors and matrices 331
A2.2.2.5 Sequences 332
A2.2.3 Basic input/output and graphics 334
A2.2.3.1 Input 334
A2.2.3.2 Numerical and character output 335
A2.2.3.3 Graphic output 335
A2.2.4 Other programming structures 338
A2.2.4.1 Conditional execution 338
A2.2.4.2 Loop structures 339
A2.3 Workspace, scripts and functions 339
A2.3.1 The workspace 339
A2.3.2 Scripts and m-files 340
A2.3.3 Functions 341
A2.4 Some useful functions 342
A2.4.1 Linear systems 342
A2.4.2 Filter design 344
A2.4.2.1 Analog filter design 344
A2.4.2.2 Transformations 346
A2.4.2.3 Digital filter design 347
A2.4.3 Fast Fourier transform and convolution 348
A2.5 Simulink’ 349
References 352
Glossary 356
A 356
B 356
C 356
D 357
E 357
F 357
G 358
H 358
I 358
J 358
L 358
M 358
N 359
O 359
P 359
Q 359
R 359
S 359
T 360
U 360
V 360
W 360
X 360
Z 360
Index 362
A 362
B 362
C 363
D 363
E 364
F 364
G 364
H 364
I 365
J 365
K 365
L 365
M 365
N 366
O 366
P 366
Q 367
R 367
S 367
T 368
U 368
V 368
W 368
X 368
Y 368
Z 368