Introduction to Probability
Preface
I Basics of Probability
1
Probability and Counting
Motivating Example
Theory
Examples
Additional Exercises
2
The Factorial
Motivating Example
Theory
Examples
Additional Exercises
3
Box Models and Combinations
Motivating Example
Theory
Essential Practice
Additional Practice
4
Sampling With Replacement
Motivating Example
Discussion
Examples
Bonus Material
5
Double Counting
Motivating Example
Theory
Examples
6
Conditional Probability
Motivating Example
Theory
Examples
Additional Exercises
7
Independence
Motivating Example
Theory
Examples
Additional Exercises
8
Law of Total Probability
Motivating Example
Theory
Examples
9
Bayes’ Theorem
9.1
Motivating Example
9.2
Theory
9.3
Examples
II Discrete Probability
10
Random Variables
Motivating Example
Theory
Essential Practice
Additional Exercises
11
Cumulative Distribution Functions
Theory
Examples
12
Hypergeometric Distribution
Motivating Example
Theory
Visualizing the Distribution
Calculating Hypergeometric Probabilities on the Computer
Another Formula for the Hypergeometric Distribution (optional)
Essential Practice
Additional Exercises
13
Binomial Distribution
Motivating Example
Theory
Visualizing the Distribution
Calculating Binomial Probabilities on the Computer
Essential Practice
Additional Exercises
14
Geometric Distribution
Motivating Example
Theory
Visualizing the Distribution
Essential Practice
15
Negative Binomial Distribution
Motivating Example
Theory
Visualizing the Distribution
Calculating Negative Binomial Probabilities on the Computer
Essential Practice
Additional Exercises
16
Poisson Distribution
Motivating Example
Theory
Visualizing the Distribution
Calculating Poisson Probabilities on the Computer
Essential Practice
17
Poisson Process
Motivating Example
Theory
Why Poisson?
Essential Practice
18
Joint Distributions
Motivating Example
Theory
Essential Practice
Additional Exercises
19
Marginal Distributions
Motivating Example
Theory
Essential Practice
Additional Exercises
20
Conditional Distributions
Motivating Example
Theory
Essential Practice
Additional Exercises
21
Sums of Random Variables
Theory
Essential Practice
Additional Exercises
22
Expected Value
Motivating Example
Theory
Essential Practice
Additional Exercises
23
Expected Value and Infinity
23.1
Pascal’s Wager
23.2
St. Petersburg Paradox
24
LOTUS
Motivating Example
Theory
Essential Practice
Additional Exercises
25
2D LOTUS
Theory
Essential Practice
26
Linearity of Expectation
Theory
Essential Practice
Additional Practice
27
Expected Value of a Product
Theory
Essential Practice
28
Variance
Motivating Example
Theory
Essential Practice
Additional Practice
29
Covariance
Theory
Essential Practice
Additional Practice
30
Properties of Covariance
Optional Video
Theory
Essential Practice
Additional Practice
31
Random Walk
Theory
Essential Practice
32
Law of Large Numbers
Motivating Example
Theory
Essential Practice
III Continuous Probability
33
Continuous Random Variables
Motivating Example
Theory
Optional Video
Essential Practice
34
Uniform Distribution
Motivation
Theory
Essential Practice
35
Exponential Distribution
Motivating Example
Theory
Essential Practice
36
Transformations
Motivating Example
Theory
Essential Practice
Additional Practice
37
Expected Value of Continuous Random Variables
Theory
Essential Practice
38
LOTUS for Continuous Random Variables
Theory
Essential Practice
39
Variance of Continuous Random Variables
Theory
Essential Practice
Additional Practice
40
Normal Distribution
Motivation
Standard Normal Distribution
(General) Normal Distribution
Essential Practice
41
Joint Continuous Distributions
Theory
Worked Examples
Essential Practice
Additional Practice
42
Marginal Continuous Distributions
Motivating Example
Theory
Essential Practice
43
Expectations of Joint Continuous Distributions
Theory
Essential Practice
44
Covariance of Continuous Random Variables
Theory
Essential Practice
45
Sums of Continuous Random Variables
Theory
Essential Practice
46
Central Limit Theorem
Motivation
Theory
Worked Examples
Essential Practice
Additional Practice
IV Random Processes
47
Random Processes
Motivation
Theory
Essential Practice
48
Examples of Random Processes
49
Brownian Motion
Brownian Motion as the Limit of a Random Walk
Essential Practice
50
Mean Function
Theory
Essential Practice
51
Variance Function
Theory
Essential Practice
52
Autocovariance Function
Theory
Essential Practice
53
Stationary Processes
Motivation
Theory
Essential Practice
V Random Signal Processing
54
Autocorrelation Function
Theory
Essential Practice
55
Power of a Stationary Process
Motivation
Theory
Essential Practice
56
Power Spectral Density
Motivation
Theory
Essential Practice
57
LTI Filters in the Time Domain
Motivation
Review
Theory
Essential Practice
58
LTI Filters in the Frequency Domain
Motivation
Theory
Essential Practice
Appendix
A
Distribution Tables
A.1
Discrete Distributions
A.2
Continuous Distributions
B
Complex Numbers
Motivation
Theory
Essential Practice
C
Fourier Transforms
Continuous-Time Fourier Transforms
Discrete-Time Fourier Transforms
Essential Practice
D
Fourier Tables
D.1
Continuous-Time Fourier Transforms
D.2
Discrete-Time Fourier Transforms
D.3
Fourier Properties
Published with bookdown
Introduction to Probability
Introduction to Probability
Dennis Sun
2020-08-14
Preface