How about minimizing the square error? J=>(a[n]-s(n])2 Mean square error(MSE) m Example:Estimating DC in white noise xln A+wln] J(A)=(xm)-A)2 Minimize J(A)w.r.t A oA-[∑训-v=0→i-发∑m whxiong@uestc.edu.cn 6
whxiong@uestc.edu.cn 6 J = Mean square error (MSE) X n (x[n] ¡ s[n]) 2 How about minimizing the square error? Minimize J(A) w.r.t A Example: Estimating DC in white noise x[n] = A + w[n] J(A) = X n (x[n]) ¡ A) 2 @J(A) @A = 2 hXx[n] ¡ NA i = 0 A b = 1 N X n x(n)
How about minimizing the square error? J=>(x(n]-s[nl)2 Mean square error(MSE) m Example:Estimating DC in white noise xln A+wln] J(A)=(xn)-A)2 Minimize J(A)w.r.t A oA-区-网-u→i-∑m Q:Is this estimator MVU? whxiong@uestc.edu.cn
whxiong@uestc.edu.cn 7 J = Mean square error (MSE) X n (x[n] ¡ s[n]) 2 How about minimizing the square error? Minimize J(A) w.r.t A Example: Estimating DC in white noise x[n] = A + w[n] J(A) = X n (x[n]) ¡ A) 2 @J(A) @A = 2 hXx[n] ¡ NA i = 0 A b = 1 N X n x(n) Q: Is this estimator MVU?
How about minimizing the square error? J=∑(xn-sn)2 Mean square error(MSE) Example:Estimating DC in white noise xln A+wln] J(A)=(xm)-A)2 Minimize J(A)w.r.t A o∑m-N个-0→1=∑w Q:Is this estimator MVU? A:yes,iff w[n]is AWGN E[A]=A+Elw(n)] whxiong@uestc.edu.cn 8
whxiong@uestc.edu.cn 8 J = Mean square error (MSE) X n (x[n] ¡ s[n]) 2 How about minimizing the square error? Minimize J(A) w.r.t A Example: Estimating DC in white noise x[n] = A + w[n] J(A) = X n (x[n]) ¡ A) 2 @J(A) @A = 2 hXx[n] ¡ NA i = 0 A b = 1 N X n x(n) Q: Is this estimator MVU? A: yes, iff w[n] is AWGN E[A b ] = A + E[w(n)]
Least Square (LS) Similar to linear model,assume s =I0 whxiong@uestc.edu.cn 9
whxiong@uestc.edu.cn Least Square (LS) 9 Similar to linear model, assume s = Hµ
Least Square (LS) Similar to linear model,assume s=H J()=∑(xln-s[n)2 whxiong@uestc.edu.cn 10
whxiong@uestc.edu.cn Least Square (LS) 10 Similar to linear model, assume J(µ) = X(x[n] ¡ s[n]) 2 s = Hµ