20. Gaussian Measures - Probability

1 Tutorial 20: Gaussian Measures120. Gaussian MeasuresMn(R)isthesetofalln n-matrices with real entries,n nition 141 AmatrixM2Mn(R)is said to besymmetric,if and only ifM= ,ifandonlyifMisnon-singular andM 1= symmetric, we say thatMisnon-negative, if and only if:8u2Rn;hu;Mui 0 Theorem 131 Let 2Mn(R),n 1, be a symmetric and non-negative real matrix. There exist 1;:::; n2R+andP2Mn(R)orthogonal matrix, such that: =P:0B@ n1CA:PtIn particular, there existsA2Mn(R)such that = 20: Gaussian Measures2As a rare exception, theorem (131) is given without 1andM2Mn(R), show that we have:8u;v2Rn;hu;Mvi=hMtu;viExercise 2Mn(R) be a symmetricand non-negative matrix.

2 Let 1be the Probability measure onR:8B2B(R); 1(B)=1p2 ZBe x2=2dxLet = 1 ::: 1be the product measure (R)be such that =A:At. Wede nethemap :Rn!Rnby:8x2Rn; (x)4=Ax+m1. Show that is a Probability measure on (Rn;B(Rn)).2. Explain why the image measureP= ( ) is well-de Show thatPis a Probability measure on (Rn;B(Rn)). 20: Gaussian Measures34. Show that for allu2Rn:FP(u)=ZRneihu; (x)id (x)5. Letv=Atu. Show that for allu2Rn:FP(u)=eihu;mi kvk2=26. Show the following:Theorem 132 Letn 2Mn(R)be a sym-metric and non-negative real matrix. There exists a unique complexmeasure onRn,denotedNn(m; ), with fourier transform:FNn(m; )(u)4=ZRneihu;xidNn(m; )(x)=eihu;mi 12hu; uifor ,Nn(m; )is a Probability 20: Gaussian Measures4De nition 142 Letn 2Mn(R)bea symmetric and non-negative real matrix.

3 The Probability measureNn(m; )onRnde ned in theorem(132)is cal led then-dimensionalgaussian measureornormal distribution ,withmeanm2 Rnand covariance matrix .Exercise 1andm2Rn. Show thatNn(m;0) = 2Mn(R) be a symmetric andnon-negative real matrix. LetA2Mn(R) be such that = :Rn!Cis said to be apolynomial, if and only if, it is a nite linear complex combination of mapsx!x ,1for Show that for allB2B(R), we have:N1(0;1)(B)=1p2 ZBe x2=2dx1 See de nition (140). 20: Gaussian Measures52. Show that:Z+1 1jxjdN1(0;1)(x)<+13. Show that for all integerk 1:1p2 Z+10xk+1e x2=2dx=kp2 Z+10xk 1e x2=2dx4.

4 Show that for all integerk 0:Z+1 1jxjkdN1(0;1)(x)<+15. Show that for all 2Nn:ZRnjx jdN1(0;1) ::: N1(0;1)(x)<+ 20: Gaussian Measures66. Letp:Rn!Cbe a polynomial. Show that:ZRnjp(x)jdN1(0;1) ::: N1(0;1)(x)<+17. Let :Rn!Rnbe de ned by (x)=Ax+m. Explain whythe image measure (N1(0;1) ::: N1(0;1)) is well-de Show that (N1(0;1) ::: N1(0;1)) =Nn(m; ).9. Show if 2 Nnandj j=1,thenx! (x) is a Show that if 02 Nnandj 0j=k+1, then (x) 0= (x) (x) for some ; 2 Nnsuch thatj j=kandj j= Show that the product of two polynomials is a Show that for all 2Nn,x! (x) is a Show that for all 2Nn:ZRnj (x) jdN1(0;1) ::: N1(0;1)(x)<+ 20: Gaussian Measures714.

5 Show the following:Theorem 133 Letn 2Mn(R)be a sym-metric and non-negative real matrix. Then, for all 2Nn,themapx!x is integrable with respect to the Gaussian measureNn(m; ):ZRnjx jdNn(m; )(x)<+1 Exercise =( ij)2Mn(R) be a symmetricand non-negative real matrix. Letj; be the fouriertransform of the Gaussian measureNn(m; ), :8u2Rn; (u)4=eihu;mi 12hu; ui1. Show that:ZRnxjdNn(m; )(x)=i 1@ 20: Gaussian Measures82. Show that:ZRnxjdNn(m; )(x)=mj3. Show that:ZRnxjxkdNn(m; )(x)=i 2@2 @ Show that:ZRnxjxkdNn(m; )(x)= jk+mjmk5. Show that:ZRn(xj mj)(xk mk)dNn(m; )(x)= 20: Gaussian Measures9 Theorem 134 Letn =( ij)2Mn(R)be a symmetric and non-negative real matrix.

6 LetNn(m; )be thegaussian measure with meanmand covariance matrix .Then,forallj;k2Nn, we have:ZRnxjdNn(m; )(x)=mjand:ZRn(xj mj)(xk mk)dNn(m; )(x)= jkDe nition 143 Letn ( ;F;P)be a Probability space. LetX:( ;F)!(Rn;B(Rn))be a measurable map. We say thatXis ann-dimensionalgaussianornormal vector, if and only if itsdistribution is a Gaussian measure , (P)=Nn(m; )for somem2 Rnand 2Mn(R)symmetric and non-negative real the 20: Gaussian Measures10 Theorem 135 Letn ( ;F;P)be a Probability space. LetX:( ;F)!Rnbe a measurable map. ThenXis a Gaussian vector,if and only if there existm2 Rnand 2Mn(R)symmetric andnon-negative real matrix, such that:8u2Rn;E[eihu;Xi]=eihu;mi 12hu; uiwhereh ; iis the usual inner-product nition 144 LetX:( ;F)!

7 R(orC) be a random variableon a Probability space( ;F;P). We say thatXisintegrable,ifandonly if we haveE[jXj]<+1. We say thatXissquare-integrable,if and only if we haveE[jXj2]<+ to de nition (144), ShowXis integrable if and only ifX2L1C( ;F;P).2. ShowXis square-integrable, if and only ifX2L2C( ;F;P). 20: Gaussian Measures11 Exercise to de nition (144), supposeXis Show thatXis integrable, if and only ifXisP-almost surelyequal to an element ofL1R( ;F;P).2. Show thatXis square-integrable, if and only ifXisP-almostsurely equal to an element ofL2R( ;F;P).Exercise ;Y:( ;F)!(R;B(R)) be two square-integrablerandom variables on a Probability space ( ;F;P).

8 1. Show that bothXandYare Show thatXYis integrable3. Show that (X E[X])(Y E[Y]) is a well-de ned and 20: Gaussian Measures12De nition 145 LetX;Y:( ;F)!(R;B(R))be two square-integrable random variables on a Probability space( ;F;P).Wede- ne thecovariancebetweenXandY,denotedcov(X;Y ),as:cov(X;Y)4=E[(X E[X])(Y E[Y])]We say thatXandYareuncorrelatedif and only ifcov(X;Y)= ,cov(X;Y)is cal led thevarianceofX,denotedvar(X).Exercise ;Ybe two square integrable, real random variableon a Probability space ( ;F;P).1. Show thatcov(X;Y)=E[XY] E[X]E[Y].2. Show thatvar(X)=E[X2] E[X] Show thatvar(X+Y)=var(X)+2cov(X;Y)+var(Y)4.

9 Show thatXandYare uncorrelated, if and only if:var(X+Y)=var(X)+var(Y) 20: Gaussian Measures13 Exercise ann-dimensional normal vector on someprobability space ( ;F;P), with lawNn(m; ), wherem2 Rnand =( ij)2Mn(R) is a symmetric and non-negative real Show that each coordinateXj:( ;F)!Ris Show thatE[jX j]<+1for all Show that for allj=1;:::;n,wehaveE[Xj]= Show that for allj;k=1;:::;n,wehavecov(Xj;Xk)= 136 LetXbe ann-dimensional normal vector on a prob-ability space( ;F;P),withlawNn(m; ).Then,forall 2Nn,X is integrable. Moreover, for allj;k2Nn, we have:E[Xj]=mjand:cov(Xj;Xk)= jkwhere( ij)=.

10 20: Gaussian Measures14 Exercise the following:Theorem 137 LetX:( ;F)!(R;B(R))be a real random vari-able on a Probability space( ;F;P).Then,Xis a normal randomvariable, if and only if it is square integrable, and:8u2R;E[eiuX]=eiuE[X] 12u2var(X)Exercise ann-dimensional normal vector on a prob-ability space ( ;F;P), with lawNn(m; ). LetA2Md;n(R)beand nreal matrix, (n;d 1). Letb2 RdandY=AX+ Show thatY:( ;F)!(Rd;B(Rd)) is Show that the law ofYisNd(Am+b;A: :At)3. Conclude thatYis anRd-valued normal random 20: Gaussian Measures15 Theorem 138 LetXbe ann-dimensional normal vector with lawNn(m; )on a Probability space( ;F;P),(n 1).