An introduction to Markov chains
A N D E R S TO LV E RA N I N T R O D U C T I O N TOM A R KOV C H A I N SL E C T U R E N OT E S F O R S TO C H A S T I C P R O C E S S E S2Anders TolverDepartment of Mathematical SciencesUniversity of CopenhagenUniversitetsparken5DK-2100Cope nhagen , Denmarkemail: printing, November2016Copyright Anders TolverISBN:978-87-7078-952-3PrefaceThese lecture notes have been developed for the courseStochastic Pro-cessesat Department of Mathematical Sciences, University of Copen-hagen during the teaching years2010-2016. The material covers as-pects of the theory for time-homogeneous Markov chains in discreteand continuous time on finite or countable state back bone of this work is the collection of examples and exer-cises in Chapters2and3. It is my hope that all mathematical resultsand tools required to solve the exercises are contained in Chapters2and3and in Appendix B. The manuscript was never intended toprovide complete mathematical proofs of all the main results sincethese may be found elsewhere in the literature.
6 CONTENTS B Mathematical tools 131 B.1 Elementary conditional probabilities 131 B.2 Some formulaes for sums and series 133 B.3 Some results for matrices 134 B.4 First order differential equations 136 B.5 Second order linear recurrence equations 137 B.6 The ratio test 138 B.7 Integral test for convergence 138 B.8 How to do certain computations in R 139 C Proofs of selected results 147
Download An introduction to Markov chains
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: