## A Second Course in Stochastic Processes, Volume 2This Second Course continues the development of the theory and applications of stochastic processes as promised in the preface of A First Course. We emphasize a careful treatment of basic structures in stochastic processes in symbiosis with the analysis of natural classes of stochastic processes arising from the biological, physical, and social sciences. |

### What people are saying - Write a review

User Review - Flag as inappropriate

Dalang's course

### Contents

CONTENTS OF A FIRST COURSE | 1 |

Relations of Eigenvalues and Recurrence Classes | 3 |

Special Computational Methods in Markov Chains | 10 |

Applications to Coin Tossing | 18 |

Index | 23 |

Chapter 11 | 31 |

Chapter 12 | 72 |

Right Regular Sequences for the Markov Chain Sn | 83 |

The Spectral Representation of the Transition Density | 330 |

The Concept of Stochastic Differential Equations | 340 |

Some Stochastic Differential Equation Models | 358 |

A Preview of Stochastic Differential Equations | 368 |

Elementary Problems Problems | 377 |

Notes References | 395 |

Chapter 16 | 398 |

An Application of Multidimensional Poisson Processes to Astronomy | 404 |

The Discrete Renewal Theorem | 93 |

Chapter 13 | 100 |

The Ballot Problem | 107 |

Empirical Distribution Functions and Order Statistics | 113 |

Some Limit Distributions for Empirical Distribution Functions | 119 |

Chapter 14 | 138 |

Construction of a Continuous Time Markov Chain from | 145 |

Chapter 15 | 157 |

Examples of Diffusion | 169 |

Differential Equations Associated with Certain Functionals | 191 |

Some Concrete Cases of the Functional Calculations | 205 |

The Nature of Backward and Forward Equations and Calculation | 213 |

Boundary Classification for Regular Diffusion Processes | 226 |

Some Further Characterization of Boundary Behavior | 242 |

Some Constructions of Boundary Behavior of Diffusion Processes | 251 |

Conditioned Diffusion Processes | 261 |

Some Natural Diffusion Models with Killing | 272 |

Semigroup Formulation of Continuous Time Markov Processes | 289 |

Further Topics in the Semigroup Theory of Markov Processes | 305 |

Compound Poisson Processes | 319 |

OneDimensional Geometric Population Growth | 413 |

Deterministic Population Growth with Age Distribution | 419 |

A Discrete Aging Model | 425 |

FLUCTUATION THEORY OF PARTIAL SUMS OF INDEPENDENT IDENTICALLY DISTRIBUTED RANDOM VARIABLES 451 | 453 |

Some Fundamental Identities of Fluctuation Theory and Direct Applications | 459 |

The Important Concept of Ladder Random Variables | 464 |

Proof of the Main Fluctuation Theory Identities | 468 |

More Applications of Fluctuation Theory Problems Notes References 459 464 468 | 473 |

QUEUEING PROCESSES 489 490 492 1 General Description 2 The Simplest Queueing Processes MM1 | 490 |

Some General OneServer Queueing Models | 492 |

Embedded Markov Chain Method Applied to the Queueing Model MGI1 | 497 |

Exponential Service Times GM1 | 504 |

Gamma Arrival Distribution and Generalizations ExM11 | 506 |

Exponential Service with s Servers GIMs | 511 |

The Virtual Waiting Time and the Busy Period | 513 |

Problems | 519 |

525 | |

541 | |

### Other editions - View all

### Common terms and phrases

Answer applications arrival assume boundary bounded Brownian motion calculation called Chapter coefficients compute Consider constant continuous converges corresponding defined definition denote density derived determine differential equation diffusion process distribution function equal establish event example exists expected expression fact finite fixed follows formula further given gives Hence holds implies independent individuals initial integral interval leads Lemma limit Markov chain matrix mean method nonnegative observations obtain occurs operator order statistics parameters Poisson process population positive Problem proof Prove r-superregular random variables recurrent referred regular relation respect result sample paths satisfies sequence Show side solution space standard starting stationary step stochastic stochastic differential equation Suppose Theorem theory transition probability unit variance vector zero