Skip to main content

Markov Processes

An Introduction for Physical Scientists

  • 1st Edition - October 8, 1991
  • Latest edition
  • Author: Daniel T. Gillespie
  • Language: English

Markov process theory is basically an extension of ordinary calculus to accommodate functions whos time evolutions are not entirely deterministic. It is a subject that is becoming… Read more

World Book Day celebration

Where learning shapes lives

Up to 25% off trusted resources that support research, study, and discovery.

Description

Markov process theory is basically an extension of ordinary calculus to accommodate functions whos time evolutions are not entirely deterministic. It is a subject that is becoming increasingly important for many fields of science. This book develops the single-variable theory of both continuous and jump Markov processes in a way that should appeal especially to physicists and chemists at the senior and graduate level.

Key features

  • A self-contained, prgamatic exposition of the needed elements of random variable theory
  • Logically integrated derviations of the Chapman-Kolmogorov equation, the Kramers-Moyal equations, the Fokker-Planck equations, the Langevin equation, the master equations, and the moment equations
  • Detailed exposition of Monte Carlo simulation methods, with plots of many numerical examples
  • Clear treatments of first passages, first exits, and stable state fluctuations and transitions
  • Carefully drawn applications to Brownian motion, molecular diffusion, and chemical kinetics

Readership

Professionals/scientists without training in probability and statistics (using books as a "self-help" guide), senior undergraduate and graduate level students in physics and chemistry and mathematicians specializing in game theory, and finite math

Table of contents

Random Variable Theory. General Features of a Markov Process. Continuous Markov Processes. Jump Markov Processes with Continuum States. Jump Markov Processes with Discrete States. Temporally Homogeneous Birth-Death Markov Processes. Appendixes: Some Useful Integral Identities. Integral Representations of the Delta Functions. An Approximate Solution Procedure for "Open" Moment Evolution Equations. Estimating the Width and Area of a Function Peak. Can the Accuracy of the Continuous Process Simulation Formula Be Improved? Proof of the Birth-Death Stability Theorem. Solution of the Matrix Differential Equation. Bibliography. Index.

Product details

  • Edition: 1
  • Latest edition
  • Published: October 31, 2012
  • Language: English

About the author

DG

Daniel T. Gillespie

Affiliations and expertise
Naval Weapons Center

View book on ScienceDirect

Read Markov Processes on ScienceDirect