You are here: Home / Shop / Product Detail Page |

## Cambridge Series in Statistical and Probabilistic Mathematics: Markov Chains (Softcover)"Markov chains are the simplest mathematical models for random phenomena evolving in time. Their simple structure make it possible to say a great deal about their behaviour. At the same time, the class of Markov chains is rich enough to serve in many applications. This makes Markov chains the first and most important examples of random processes. Indeed, the whole of the mathematical study of random processes can be regarded as a generalization in one way or another of the theory of Markov chains." — From the Preface ## $13.50 |

### Need More Info?

Please contact us if you've got questions about this product.## Condition

**ACCEPTABLE:** The book shows some of the usual signs of use and wear: slightly bent corners and slightly worn covers. A previous owner’s name is written in ink on the first endpage, and there is a limited amount of highlighting and underlining, but these marks do not obscure the text.

## Description

From the back cover: “Markov chains are central to the understanding of random processes. This is not only because they pervade applications, but also because one can calculate explicitly many quantities of interest. This textbook, aimed at advanced undergraduate or MSc students with some background in basic probability theory, focuses on Markov chains and develops quickly a coherent and rigorous theory. In a non-technical way, it explains methods of calculation for transition probabilities, hitting probabilities, long-run averages and equilibrium probabilities.

“The author presents both discrete-time and continuous-time chains and also discusses reversibility. He uses random walks as important examples, as well as Poisson processes and birth-and-death processes. A distinguishing feature of the book is an introduction to more advanced topics such as martingales and potentials, in the established context of Markov chains. There are applications in simulation, economics, optimal control, genetics, queues and many other topics.

“There is a careful selection of exercises and examples drawn both from theory and practice. The book will therefore be an ideal text either for elementary courses on random processes or those that are more oriented toward applications.”

**BRIEF CONTENTS**

- Preface
- Introduction
- 1. Discrete-time Markov chains
- 2. Continuous-time Markov chains I
- 3. Continuous-time Markov chains II
- 4. Further theory
- 5. Applications
- 6. Appendix: probability and measure
- Further reading
- Index

About the series: “This series of high quality upper-division textbooks and expository monographs covers all aspects of stochastic applicable mathematics. The topics range from pure and applied statistics to probability theory, operations research, optimization and mathematical programming. The books contain clear presentations of new developments in the field and also of the state of the art in classical methods. While emphasizing rigorous treatment of theoretical methods, the books also contain applications and discussions of new techniques made possible by advances in computational practice.”

## Details

- SKU:
- 1768
- Subject:
- Mathematics
- Author:
- Norris, J. R.
- Publisher:
- Cambridge University Press
- Publish Date:
- 1999 Reprint
- Format:
- Softcover
- Weight (pounds):
- 1.04
- Dimensions (W”xL”xH”):
- 7″x9.9″x0.7″
- ISBN-13:
- 9780521633963
- ISBN-10:
- 0521633966
- Grade Level:
- College

## Related Products

### Products related to "Cambridge Series in Statistical and Probabilistic Mathematics: Markov Chains (Softcover)"

- Views:

#### Stochastic Models: An Algorithmic Approach (Softcover)

$149.99

"

*Stochastic Models: An Algorithmic Approach*fulfills the widely perceived need for an introductory text which demonstrates the effective use of simple stochastic models to gain insight into the behaviour of complex stochastic systems." — From the back cover#### The Art of Probability for Scientists and Engineers (Softcover)

$63.95

"The fact that probability theory is increasingly being used to make important decisions is a further incentive for examining the theory carefully. I have witnessed very important decisions being made that were based on probability, and as a citizen I have to endure the consequences of similar decisions made in Washington, D.C., and elsewhere; hence, I feel that anything that can clarify and improve the quality of the application of probability theory will be of great benefit to our society." — Richard W. Hamming, U.S. Naval Postgraduate School and Author

#### An Introduction to Random Matrices (Hardback)

$53.95

"The theory of random matrices plays an important role in many areas of pure mathematics and employs a variety of sophisticated mathematical tools (analytical, probabilistic, and combinatorial). This diverse array of tools, while attesting to the vitality of the field, presents several formidable obstacles to the newcomer, and even to the expert probabilist. This rigorous introduction to the basic theory is sufficiently self-contained to be accessible to graduate students in mathematics or related sciences who have mastered probability theory at the graduate level, but who have not necessarily been exposed to advanced notions of functional analysis, algebra, or geometry." — From the back cover

#### Measure and Integral: An Introduction to Real Analysis (Hardback)

$53.29

"This volume develops the classical theory of the Lebesgue integral and some of its applications. The integral is initially presented in the context of

*n*-dimensional Euclidean space, following a thorough study of the concepts of outer measure and measure. A more general treatment of the integral, based on an axiomatic approach, is later given." — From the back cover#### A Series of Comprehensive Studies in Mathematics, Volume 333: The Random-Cluster Model (Hardback)

$29.42

"The random-cluster model has emerged in recent years as a key tool in mathematical study of ferromagnetism. It may be viewed as an extension of percolation to include Ising and Potts models, and its analysis is a mix of arguments from probability and geometry." — From the back cover

#### Analytical Mechanics: A Comprehensive Treatise on the Dynamics of Constrained Systems; For Engineers, Physicists, and Mathematicians (Hardback)

$279.95

From the Preface: “This book is a classical and detailed introduction to advanced analytical mechanics (AM), with special emphasis on its basic principles and equations of motion, as they apply to the most general constrained mechanical systems with a finite number of degrees of freedom..."

#### The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization (Hardcover)

$169.95

"Provides an in-depth treatment of the Traveling Salesman problem—the archetypical problem in combinatorial optimization. Each chapter deals with a different aspect of the problem, and has been written by an acknowledged expert in the field. Focusses on the essential ideas in a self-contained manner. Includes exercises and an extensive bibliography."—from the publisher

#### Algebra 1 2.0 (Teaching Textbook, Answer Key & Test Bank, 10-Disc CD Set)

$149.00

This is a "technologically-advanced, math curriculum designed specifically for homeschoolers." It is meant for the student who enjoys independent study.

#### Algebra 2 2.0 (Teaching Textbook, Answer Key & Test Bank, 12-Disc CD Set)

$149.00

This is a "technologically-advanced, math curriculum designed specifically for homeschoolers." It is meant for the student who enjoys independent study.

#### History of Algebraic Geometry: An Outline of the History and Development of Algebraic Geometry (Hardback)

$136.99

"Algebraic geometry is undoubtedly the area of mathematics where the deviation is greatest between the intuitive ideas forming its starting point and the abstract and complex concepts at the foundation of modern research. The purpose of this work is to help the willing reader abridge the gap." — From the Foreword (page VII)

#### Encyclopedia of Mathematics and Its Applications 20: Finite Fields (Hardback)

$123.50

"In this book, which is the first one devoted entirely to finite fields, we have aimed at presenting both the classical and the applications-oriented aspect of the subject. Thus, in addition to what has to be considered the essential core of the theory, the reader will find results and techniques that are of importance mainly because of their use in applications." — From the Authors in the Preface

#### Positive Harmonic Functions and Diffusion: An Integrated Analytic and Probabilistic Approach (Hardback)

$119.95

"In this book, Professor Pinsky gives a self-contained account of the theory of positive harmonic functions for second order elliptic operators, using an integrated probabilistic and analytic approach." — From the back cover

#### Stochastic Modelling and Applied Probability 51: Applied Probability and Queues, Second Edition (Hardback)

$91.29

"This book serves as an introduction to queueing theory and provides a thorough treatment of tools such as Markov processes, renewal theory, random walks, Lévy processes, matrix-analytic methods, and chagne of measure. ..." — From the back cover

#### Introduction to Analysis of the Infinite, Book I (Hardback)

$89.95

"...I have divided this work into two books; in the first of these I have confined myself to those matters concerning pure analysis. In the second book I have explained those things which must be known from geometry, since analysis is ordinarily developed in such a way that its application to geometry is shown. ... [I]n the first book, since all of analysis is concerned with variable quantities and functions of such variables, I have given full treatment to functions. I have also treated the transformation of functions and functions as the sum of infinite series. In addition I have developed functions in infinite series..." — From the Preface by the Author, Leonhard Euler

#### Discrete Mathematics and Its Applications: Handbook of Computational Group Theory (Hardback)

$79.99

"The origins of computational group theory (CGT) date back to the late 19th and early 20th centuries. Since then, the field has flourished, particularly during the past 30 to 40 years, and today it remains a lively and active branch of mathematics." — From the back cover

#### Emergence of the Theory of Lie Groups: An Essay in the History of Mathematics 1869-1926 (Hardback)

$79.95

"Written by the recipient of the 1997 MAA Chauvenet Prize for mathematical exposition, this book tells how the theory of Lie groups emerged from a fascinating cross-fertilization of many strains of nineteenth and twentieth century geometry, analysis, mathematical physics, algebra, and topology. The reader will meet a host of mathematicians from the period and become acquainted with the major mathematical schools." — From the back cover

#### Studies in Advanced Mathematics: Harmonic Analysis and Applications (Hardback)

$79.95

"Harmonic analysis plays an essential role in understanding a host of engineering, mathematical, and scientific ideas. In

*Harmonic Analysis and Applications*, the analysis and synthesis of functions in terms of harmonics is presented in such a way as to demonstrate the vitality, power, elegance, usefulness, and the intricacy and simplicity of the subject." — From the back cover#### Encyclopedia of Mathematics and Its Applications 20: Finite Fields (Softcover)

$73.95

"In this book, which is the first one devoted entirely to finite fields, we have aimed at presenting both the classical and the applications-oriented aspect of the subject. Thus, in addition to what has to be considered the essential core of the theory, the reader will find results and techniques that are of importance mainly because of their use in applications." — From the Authors in the Preface

#### Iterative Methods for Sparse Linear Systems, Second Edition (Softcover)

$73.95

"This book can be used to teach graduate-level courses on iterative methods for linear systems. Engineers and mathematicians will find its contents easily accessible, and practitioners and educators will value it as a helpful resource. The preface includes syllabi that can be used for either a semester- or quarter-length course in both mathematics and computer science." — From the back cover

#### Discrete Mathematics and Its Applications: A Combinatorial Approach to Matrix Theory and Its Applications (Hardback)

$73.75

"Unlike most elementary books on matrices,

**A Combinatorial Approach to Matrix Theory and Its Applications**employs combinatorial and graph-theoretical tools to develop basic theorems of matrix theory, shedding new light on the subject by exploring the connections of these tools to matrices." — From the back cover