A First Course in Stochastic Models

Author: Henk C. Tijms  

Publisher: John Wiley & Sons Inc‎

Publication year: 2003

E-ISBN: 9780470864289

P-ISBN(Paperback): 9780471498810

P-ISBN(Hardback):  9780471498803

Subject: O211.6 stochastic process

Language: ENG

Access to resources Favorite

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Description

The field of applied probability has changed profoundly in the past twenty years. The development of computational methods has greatly contributed to a better understanding of the theory. A First Course in Stochastic Models provides a self-contained introduction to the theory and applications of stochastic models. Emphasis is placed on establishing the theoretical foundations of the subject, thereby providing a framework in which the applications can be understood. Without this solid basis in theory no applications can be solved.

  • Provides an introduction to the use of stochastic models through an integrated presentation of theory, algorithms and applications.
  • Incorporates recent developments in computational probability.
  • Includes a wide range of examples that illustrate the models and make the methods of solution clear.
  • Features an abundance of motivating exercises that help the student learn how to apply the theory.
  • Accessible to anyone with a basic knowledge of probability.

A First Course in Stochastic Models is suitable for senior undergraduate and graduate students from computer science, engineering, statistics, operations resear ch, and any other discipline where stochastic modelling takes place. It stands out amongst other textbooks on the subject because of its integrated presentation of theory, algorithms and applications.

Chapter

Contents

pp.:  1 – 7

Preface

pp.:  7 – 11

2 Renewal-Reward Processes

pp.:  13 – 45

3 Discrete-Time Markov Chains

pp.:  45 – 93

4 Continuous-Time Markov Chains

pp.:  93 – 153

5 Markov Chains and Queues

pp.:  153 – 199

6 Discrete-Time Markov Decision Processes

pp.:  199 – 245

7 Semi-Markov Decision Processes

pp.:  245 – 291

8 Advanced Renewal Theory

pp.:  291 – 319

9 Algorithmic Analysis of Queueing Models

pp.:  319 – 351

Appendices

pp.:  351 – 443

Index

pp.:  443 – 487

LastPages

pp.:  487 – 490

The users who browse this book also browse