Bayesian Time Series Models

Author: David Barber; A. Taylan Cemgil; Silvia Chiappa  

Publisher: Cambridge University Press‎

Publication year: 2011

E-ISBN: 9781139089104

P-ISBN(Paperback): 9780521196765

Subject: O212.8 Bayesian statistics

Keyword: 计算机的应用

Language: ENG

Access to resources Favorite

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Bayesian Time Series Models

Description

'What's going to happen next?' Time series data hold the answers, and Bayesian methods represent the cutting edge in learning what they have to say. This ambitious book is the first unified treatment of the emerging knowledge-base in Bayesian time series techniques. Exploiting the unifying framework of probabilistic graphical models, the book covers approximation schemes, both Monte Carlo and deterministic, and introduces switching, multi-object, non-parametric and agent-based models in a variety of application environments. It demonstrates that the basic framework supports the rapid creation of models tailored to specific applications and gives insight into the computational complexity of their implementation. The authors span traditional disciplines such as statistics and engineering and the more recently established areas of machine learning and pattern recognition. Readers with a basic understanding of applied probability, but no experience with time series analysis, are guided from fundamental concepts to the state-of-the-art in research and practice.

Chapter

1.7 Discussion and summary

Bibliography

Contributors

2 Adaptive Markov chain Monte Carlo: theory and methods

2.1 Introduction

2.2 Adaptive MCMC algorithms

2.3 Convergence of the marginal distribution

2.4 Strong law of large numbers

2.5 Convergence of the equi-energy sampler

2.6 Conclusion

2.A Appendix: Proof of Section 2.5

Bibliography

Contributors

3 Auxiliary particle filtering: recent developments

3.1 Background

3.2 Interpretation and implementation

3.3 Applications and extensions

3.4 Further stratifying the APF

3.5 Conclusions

Bibliography

Contributors

4 Monte Carlo probabilistic inference for diffusion processes: a methodological framework

4.1 Introduction

4.2 Random weight continuous–discrete particle filtering

4.3 Transition density representation for a class of diffusions

4.4 Exact simulation of diffusions

4.5 Exact simulation of killed Brownian motion

4.6 Unbiased estimation of the transition density using series expansions

4.7 Discussion and directions

Bibliography

Contributor

5 Two problems with variational expectation maximisation for Time Series models

5.1 Introduction

5.2 The variational approach

5.3 Compactness of variational approximations

5.4 Variational approximations are biased

5.5 Conclusion

Bibliography

Contributors

6 Approximate inference for continuous-time Markov processes

6.1 Introduction

6.2 Partly observed diffusion processes

6.3 Hidden Markov characterisation

6.4 The variational approximation

6.5 The Gaussian variational approximation

6.6 Diffusions with multiplicative noise

6.7 Parameter inference

6.8 Discussion and outlook

Bibliography

Contributors

7 Expectation propagation and generalised EP methods for inference in switching linear dynamical systems

7.1 Introduction

7.2 Notation and problem description

7.3 Assumed density filtering

7.4 Expectation propagation

7.5 Free-energy minimisation

7.6 Generalised expectation propagation

7.7 Alternative backward passes

7.8 Experiments

7.9 Discussion

7.A Appendix: Operations on conditional Gaussian potentials

7.B Appendix: Proof of Theorem 7.1

Bibliography

Contributors

8 Approximate inference in switching linear dynamical systems using Gaussian mixtures

8.1 Introduction

8.2 The switching linear dynamical system

8.3 Gaussian sum filtering

8.4 Expectation correction

8.5 Demonstration: traffic flow

8.6 Comparison of smoothing techniques

8.7 Summary

Bibliography

Contributor

9 Physiological monitoring with factorial switching linear dynamical systems

9.1 Introduction

9.2 Model

9.3 Novel conditions

9.4 Parameter estimation

9.5 Inference

9.6 Experiments

9.7 Summary

Bibliography

Contributors

10 Analysis of changepoint models

10.1 Introduction

10.2 Single changepoint models

10.3 Multiple changepoint models

10.4 Comparison of methods

10.5 Conclusion

10.A Appendix: segment parameter estimation

Bibliography

Contributors

11 Approximate likelihood estimation of static parameters in multi-target Models

11.1 Introduction

11.2 The multi-target model

11.3 A review of the PHD filter

11.4 Approximating the marginal likelihood

11.5 SMC approximation of the PHD filter and its gradient

11.6 Parameter estimation

11.7 Simulation study

11.8 Conclusion

Bibliography

Contributors

12 Sequential Inference for Dynamically Evolving Groups of Objects

12.1 Introduction

12.2 MCMC-particles algorithm

12.3 Group tracking

12.4 Ground target tracking

12.5 Group stock selection

12.6 Conclusions

12.A Appendix: Base group representation

Bibliography

Contributors

13 Non-commutative Harmonic Analysis in Multi-object Tracking

13.1 Introduction

13.2 Harmonic analysis on finite groups

13.3 Band-limited approximations

13.4 A hidden Markov model in Fourier space

13.5 Approximations in terms of marginals

13.6 Efficient computation

13.7 Conclusions

Bibliography

Contributor

14 Markov chain Monte Carlo algorithms for Gaussian processes

14.1 Introduction

14.2 Gaussian process models

14.3 Non-Gaussian likelihoods and deterministic methods

14.4 Sampling algorithms for Gaussian process models

14.5 Related work and other sampling schemes

14.6 Demonstration on regression and classification

14.7 Transcriptional regulation

14.8 Dealing with large datasets

14.9 Discussion

Bibliography

Contributors

15 Nonparametric hidden Markov models

15.1 Introduction

15.2 From HMMs to Bayesian HMMs

15.3 The infinite hidden Markov model

15.4 Inference

15.5 Example: unsupervised part-of-speech tagging

15.6 Beyond the iHMM

15.7 Conclusions

15.A Appendix: Equivalence of the hierarchical Polya urn and hierarchical Dirichlet process

Bibliography

Contributors

16 Bayesian Gaussian Process Models for Multi-sensor time series prediction

16.1 Introduction

16.2 The information processing problem

16.3 Gaussian processes

16.4 Trial implementation

16.5 Empirical evaluation

16.6 Computation time

16.7 Related work

16.8 Conclusions

16.A Appendix

Bibliography

Contributors

17 Optimal control theory and the linear Bellman equation

17.1 Introduction

17.2 Discrete time control

17.3 Continuous time control

17.4 Stochastic optimal control

17.5 Learning

17.6 Path integral control

17.7 Approximate inference methods for control

17.8 Discussion

Bibliography

Contributor

18 Expectation maximisation methods for solving (PO)MDPs and optimal control problems

18.1 Introduction

18.2 Markov decision processes and likelihood maximisation

18.3 Expectation maximisation in mixtures of variable length dynamic Bayesian networks

18.4 Application to MDPs

18.5 Application to POMDPs

18.6 Conclusion

18.A Appendix: Remarks

18.B Appendix: Pruning computations

Bibliography

Contributors

Index

The users who browse this book also browse