Other Titles in Applied Mathematics
Hidden Markov Models and Dynamical Systems

3. Variants and Generalizations

Abstract

HMMs are special cases of discrete-time state space models characterized by a state transition probability function and an observation probability function, i.e.,
P(Sn+1|Sn),
3.1a
P(Yn|Sn).
3.1b
In Chapter 2, I described algorithms for fitting and using the probability distributions specified in (3.1) if both the set of possible states S and the set of possible observations Y have an unstructured finite number of discrete values. However, in many applications the measurements, and perhaps the states also, are thought of as being drawn from continuous vector spaces.
Since most experimental observations are measured and recorded digitally, one could argue that discrete approximations are adequate and attempt to use the algorithms of Chapter 2 anyway. That approach is disastrous because it precludes exploiting either the metric or topological properties of the space of measurements. Consider the histogram of the first 600 samples of Tang's laser data in Fig. 3.1. Neither 5 nor 93 occurs, but it seems more plausible that 93 will occur in the remainder of the samples because there are 14 occurrences between 90 and 96 and none between 2 and 8. To make more effective use of measured data, one usually approximates the probabilities by functions with a small number of free parameters. For many such families of parametric models one can use the algorithms of Chapter 2 with minor modifications. For a practitioner, the challenge is to find or develop both a parametric family that closely matches the measured system and algorithms for fitting and using the models.
In this chapter, I will describe some model families with Gaussian observations. I will use the failure of the maximum likelihood approach with such models to motivate and develop regularization. Also, I will touch on the relationships between HMM model families and other kinds of models.

Get full access to this article

View all available purchase options and get full access to this chapter.

Information & Authors

Information

Published In

cover image Other Titles in Applied Mathematics
Hidden Markov Models and Dynamical Systems
Pages: 47 - 57
ISBN (Print): 978-0-89871-665-8
ISBN (Online): 978-0-89871-774-7

History

Published online: 23 March 2012

Keywords

  1. hidden Markov model
  2. HMM
  3. time series
  4. chaos
  5. estimation
  6. statistics

Keywords

  1. 43
  2. 48
  3. 11
  4. 13
  5. 10
  6. 08

Keywords

  1. 519.2'33--dc22

Keywords

    QA274.7.F726 2008Markov processes, Dynamics

Authors

Affiliations

Andrew M. Fraser
Fraser Physics and Los Alamos National Laboratories, Los Alamos, New Mexico

Metrics & Citations

Metrics

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

Cited By

There are no citations for this item

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share with email

Email a colleague

Share on social media

The SIAM Publications Library now uses SIAM Single Sign-On for individuals. If you do not have existing SIAM credentials, create your SIAM account https://my.siam.org.