A direct method based on oblique projections is adapted to compute the stationary distribution vector of a finite Markov chain. The algorithm can also be used to compute the group inverse of the corresponding generator matrix. It is shown how to update the stationary vector and other quantities of interest when one row of the transition probability matrix is modified. A GTH-like variant that appears to compute the stationary probabilities to high relative accuracy is developed. © 2004 Elsevier Inc. All rights reserved.

A direct projection method for Markov chains

Benzi, Michele
2004

Abstract

A direct method based on oblique projections is adapted to compute the stationary distribution vector of a finite Markov chain. The algorithm can also be used to compute the group inverse of the corresponding generator matrix. It is shown how to update the stationary vector and other quantities of interest when one row of the transition probability matrix is modified. A GTH-like variant that appears to compute the stationary probabilities to high relative accuracy is developed. © 2004 Elsevier Inc. All rights reserved.
2004
Direct solution method; Finite Markov chains; Gaussian elimination; Generalized inverses; GTH algorithm; Nearly uncoupled chains; Projections; Purcell's method; Rank-one updates; Stationary vector; Algebra and Number Theory; Numerical Analysis
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11384/75265
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 11
  • ???jsp.display-item.citation.isi??? 11
social impact