Probabilistic model checking and Markov decision processes (MDPs) form two interlinked branches of formal analysis for systems operating under uncertainty. These techniques offer a mathematical ...

Journal of the Royal Statistical Society. Series B (Statistical Methodology), Vol. 68, No. 2 (2006), pp. 155-178 (24 pages) For a class of latent Markov models for discrete variables having a ...

The paper proposes a statistical model of a football match that is useful in providing insights into the characteristics of teams. We evaluate the characteristics by means of maximum likelihood ...

If we can ‘talk’ to AI programs today, it’s in part because of a Russian from the 1800s. Markov’s approach to data in flux changed how we navigate our world. There’s an odd little trick to how AI ...

This paper proposes a hidden state Markov model (HMM) that incorporates workers’ unobserved labor market attachment into the analysis of labor market dynamics. Unlike previous literature, which ...

With the development of satellite networks, space-air-ground integrated networks, and the Internet of Things, the future giant constellations, high-resolution earth observation, human-crewed ...