Editing Markov chain (section)

=== Markov model ===
{{Main|Markov model}}
Markov models are used to model changing systems. There are 4 main types of models, that generalize Markov chains depending on whether every sequential state is observable or not, and whether the system is to be adjusted on the basis of observations made:
{| class="wikitable" style="border-spacing: 2px; border: 1px solid darkgray;"
!
!System state is fully observable
!System state is partially observable
|-
!System is autonomous
|Markov chain
|[[Hidden Markov model]]
|-
!System is controlled
|[[Markov decision process]]
|[[Partially observable Markov decision process]]
|}