Editing Markov decision process (section)

===Partial observability===
{{main|Partially observable Markov decision process}}
The solution above assumes that the state <math>s</math> is known when action is to be taken; otherwise <math>\pi(s)</math> cannot be calculated. When this assumption is not true, the problem is called a partially observable Markov decision process or POMDP.