This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time M

Devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes, the text is mainly confined to MCPs with

This book is concerned with a class of discrete-time stochastic control processes known as controlled Markov processes (CMP's), also known as Markov decision pr

This will be the most up-to-date book in the area (the closest competition was published in 1990) This book takes a new slant and is in discrete rather than con