CHAPTER
I INTRODUCTION
......................................................... 1
1.1
Significance of the Problem........................................ 1
1.2
Research Objective................................................... 5
1.3
Assumptions........................................................... 6
1.4
Scope................................................................ 6
1.5
Expected Usefulness................................................. 7
1.6
Synopsis of Thesis.................................................... 7
II BACKGROUND THEORY
............................................. 9
2.1
Markov Processes..................................................... 9
2.1.1
Discrete-Time Markov Chain............................. 10
2.1.2 Markov Decision Process................................. 11