0

1N

1S

Eq. No.

Ax - alpha= 0

Expected Reward

0
1E

1N
1 (1, 1)
2 (1,3)
3 (2,2)
4 (2,3)
5 (3,1)
6 (3,2)
7 (3,3)
8 (4,1)
9 (4,2)
10 Negative Terminal (2,1)
11 Positive Terminal (1,2)

1N

(1, 1)
(1,3)
(2,2)
(2,3)
(3,1)
(3,2)
(3,3)
(4,1)
(4,2)
Negative Terminal (2,1)
Positive Terminal (1,2)

1S
0.1
0
0
0
0
0
0
0
0
0
-0.1

1S
-0.15

Alpha =

0
2N

** These are the 11 equations which act as constrai

0
2.22044604925031E-016
-2.22044604925031E-016
Note:
-2.91433543964104E-016
1. The results obtained in the
4.16333634234434E-016
2. All Non-zero values of x sho
0
3. On Clicking on any of the ce
0
-2.22044604925031E-016
-6.38378239159465E-017
0
1.38777878078145E-016
1.7864334305 ** This is the Objective Function (Rx) which has to b

A=

R=

0
1W

1E
0.9
0
0
0
0
0
0
0
0
-0.8
-0.1

1E
-0.15

0
0
0
0
0
0
0
1
0
0
0

0.9
0
0
0
0
0
0
0
0
-0.1
-0.8

1W
-0.15

-0.15

0
2S

0 1.109232
2E

2W

0
3N

0
3S

uations which act as constraints in the LP

. The results obtained in the first row of this sheet are using the LP Solver and denote the values of the variable
. All Non-zero values of x show the directions in each and every cell.
. On Clicking on any of the cells in A*x -alpha = 0, we can see the equation used in the formula bar

Function (Rx) which has to be maximized

1W

2N

2S

0.1
0
0
0
0
0
0
0
0
-0.1
0

2N

2S
-0.15

2E

0
0.1
0
0
0
0
0
0
0
0
-0.1

0
0.9
0
-0.8
0
0
0
0
0
0
-0.1

2E
-0.15

Policy According to LP(1, 1)

(1,3)
(2,2)
(2,3)
(3,1)
(3,2)
(3,3)
(4,1)
(4,2)
Negative Terminal (2,1)
Positive Terminal (1,2)

2W
0
0.1
0
-0.1
0
0
0
0
0
0
0

2W
-0.15

No-op
W
E
N
S
N
N
E
N
No-op
No-op

0
0.9
0
-0.1
0
0
0
0
0
0
-0.8

3N
-0.15

-0.15

1.126141
3E

0 1.247886
3W

4N

0
4S

0
4E

0
4W

0
5N

0.31004
5S

the values of the variable 'x'

e formula bar

3N

3S
0
0
1
-0.1
0
0
0
0
0
-0.1
-0.8

3S

3E
0
0
1
-0.1
0
-0.8
0
0
0
-0.1
0

3E
-0.15

3W
0
0
1
-0.8
0
-0.1
0
0
0
0
-0.1

3W
-0.15

4N
0
0
1
0
0
-0.1
0
0
0
-0.8
-0.1

4N
-0.15

4S
0
-0.8
-0.1
0.9
0
0
0
0
0
0
0

4S
-0.15

4E
0
0
-0.1
0.9
0
0
-0.8
0
0
0
0

4E
-0.15

4W
0
-0.1
0
0.2
0
0
-0.1
0
0
0
0

4W
-0.15

0
-0.1
-0.8
1
0
0
-0.1
0
0
0
0

5N
-0.15

-0.15

6.38E-016
5E

0 1.251691
5W

5N

6N

5S
0
0
0
0
0.9
-0.1
0
0
0
-0.8
0

5S

5E
0
0
0
0
0.9
-0.1
0
-0.8
0
0
0

5E
-0.15

7N

6S
0
0
-0.8
0
-0.1
1
-0.1
0
0
0
0

6S
-0.15

0 0.139077
6W

6N
0
0
0
0
0.2
0
0
-0.1
0
-0.1
0

6N
-0.15

0
6E

5W
0
0
0
0
1
-0.8
0
-0.1
0
-0.1
0

5W
-0.15

0
6S

6E
0
0
0
0
-0.1
1
-0.1
0
-0.8
0
0

6E
-0.15

6W
0
0
-0.1
0
0
1
-0.8
0
-0.1
0
0

6W
-0.15

0
7S

0
0
-0.1
0
-0.8
1
0
0
-0.1
0
0

7N
-0.15

-0.15

0
7E

0
7W

7N

7S
0
0
0
-0.8
0
-0.1
0.9
0
0
0
0

7S

9N

8S
0
0
0
0
-0.8
0
0
0.9
-0.1
0
0

8S
-0.15

0 1.367706
8W

8N
0
0
0
-0.1
0
-0.8
0.9
0
0
0
0

8N
-0.15

1.53867
8E

7W
0
0
0
-0.1
0
0
0.1
0
0
0
0

7W
-0.15

0
8S

7E
0
0
0
0
0
-0.1
0.1
0
0
0
0

7E
-0.15

0
8N

8E
0
0
0
0
0
0
0
0.1
-0.1
0
0

8E
-0.15

8W
0
0
0
0
-0.1
0
0
0.9
-0.8
0
0

8W
-0.15

0
9S

0
0
0
0
-0.1
0
0
0.1
0
0
0

9N
-0.15

-0.15

0
9E

0
9W

9N

9S
0
0
0
0
0
-0.8
0
-0.1
0.9
0
0

9S

9E

9W
0
0
0
0
0
-0.1
0
0
0.1
0
0

9W
-0.15

1
term +ve

0
0
0
0
0
0
0
-0.1
0.1
0
0

9E
-0.15

0
term -ve

term -ve
0
0
0
0
0
-0.1
0
-0.8
0.9
0
0

term -ve
-0.15

0
0
0
0
0
0
0
0
0
1
0

term +ve
-3
3

term +ve
0
0
0
0
0
0
0
0
0
0
1

0.1
0
0
0
0
0
0
0
0
0
-0.1

0.9
0
0
0
0
0
0
0
0
-0.8
-0.1

0.9
0
0
0
0
0
0
0
0
-0.1
-0.8

0.1
0
0
0
0
0
0
0
0
-0.1
0

0
0.1
0
0
0
0
0
0
0
0
-0.1

0
0.9
0
-0.8
0
0
0
0
0
0
-0.1

0
0.1
0
-0.1
0
0
0
0
0
0
0

0
0.9
0
-0.1
0
0
0
0
0
0
-0.8

0
0
1
-0.1
0
0
0
0
0
-0.1
-0.8

0
0
1
-0.1
0
-0.8
0
0
0
-0.1
0

0
0
1
-0.8
0
-0.1
0
0
0
0
-0.1

0
0
1
0
0
-0.1
0
0
0
-0.8
-0.1

0
-0.8
-0.1
0.9
0
0
0
0
0
0
0

0
0
-0.1
0.9
0
0
-0.8
0
0
0
0

0
-0.1
0
0.2
0
0
-0.1
0
0
0
0

0
-0.1
-0.8
1
0
0
-0.1
0
0
0
0

0
0
0
0
0.9
-0.1
0
0
0
-0.8
0

0
0
0
0
0.9
-0.1
0
-0.8
0
0
0

0
0
0
0
1
-0.8
0
-0.1
0
-0.1
0

0
0
0
0
0.2
0
0
-0.1
0
-0.1
0

0
0
-0.8
0
-0.1
1
-0.1
0
0
0
0

0
0
0
0
-0.1
1
-0.1
0
-0.8
0
0

0
0
-0.1
0
0
1
-0.8
0
-0.1
0
0

0
0
-0.1
0
-0.8
1
0
0
-0.1
0
0

0
0
0
-0.8
0
-0.1
0.9
0
0
0
0

0
0
0
0
0
-0.1
0.1
0
0
0
0

0
0
0
-0.1
0
0
0.1
0
0
0
0

0
0
0
-0.1
0
-0.8
0.9
0
0
0
0

0
0
0
0
-0.8
0
0
0.9
-0.1
0
0

0
0
0
0
0
0
0
0.1
-0.1
0
0

0
0
0
0
-0.1
0
0
0.9
-0.8
0
0

0
0
0
0
-0.1
0
0
0.1
0
0
0

0
0
0
0
0
-0.8
0
-0.1
0.9
0
0

0
0
0
0
0
0
0
-0.1
0.1
0
0

0
0
0
0
0
-0.1
0
0
0.1
0
0

0
0
0
0
0
-0.1
0
-0.8
0.9
0
0

0
0
0
0
0
0
0
0
0
1
0

0
0
0
0
0
0
0
0
0
0
1