ON THE MAXIMUM PROBABILITY CRITERIA
CONCERNING THE SEQUENCIAL DECISION - MAKING
PROBLEM
by
Ilie Mitran
Abstract. This paper presents, originally,some results about an important criterion used in the theory of the decisions. Here are treated the partial and the total co-operative cases and, finally, will be presented an application for a market competitional problem who will finish with a ruining problem.
INTRODUCTION
A problem of sequencial decision is described by the ensemble ([1],[3]):
∈ ∈ ∈ ∈ ∈
= X X X− M u i M D i M n N x X f n N
S i ix n n
n, , , , ,
, , , , , , 0
Where the significance of the elements is as follows:
1) The set
X
represents the space of the positions and is a topological linear space (real) and BX is theσ
−algebra generated generated by the topology of thespace
X
.To be measurable space
(
X,BX)
,the set µ( )
BX of all measures of probabilitydefined in BX is associated. The measure of probability PX ∈µ
( )
BX is associated which each state x∈X .2)
−
X
X0, represents the set of initial states and final states respectively and they
are supposed to be compact sets in X
3) The set M =
{
1,2,...,m}
represents the set of deciders taking part in the decision-making process and i X →R−
:
µ represents the utility function of the deciders i∈M (
u
i is supposed to be continuous)The set
∈ ≥
= − − −
−
i i
i x X u x a
X : ( ) is called the target set of the decider M
i∈ .
4) The evolution of the decision-making process is described with the help of the recurrence relations:
(
x d)
x X n N fxn+1= n n, n , 0∈ 0,∀ ∈
where
( )
∏
( )
=
=
∈ n
i
n i n
n D x D x
d
1
and
( )
n ix
D represents the set of the decision that can be made in the state xn∈X by the decider i M D
( )
xi
(
∈ is supposed to be a topological linear space x∈X,i∈M).
The application f fn :XxDX → X,n∈N are called transition functions and
they are supposed to be continuous and bounded (
U
( )
X x
X D x
D
∈
= ).
If xn ∈X− , then fn
(
xn,dn)
=xn,∀dn∈D( )
xn .. When there is no risk of confusion Di( )
xn is written as Dni and D( )
xn as Dn.The notion of inferior semi-continuity(i.s.c.), higher semi-continuity(h.s.c.) and continuity in the Haussdorf sense, both for the univocal and multivocal application will be the basic elements in the proves of some theorems.
2. THE EXISTENCE OF THE GUARANTEED OPTIMAL STRATEGIES
We shall put ourself in the position of decider in the case of the problem of sequencial decision described in introduction. Two situations will be analyzed:
a) the partial co-operative case; b) the total co-operative case;
The purpose of this paragraph is to specify the margins of the interval within which the maximum profit of deciders1 lies, as well as the strategies(simple or mixed) throught which these margins are reached.
If the decision-making process has evolved to the state xn∈X \X− , the
adoption by decider 1 of the criterion of maximum probability implies the adoption of the problem([3]):
( )
≥
≥
∈
∈ − − − −
−
p a x u X x P
R p
P i i
d d x f d
n
n n n n n
: :
sup
: ~
∏
=∈
=
m j j n n n nn
d
d
D
x
D
d
2 1 ~ 1 1,
As decider 1 will decide first and deciders j∈M \
{}
1 adopt,simultaneously, the following notations will be considerated:∏
= == m
j j n
n D D D
D 2 2 1 1 ,
The following functionals are introduced:
(
1 2)
( , , ) 1 1(
1 2)
1 2 21 , , : , ,
:
2
1 x X u x a d d DxD
P d d F R xD D
Fn n fn xnd d ∈
≥ ∈ = → − − −
(
)
( )(
1 2)
1 2 * * , , 2 1 2 1 , , ) ( : ) ( : , , : 2 1 xD D d d a x u X x P a x u X x P d d g R xD D g Mi i M
i i
x
M
i i M
i i d d x f n n n n n ∈ ≥ ∈ − − ≥ ∈ = →
∑
∑
∑
∑
∈ ∈ − − − ∈ ∈ − − −and the multivocal application:
( ) ( )
,{
,(
,)
0}
:D1 →P D2 B d1 = d2∈D2 g d1 d2 ≥
Bn n n
For greater convenience we shall write
F
,
g
,
B
insteadof
(
)(
)
2 1 , , ,
, ,
, n n 1 D 2 D
n g B D d D d
F are assumed to be compact spaces.
The following hipothesis are made:
1) the forming of a coalition in the sense of maximum probability is allowed; 2) if the first decider has adopted the strategy d1∈D1, the other decider will adopt only strategies from B
( )
d1 .Remark 2.1 Hypothesis 2 is based on the following argument:if the choice of the pair of the strategies
(
d1,d2)
∈D1xB( )
d1 increases in the statex
n+1 the value:( ) { } { } ≥ ∈
∑
∑
∈ ∈ − − − 1 \ 1 \ ,,1 2 : ( )
M j j M j j d d x
f x X u x a
P
n n
then this choice will suit deciders j∈M \
{}
1 ; if in the statex
n+1the value:( ) { } { } ≥ ∈
∑
∑
∈ ∈ − − − 1 \ 1 \ ,, 1 2 : ( )
M j j M j j d d x
f x X u x a
P
n n
doesn’t increase (as against the value:
{ } { } ≥ ∈
∑
∑
∈ ∈ − − − 1\ \1
) ( :
M
j j M
j j
x x X u x a
P
n ), but
(
d1,d2)
≥0{}
1 \M
j∈ will be favored again. In his turn, decider 1 will be favored as he has the possibility of improving his control over deciders j∈M \
{}
1 .Having introduced these notations, we can formulate problem (P1n) in the
following way:
( )
1 :n
P determine
( )
1 2* 2 * 1 *
,d DxD d
d = ∈ which verifies the equality:
( )
( )(
1 2)
, * 2 *
1, sup , 2 1 2 1
d d F d
d F
xD D d
d ∈
= .
The solving of the problem
( )
P1n represents however the ideal case for decider 1 as in concrete situations it hardly ever happens for all the deciders of the set M to have the same target set (in other words, all the deciders of the set M have the same target).As for any d2∈D2 −
the following inequalities occur:
( )
(
1, 2)
sup 1, 2 sup sup( )(
1, 2)
inf sup
1 2 1 1 1
1 1
2 1 1
d d F d
d F d
d F
d B d D d D
d d
B d D
d ∈ ∈
− ∈
∈
∈ ≤
≤ .
The following functionals will be introduced naturally
( )
( )
(
1 2)
11 1
1: , sup , 1 2
d d F d
f R D f
d B d∈
= →
( )
1 ( )(
1 2)
2 1
2: , inf , 1 2
d d F d
f R D f
d B d∈
=
→ .
Theorem 2.1. The following results occur:
1) If
F
is h.s.c.,g
is continuous( as an univocal application in the topology generated by2 1xD
D
d
), B( )
d1 is closed in the metric space( )
D2 ,d , d1 D1P ∀ ∈
−
(
−
d
is the Haussdorf metric drawn with the help of the 2D
d
metric) and
B
is closed( as a multivocal application), then there isd
1*∈
D
1 so the following equality takes place:( )
( )(
1 2)
* 1
1 max max , 1 2 1 1
d d F d
f
d B d D
d∈ ∈
= ;
2) If
F
is h.s.c.( as an univocal application in the topology generated by2 1xD
D
d
),B
is continuous( as a multivocal application in the topology generated by the Hauswsdorf metric d drawn with the help of2
D
d
metric), then there isd
1**∈
D
1 so the following equality occurs:( )
( )(
1 2)
* * 1
2 max inf , 1 2 1 1
d d F d
f
d B d D
d∈ ∈
Proof
1)We first prove that if g is continuous, then
B
is h.s.c.(as a multivocal application). Let us consider:( )
( ) ( )
2* 2 ` 1 2
1 * 1 1 1
, ,
,d d d Bd d d
D d
n n n n
n n n
n ⊂ → ∈ → .
Because g is continuous, we obtain that g
(
d*1,d*2)
= lim(
1n, n2)
n g d d ., As
(
,
)
0
2 1
≥
n
n
d
d
g
,N n∈
∀ , it means that g
( )
d1n,dn2 ≥0, therefore( )
1 2* B d
d ∈ and consequentely
B
is h.s.c..If d1
( )
D1 d*1n
→
∈ , from the fact that F is h.s.c. and B
( )
d1 is closed ∀n∈N, it follows that there isd
n2∈
B
( )
d
n1 so that the following conditions occur:( )
( )
( )
( )
( ) (
1 2)
2 1 2
1 1
1 sup , max1 , , 2
1 2
n n n
d B d n
d B d
n F d d F d d F d d
d f
n n
= =
=
∈
∈ .
From the fact that
B
is h.s.c. it follows that there is d*2∈B( )
d*1 so that *2 lim n2n d
d = .
As
F
is h.s.c. we shall have:( )
(
) ( )
( )( ) ( )
1* 1 2 1 * 2
* 1 * 2
1 1
1 lim , , max ,
lim
1 2
d f d d F d
d F d d F d
f
d B d n
n n n
n = ≤ ≤ ∈ =
− −
From limf1
( ) ( )
d1n f1 d*1n ≤ it follows that f1 is h.s.c.; as D1 is compact it means that
there is d*1∈D1 so that the below equality is verified:
( )
( )(
1 2)
1
* max max , 1 2 ` 1 1
d d F d
f
d B d D
d∈ ∈
= .
2).In order to demonstrate the existence of
d
1** it is sufficient to prove that f2is h.s.c.;let us consider any d10∈D1. Also, let us consider any sufficiently small 0
>
ε
. As( )
( )
(
2)
0 1 01
2 inf 0 , 1 2
d d F d
f
d B d∈
=
there is d20∈B
( )
d10 so that F(
d10,d20) ( )
≤ f2 d10 +ε.F
beeing h.s.c. for the closenε
there will beδ
so that:(
)
≥(
)
−ε ∀(
)
∈(
(
)
(
0)
)
<ε2 0 1 2 1 2
1 2 1 2
1 0
2 0
1,d F d ,d 2, d ,d D xD ,d 1 2 d ,d , d ,d
d
F DxD .
As
B
is continuous, there is γ >0 so that d(
B( ) ( )
d1 ,B d2)
≤δ . Let us consider( )
( )
{
1 1: 1, 10 minδ,γ}
1 0
1 = d ∈D d d d ≤
Vd D .
For any 0
1 1 Vd
d ∈ , there is a d2∈B
( )
d10 with dD2(
d2,d20)
≤δ . Henceforth, for any 01 1
V
d( )
(
,)
(
,)
2( )
22 1 2 2 1
0 2 0 1 0
1
2 d +ε ≥F d d ≥F d d −ε ≥ f d −ε
f
and so
( )
( )
1 1 1
2 0 1
2 d f d , d Vd
f ≥ −ε ∀ ∈ . This means that f2 is h.s.c. and so there is
1 * * 1 D
d ∈ so that the following equalities occur:
( )
( )(
1 2)
* * 1
2
max
inf
,
1 2 1 1d
d
F
d
f
d B d D
d∈ ∈
=
.Remark 2.2 Theorem 2.1 specifies the existence of the strategies where the boarders of the interval in which decider 1 will obtain his maximum profit can be reached( and which is the maximum of the probability of realization of the target set in the state
1 +
n
x
).Theorem 2.2 If
B
is h.s.c. and closed(as a multivocal application),F
is h.s.c.( as an univocal application) and B( )
d is compact for every d∈d1, then there is d*∈D1 sothat the following equality occurs:
( )
* ( )(
1 2)
1 max max , 1 2 1 1
d d F d
f
d B d D
d∈ ∈
=
Proof In order to prove the existence of
d
* having the required property it is sufficient to show thatf
is h.s.c. Let us consider( )
*11 1 1
lim
, d d
D
d n
n n
n ⊂ = . From the
fact that
F
is h.s.c. and B( )
D is compact, it follows that there is dn0∈B( )
dn1 so that:( )
1( )
(
1 2)
( )
(
1 2) (
1 0)
1 sup , 2max1 , ,1
2 Bd n n d BD n n n n
d
n F d d F d d F d d
d f
N n n
n
= =
=
∈
∈ (1)
From the fact that
B
is h.s.c. (as multivocal application) we obtain that there is( )
1 2* Bdn
d ∈ so that *2 lim n0
n d
d = . Because B is also closed( as a multivocal application), we get that
( )
*12 * Bd
d ∈ .
F
is h.s.c. so:(
) (
)
( )
( ) ( )
1* 1 2 1 * 2
* 1 * 0
1
, max ,
, lim
1 * 2
d f d d F d
d F d d F
d B d n
n
n ≤ ≤ ∈ =
−
(2)
which means that f1 is h.s.c. and consequently there is d*∈D1 so that the below equalities occur:
( )
* ( )(
1 2)
1 max max , 1 2 1 1
d d F d
f
d B d D
d∈ ∈
= (3)
Corollary 1 If
F
is continuous,B
is continuous and B( )
D is compact,1
D d∈
∀ , then there are d1*,d*2* so that for every d−2∈B
( )
d1 we have:( )
( )(
)
( )(
)
( )
*1 1 2 1 2
1 2
1 *
* 1
2 max min , max , max max , 1 2 1 1 1
1 1
2 1 1
d f d d F d
d F d
d F d
f
d B d D d D
d d
B d D
d ≤ =
≤
= ∈ ∈ ∈ − ∈ ∈
There are the following two cases:
a) The partial co-operative case. It corresponds with the situation when
( )
* 1 1 1f
d
p
n>
. In this case the decider 1 must give up the coalition idea (because in the next stagex
n+1 is led through an inferior gain to the gainp
1n according to thex
n stage).Remark 2.4 The term ”partial co-operative” comes from the fact that the deciders of the set M \
{}
1 can form a coalition in this case( forming the total coalition or distinct coalitions), even though the decider 1 might not belong to any coalition.The decider 1 has the following alternatives:
i) The deciders of the set M \
{}
1 adopt a prudent strategic behavior( whichmeans that they adopt maxmin or minmax strategies). In this case, according to ”the equalization criterion” [4], the decider 1 owns a strategy~ 1
n
d
which, if he adopts it, he will obtain p1n+1> p1n( that means that the maximum probability criterion is equivalent with the equalization criterion).ii) The decider 1 has no information regarding to the strategic behaviorof the other deciders. In this case, if the following conditions are fulfilled:
a) the target sets Xj j∈M
−
, , realize un unfolding of X− ; b) the strategy sets D1nare compact sets in R n N
k ∀ ∈
, ;
c) application
F
is continuous in both arguments and convex in the second, there is a finite subset D1n ⊂D1−
so that a necessary condition for solving the problem
( )
P1n is the solving of the following problem:(
n n)
n n
d n n d n D d n
I H
P 1 , 1
~
1 :max∈ + + +
where
∑
=+ =−
n
i
d j n d
j n d
nn P n P n
H
1
, ,
represents the undeterminancy( Shannon entropy) provided the choice of the strategy:
( )
∏
= − − −− −
=
∈ ≥
=
∈ n
j
d j n j j
d x f j n n
n
n D D x D Pn n n x X u x a P n
d
2
, ,
1 , : ( )
∑
= + ++ =
n
j
j n d
j n d
j n d
n n
P P P
I
n n
n
1
, 1 ,
1 1
, ln
represents the mean information profit( in the Renyi sense) obtained through passing on form the state
x
n to the statex
n+1 as a result of the adoption of the strategyn
d
.Remark 2.5 Let us consider
d
n* the solution of(
)
~ 1
n
P
. Not alwaysP
ndnp
n 1 1 ,*
>
. In [3] is proved that if the inequality:( )
n nn d
n n d
n I p p p
H n n
1 1
1 1 ,
1 ln ln1 *
*
− − −
≥ + + +
holds, then
P
ndp
nn 1 1 ,
*
>
( which means that the reached probability in the statex
n+1 ofthe target set
− 1
X
is greater than the reached probability of the target set− 1
X
by the decider 1).b). The total co-operative case. It corresponds with the situation when
<
n
p1
( )
* 1 1 d
f .Therefore, forming a coalition and adopting the strategy d1*, at the state
1 +
n
x the decider 1 increases his own reached probability of the fixed target set
− 1
X (that is Pnd,1n p1n *
≥ ).
It appears the natural problem of finding what are the conditions for the decider 1 to obtain lim 1n =1.
n p That is, if the decider 1 forms a coalition with the
other deciders and it is formed the total coalition, which are the conditions for this coalition to reach the target set at the end of the decisional process. In order to do this, we first introduce some important notations and notions.
The sequence of multivocal applications
( )
B
n n is defined through reccurence. The sequence is defined as follows:( ) ( )
1 0{
1 1 0(
0 0)
0 0}
0
1:X P X ,B x x X :x f x ,d ,d D
B → = ∈ = ∈
( ) ( )
0{
1(
1 1)
1 1 1 1( )
0}
0 , : , , ,
:X P X B x x X x f x d d D x B x
Bn → n = n∈ n = n− n− n− n− ∈ n− n− ∈ n− ,
1
>
n .
The set Bn
( )
x0 represents the set of the states which can be reached in n(
)
( )
( )
∈ ≥
=
→ x∈B x − − m − m n
n
a x u X x P
x x F R X X x X F
n : ( )
, , \
:
0 0
0 0
( )
x ( )F( )
x x n N RR X
R n
x B x n
n
n
∈ =
→
∈sup , ,
,
: 0 0 0
0
(we wrote
∑
∑
∈
∈ =
=
M i
i M
M i
i
M u a a
u , ). We denote:
( )
U
( )
n
k k n
x B x
T
1 0
0 ,
=
=
( )
U
∞( )
= ∀ ∈
=
1
0 0 0
0 ,
n n
X x x T x
T . The sets T
( ) ( )
x0 ,T x0n
represent the sets of trajectories of n duration that start from
x
0 and the sets of trajectories that startfrom
x
0, respectively.The transition functions
f
nare supposed to be Lipschitzian with the sameLipschitz constant
M
0,
∀
n
∈
N
.We further on attempt to prove that the problem of sequencial decision under consideration there are convergent trajectories and optimum trajectories.Theorem 2.3 We have the next results:
1) If for every n∈N,Fn is h.s.c., then there are n
( )
n nx B
x *,0
*,
0 ∈ so that:
(
x x)
( )F( )
x xF n
x B x X x n n n
n
, max
max
, 0
* *, 0
0 0 0∈ ∈
= .
2) If Fn is h.s.c. and x n =x0,∀n∈N
*,
0 (i.e. all of the optimum trajectories
start from the same end), then all of the optimum trajectories converge towards
−
M
X .
3) Let us take
( )
xnm n,m ⊂T( )
x0 ,x0m =x0,x0 fixed. There is always( ) ( )
nm m n k n mn x
x k
,
, ⊂ and
( )
xn n ∈T( )
x0 so that lim − =0.X n m n
k x x
k
Remark 2.6 1) From the teorem 2.3 it results that for any n∈N there is
( )
n n n nx B x X
x *,0
* 0 *,
0 ∈ , ∈ so that whatever the trajectories from
( )
n n
x
T *,0 of ends *
*, 0 , n
n
x
x , maximum profit is guaranteed in the end x*n.
2)The conditions in which the existence of the optimum trajectories has been demonstrated, in the case of the finite horizon and infinite horizon (theorem 2.3 and 2.4), are very hard. If these conditions are loosen , it is only the existence of convergent trajectories that can be demonstrated ( without securing their conditions of optimality) on the basis of the following theorem:
1) there is a trajectory which converges in the target set
−
M
X
;2) there is a sequence of trajectories which converge at this trajectory.
3. APPLICATION IN A RUINING PROBLEM
Below it will be given an market competitional problem which leads at the end to a ruin problem
Let us consider a sequencial decision problem in which the deciders are formed a coalition in two coalition C1,C2 having the final state sets
− −
2 1,X
X which
form a partition for X− :X− = X−1∪X−2,X−1∩X−2 =Φ
We also consider the model of the following market phenomen:in their struggle for supremacy in taking hold of a certain commodity market, the deciders from C1, intending to eliminate the deciders from C2which control the market, want in a first stage to take hold of at least one strategic point of the existing k in this market. Having one penetrated the commodity market, the deciders in C1 will try the
complete elimination of the deciders in C2 by ruining them.
We interpret the decision process of first stage as a game made up of k-simultaneous periods. We assume that in this stage the capitals of the two coalitions from
A
andB
, each banking unit of a decider from C2can ruin mjmonetary units ofthe
A
capital in the game j, j=1,...,k.Let D1j,D2j be the set of the strategies of C1and C2 respectively, in the
game
j
,
j
=
1
,...,
k
for any(
)
C
k(
)
C
j
k
j j k
j k
D d
d d d D d
d d d
1 1
2 2
2 2 1 2 2 1 1
2 1 1 1
1 , ,..., , , ,...,
= = ∈ =
∈
= . We shall have
∑
= =∑
= ==
≥ k
j
k
j j j
j j
B d A d k j
d d
1 1
2 1
2
1, 0, 1,..., , , .
We introduce the utility function
C
k
j
j j
R xD D u
1
2
1 ,
:
= →
(
)
∑
(
)
= −
= k
j
j j j k
k
d d m d
d d d d d u
1
1 2 2
2 2 1 2 1 2 1 1
Let us calculate the guaranteed optimum strategy for C2(maxmin strategy) as well as the maxmin value of the noncooperative game between C1 and C2. We will use the
result ([3]):
(
)
∑
(
)
∑
= = = − = −
−
= k
i
i i d d i i i d
d k
i
i i i d
d md d md d md A
V
1
2 1
2 1
1 2 1
1 2 1
2 1
2
min max min
max 0
, min
min max
By introducing the partial utility function : 1 ,
~
R D
ui i → ui
( )
d2i =mid2i −A~
we shall have
( )
0( )
0~ 1 ~
u A
ui =− = and hence it results (from equalization principle)
that among the optimum strategy will be strategies of the form
(
2,0,...,0)
j
d so that
( )
j j du
V 2
~
1 = (where
j
is determinated from the condition: m d A(
md A)
i i k i j
j − = −
≤
≤ 2
1
2 min .
It will results directly that the guaranteed optimum (simple) strategy for C2 will be:
∑
== k
i j
j j
m m
B d
1 2
1 ,
the maximum value beeing:
− =
∑
= 1 ,0min
1
1 k
i i
A m
B
V .
For the determining of the guaranteed optimum for C1(minmax strategy) as well as og the minmax value we shall first observe that the uefficiency function is concave in
(
k)
d d d
d2 = 21, 22,..., 2 and so the V1 maxmin value for C2 will be equal to the value V of the game ([3],[4]):V =V1. The minmax value is:
(
)
{
min ,0}
min
1
2 m B A
V
i
k
i −
= ≤≤ .
The minmax (mixed) strategy will be:
k j
m m
d k
i i
j j
,..., 1 , 1 1
1
1 = =
∑
=as for any
∏
=
∈ k
i i
D d
1 2
(
)
∑
∑
∑
∑
∑
=
= =
= =
=
− =
− ≥
−
k
i
k
j j
k
i k
j j
i i i i
i k
j j
i
m B A
m m
d m A d
m A
m m
1
1 1
1 2 2
1
0 , 1 max
1 max
0 , max
1 1
1
1
0 , 1
min V
A m
B
k
j j
=
− =
∑
=Remark 3.1 As a result of the concavity of the u functional in relation to
(
21, 22,..., 2)
,2
k
d d d
d = the value of the game between the two coalitions will be equal to
2
V and consequently a decision-making behavior for C2 which is based on keeping decisions does not favor this coalition. It is very important for C2 to obtain additional informations on the strategic behavior of C1.
Remark 3.2 The optimum solution ofC1 consists in the concentration of the forces in a single game (in the
j
0 game in which the condition{ }
jk j
j m
m
≤ ≤
=
1min
0 is realized), keeping the secret about the game in which it concentrates its forces. If C2has no information on C1, it has to distribute its forces uniformly.
After the first stage, the remaining capital reserves beeing A1,B1 ∈ N, the second stage, the ruining stage proper, takes place as a particular sequencial process:
{ }
a,b,a,b N,a b A1 B1;X0{
A1,B1}
;X{
A1 B1,0} {
0,A1 B1}
X = ∈ + = + = − = + ∪ + .
If xn ∈X,xn =
{ }
a1n,a2n , we will have:(
) (
1)
2 1 1 2 1
1 , , +, + + = n n n n = n n
n f x d d a a
x
where:
(
n n) (
{
n n)
n n} (
n n)
n nxD D d d a
a a a a
a1+1, 2+1 ∈ 1 +1, 2 −1, 1 −1, 2 +1,∀ 1, 2 ∈ 1 2
Remark 3.3 The sequencial process described before consists on a series of null sum games, the loss of the game in the state
x
n by a coalition means its having to concede to the winning colaition a monetary unit aut of the available capital.the state
x
n isp
=
constant, n∈N. It results that( )
n na1 is a homogeneous Markov chain with the state 0,1,2,...,C =A1+B1, and with the passing matrix:
p q p q
p
M = −
− − − − − − −
= , 1
1 0 0 ... 0 0 0 0 ... 0 0 0 0 0 0 ... 0 0 0 0 0 ... 0 0 1
The potential matrix
R
is given by:1 0 0 ... 0 0 0 0 0 ... 0 0 0 0 0 0 ... 0 0 0 0 ... 0 0 − − − − − − − − − = q p p q p I R
the elements r
( )
i, j of this matrix beeing:( ) (
)
(
)
(
)
= > − ≤ − ≠ > − − ≤ − − − − = − − − 2 1 , , , 2 2 1 , , 1 , 1 1 1 1 2 1 , 1 1 1 p i j j C i i j i C j A p i j q p q p q p i j q p q p q p p j i r i j i C i i A j AThe mean duration
D
mof the decision-making process will be:( )
21, 2 1 , 1 1 2 1 , 1 1 1 1 1 1 ≠ = − − − − = =
∑
− = p p B A A q p q p q p p l A r D C B C c l mThe ruining probability of the C1 coalition is given by 1,
C r
= −
≠ −
−
=
2 1 ,
1
2 1 , 1 1
1 1
1
p C A
p
q p q p
P
C B
C r
and the runing probability of the C2 coalition will be: 1
2 1 C
r C
r P
P = −
REFERENCES
[1] Mitran,I. – Co-coperative and partial co-operative decisional models, monographs, AMSE, France, 1990;
[2] Mitran,I. – Optimalite minmax, monographs, AMSE, France, 1992.
[3] Mitran, I.- On the maximum probability, Proceedings of the International Conference on Approximation and Optimization, ICAOR, Cluj-Napoca, vol. II, pp169-178