Download as pdf or txt
Download as pdf or txt
You are on page 1of 4

.

. .
, ( ),
, ,
- .
, ,
.
.
, ,
.
.
,
. , .

- .
(features) (region of
interest), ,
, , -, / ,
.

-
.

, RPROP SARPROP.

RPROP. Resilient error backpropagation - , 1992
( 1994) [1, 2]. (
),
. ,
:
i j (t-1)* + , E/w i j (t-1)*E/w i j (t) > 0,
i j (t) = i j (t-1)* - , E/w i j (t-1)*E/w i j (t) < 0,
i j (t-1),
0 < < 1 < +.
RPROP :
1) ,

a)
i) E/wm,n,nit * E/wm,n,nit-1 > 0
w m , n , n i = min( + * w m , n , n i , m a x )
w m , n , n i = -SGN( E/w m , n , n i ) * w m , n , n i
w m , n , n i = w m , n , n i + w m , n , n i
E/w m , n , n i t - 1 = E/w m , n , n i t
ii) E/wm,n,nit * E/wm,n,nit-1 < 0
w m , n , n i = max( - * w m , n , n i , m i n )
E/w m , n , n i t - 1 = 0
iii) E/wm,n,nit * E/wm,n,nit-1 = 0
w m , n , n i = -SGN( E/w m , n , n i ) * w m , n , n i
w m , n , n i = w m , n , n i + w m , n , n i
E/w m , n , n i t - 1 = E/w m , n , n i t
iv)
, ,
, ,
, .
max .
min .
+ .
- .

:
m a x = 50
m i n = 10 - 6
+ = 1,2
- = 0,5
RPROP , ,

.
SARPROP [3, 4].
Simulated Annealing ( ) RPROP -
RPROP, 1998 , ,
.
,
.
,
.
:
- ;
-
(RMS).

,
.

.

. ,
.
RPROP - (weights decay),
.
, .

E/w i j S A R P R O P = E/w i j - k 1 * w i j * 2 - T * e p o c h
,
. ,
, ( ).
SARPROP:

E/w i j (t-1)*E/w i j (t) > 0
i j (t) = min( i j (t-1)* + , m a x )
w i j (t) = w i j (t) + w i j (t)
E/w i j (t-1) = E/w i j (t)
E/w i j (t-1)*E/w i j (t) < 0
i j (t-1) < k 2 *error 2
i j (t) = i j (t-1)* - + k 3 *r*error*2 - T * e p o c h

i j (t) = i j (t-1)* i j (t) = max( i j (t-1)* - , m i n )


E/w i j (t-1) = 0

w i j (t) = - sign( E/w i j (t) ) * i j (t)


w i j (t+1) = w i j (t) + w i j (t)
E/w i j (t-1) = E/w i j (t)
error - , - , k1, k2, k3 , r - [0; 1].
,
SARPROP
[3]:
- k1 = 0.01
- k2 = 0.1
- k3 = 3
- T [0.01; 0.07].

,

, ,
.
SARPROP
RPROP.
.
1. Martin Riedmiller, RPROP - A fast adaptive learning algorithm. - Karlsruhe, 1992, 12 c.
2. Martin Riedmiller, RPROP - Description and implementation details. - Karlsruhe, 1994,
16 c.
3. N.K. Treadgold, T.D. Gedeon, THE SARPROP ALGORITHM: A SIMULATED
ANNEALING ENHANCEMENT TO RESILIENT BACK PROPAGATION. - Sydney,
1998, 7 c.
4. P. A. Castilo, SA-Prop: Optimization of multilayer perceptron parameters using simulated
annealing. - Granada, 1998, 10 c.

You might also like