Professional Documents
Culture Documents
Nips01 Discriminativegenerative
Nips01 Discriminativegenerative
!"
#%$ '&(
)
*& &,+-&./
0.(
* & 21 34( 506
79LONQ8;PS:;R/<>TO=US?AVWPYXZ@U[PBD\]CV_E^Va`bVWGX
w"Z\]xzy|V_^{;} =~\/>B;PYJONYZ<>Gv: h} T8 NQi>N
F
H
4
G
K
I
M
J
]
F
T
c XMV_^4PSRd`bnHVeNgPYf'RboG4PShDk_PSFjfi4mMkWFjV hlp2G4RQXMq4VariMs4mMtvnju PSRQo4PYkWPYf c XMVW^PSRd`njVWNgPSfRQo4GvPYhkWPYFjf4ivmk_FjVWhlpG4RQXMqvV_rOiZsvmOt4nHu PYRboPSk_PSf
*4OMD
kWG4PKVa`gU[NQGV_UjIKRQJZPSivRQRbPP`bO`bVWVaG`bUSXRbV_ivIKXVWXXZi>Nbi4V_VW^4^PPivnjXZi|fPY4`YPY XM PSRdPi>NQ`VWM^G>PkWPmivU[RQG4XMXV_NQXMRQi4Rbi4f*`]NbNgGfi JMVWZPYVaOPSk_ff
MJMPSRQP[ka3hlPSRQRQPSPYk_VWPSm*hNbNbZi>ivNNNQOMVaPS`bUSRQP,RbV_IKUSi4VWXXi>NbG4V_h^4NbP9PYXU[kai4`QP`VWZNgjPSRdG`OivRQV_`PNbV_i4XZkWU[IKNGRb`PYN4ivV_IKk_PYi|`f`GvhNbGJPSRbP
hlivG4k_4RQIGRbivVWNbXZMUSIPi4M`GNbPM`PNbP[RdNivNQV_PSXMRV_XM`bMP[VaNK`'``gV_NQSPSP9IV_``hlVWRQXG4U[IRQPYi4NQ`bMPYPmG4GXM`PYPRb^>V_Xi>NQVWGZXV_Ud,PMi4V_UdUd
V_kWP`'ivRQXMGV_RbXMXM/PZG4iLO`N'kWG>V_jXPSRbRPYi4J`bPfi>INQPYJMNbGvP[NQOV_UHJPSPSRQRQVWRQIKG4RPYm|Xi]Nd`4PYXMNbPSRdi>i>N'NQVW^PHMUSV_kWk_Pi`bO`bVeV_`QU[PSRQRV_IKIV_i|XZfivi4NbV_k_^4`bGP
ivJMJZRbGi4UdVWNQ`MV_4MPYRdi`fIKJONbG4NbVaU*PSRQRbGRjILZUd9hi4`NbPSR
OM//M
iviv*XXPSXZPSNQNbRdMMi>PPYNbXV_ka^4ivJMP VaPSU[UdkMkaoi4VW`QXMm`bivVeZXZNbPYMRQP`HIk_IKPYivivoGRQPH`XN]NQMik_VWPSoIKV_PSRk_GOf0JMORQkaPSPYivkMGvV_PSU[hkNbV_NQG4MXZ]Pj`D\]gG4V_V_f`QXU[NLZRQV_`JZIV_XMRbV_GXZZivnivNbMi|V_^4f4V_k_PPVeNg`USfk_Rbm>iLM;`bk_`bPYl;Ve`DNbPSMGRd`USmOi4IKG4k_hUSGOLMNQOMkaPSi>Pk;NbPVWNbXZMJMPlLOJNQ `G` m
NbivPYRQRbP V_G4`R;PY^4;PSRdiv kUSHG4OIKV_RbJPPYUkWNQ_kWV_fXMmKGRHRbPk_i4PY`bi4G4RbXZX'`HihlG4ORVWRQLZPY`bU[V_NHXMIivOJ'V_`QU[hlRbRQGV_IIV_XZV_XMivJMNbV_LM^4NQP `HRQivNbNQMGPYNbRjZNbP*Zi4USk_X9i`b`PSXMk_i4PYRQPYivk_Nb`YV_^4DP U[MkaPSi4RQ`P
NbV_`bXZVeZNQP0PSPYRQRQ IKU[`YkamOi4PYG4`QOXZ`VaVWP*i>NQG4UYPi>h;Nb`gNQV_G4PSMXMJVaUd JM`bmZLZRQG4`bUdLZZUYkWPYi4U[IV_`/XZIKUMNQGkWVWfRQMPYPSU[i4k_NbRVWk_NQXMfV_USi4LM;XZkai>lNbP XZMPS^4 PYf'R*`bXZG4i4Ok_JM^4PYXMPPYV_oim IKk_>PYi|G4mO^RQV_P`VWXZNbZPSivi4XMNK`bPYV_RQMbi4G4PkXMU[JMPGRQIG4`bMZJZG4kWPYLOLZINQk_0ivNbi`V_G4`]GXZkWi4^i4X P k
NbVaG4`bGKXZ`bPYLM`YPYP* `Nbi4ZXZivN/OIV_`QivU[NRQNbV_PYIRQ`V_XZ`bivLZNbUdV_^43P i4U[`*kai4Z`Qi4`VWXZZOPSk_RdVWXM`jivRQIKP*Vai4`bkW`bIKVWXZG`NZivi>k_NQjiZi|mfONbZ`PNbGKJZRbPYP*^|JZi4VWRbk_PSV_XMhlPS0RQRbUSPG4XZNb`bGKPSX`PSLZXM`PY`bRQPSivPYNbIV_^4P`
MpNMXZVaGvi`NbZIKZPSiGOR/` OJZVePSNdVWkP` U[VaNbP`MG4G4PYhhG4NbRQJZPYP[XRbNQPYV_^|UYRQi4G4ivVWkDLMk_V_ZXMMiKkW`f3Vahl` G4k_k_VWVWo9XZX PYNQivMVaR`QP'OVWXG4G4INb`MPYV_P0`Rb^>XNbi>ZLMNQivVWIGN/XNbPSZNQRPZGvi>XNh/LMhlhlIRbGPYRPPSR]JZIi4GvivRQhDXi4P[IfOM0ivPSNbIKIPYRQJMGO`k_OPYGvPY`h]k_`YXMmiPSPNQIMOPPYGO0O]PYNQF kzG
GvO hV_aIKSJZSPSi4XZRQ`bi4VWIKGX3P[>NbV_PY`|RQ`RQG4SLZ`bS4PSzMP4mk_fPk_VaVW`XMWm*PkWV_ivXMeR4PYmji4G|RRlVWi>X0m]NNQivIKMXZPG`]NVWN9F`GVaO`'IKV_IKoPXMPSkWG>XZG>`bV_XG4G4XRdNbO vPSi>R*N0 J`QG4ivk_IKfXZJMG4k_PIKUSV_i4G4kIKV_JMXk_P[NQOMVePNgfXLMIlMPSR
XPSk_VWNbPSZhV_``9ivJZRQPjivJNbRQPSLMRP4mHpPJZ`gi4NQLZRQi4OIKfP[PSNbIKRQVaUJMV_hRbi4VaIUSi4V_kWk__ff(Gvi4hXZJMRQG4NbZMi4PYMG4V_RQkWVaP[`gNQNQV_V_UYUivIKk_kWfGOONbPYMk_P`P[l;NbPYMXNUSNbi4G,XMPVaMUdNPYNbVeZNQMPYPS`bPR
NbU[G9GXZG4OJOVWNQNbVWV_IKG4XZV_i4SPkMk_NbVWoMPSP/k_VWgMG4GV_XGON* kW;V_o4PYkWV_MGmGOG4RGvPY^4hDPSNQXMPMNV_XMNbJMGLOIKNd`]V_XMi4VWXZIKV_SNQP/MNbPMkaP/ivuvQPSjka`SNQmRQG4i4R/VWXMMV_XMN/NQGPYRbGRQJOG4RDNbV_GIKOVWNQYi4PVWXMNbZP P
tDUh~?t E <??&t:dhM Mh
Etht&
e _ e <??&twg _ hg tMe 8? g ehg8i hEte ht i it:eh?g ?i g Pth
DlQ 0>jWd|j
d>[t a[SbS>} O: ? ;- "
/[ 0;l
/SS ) P[>vP q4 A
/[U > 3 ;/ l " /[S ) > ? ;- l
lMQ>St dvZP Zx *>} O: ? - " ;D(!= " ;D(!= ) ^ - "F "F ) >
?- l/[,0;J/[S ) [v>Pq A
v /
<> t = Yy|{ B FHGXZ`bV_OPYRNbMPOV_`QU[RQP[NQPUSi4`bP4mMi4XZ0kWPSN O!uhlG4RXMG> P[N ) vtM
hlnj/[Rd i4fUNbNQZVW;GP'XH FHG4 ZhjPSJ/[RQSXMG} `b5G VWNbV_^4 PG4mLMP[i4MXZXZi4ImjJZkWVWPPNb` Zi|JM^VWRbPk_GkZivivN*P'Zk_VWPYk_iVeNgVe`gNQfN MV_iv$XfN*+ k_PY) JiG4G`gNh`VWNb V_l^4.PK iv) X]}m + (ZXMtDV_UdPYP[3OivJV_NbIV_t ^4/JZPtkWV_PS&PYMF) `0+ivIK?[- mJM.Nbk_PYZ `YP m
UdZMi4PYXZRbU[P P zNQZ i>N? - zl )) /[,[;TO G9 lfNQ/[MYP9FHM PSRQXMV_`]G 3i>N/IKG4LZGXZ`gN3ivi4VWXtDmP[hlOG4JRt`b/JtP U[F VW$U+Qm //|TmV_XZNbZUSPP
Nbi>ZNPSIKRQPG`ivN RQP5t
`bxt LZ
Ud0" JMTRbGLMZiv`gZNQVeVWNQk_LOVeNQNbVWV_PXM`S"mMNbV_MX PG>^i4PSXZRdiv k_k) Ud `ivXZOP[USP*XMG4VehNQVWPYGRbXZRQ`YG4F mORHmP f`PYNbP/MP NQZc i>XMNV_NQG4) GXLZG4ivLMRdXZivXNQmMPSV_P`
)
F
)
F
GvNbLZ`VWXMV_XMKNbO,ZPu`bi4Ii4MPMi4`DRbivNLMIKIKPSGX`NN
)iK`Itxi4
kWm F K gx m4+VWNHj`bJLPY
'RNQU[LMPYRQ`DZNbi>ZNQivVWGN0X9+ NQGV_`Nbi4M`P``NQPivJMNbPYRQG4 iv Mi4V_`kWV NbNbk_V_f4PYm`Y`bmMIKivXG9
VaRQi4`PY``bi>i4LMNkeNIG>^hlGG4P `gRNNQ VeMNQ) 3P4tU[z`bG4i|XfMNQM~VWV_XUd LM0) G4VWLZtN`VaVW`XZUY`i4i4Nb`b`wPPi4+0Va`KVaGv`JMqh RQi> G>N) ^4mkWPYPi4i4XZ``b0NjV_IGivRQRQV_Oka4ivPYLMRQR V_kWXMfxLZNb`bF)ZV_[XMivmMN ivNbiMivVaV_FH` X'MK4PYV_Rb^4 XMPG `+NQMP JG4PSLMRbRbPXZNb`ZLMLZ`RQkeNZivi4Nb`bV_G4ZPYX P
ivRQ4LZLZ`YImPYXVWNbNziviXZXLMINbZPPYi4R`QGv`hZLM`QIKivIKJONQJMVWGk_PYX`NQNbZi>i>NN;Va `;" G4XMk_fKuZSWbS[> lSm4Rdi>NbZPSRNQZivXkWV_XMPYi4RYm|V_X
Dm|NbZP
JZ^>ivi4k_RQLMi4PYI`PSVWX0NbPYRQ `HGvh;NbMP g4`HPYVaXM`DPSNbRdPYi>IKNQVW^JOP]NbV_XMUSk_i`bNQ`bGVeUSPSG4RXZUSkWLZM PivNbRQMP]PYRbLZPSXMhlVeG4hlRQGPRbIKNbk_i>f'N U[Mk_G`bP/NQG[NbmMNbPYMVWP]RPSiRQ`RbfGIKRDJOGvhNbG4NbNbZVaPU
4i>hPYNQXMPSPSRRdi>NbNQZVWV_^`KPHIXivivV_X^49 fPnjPSOi|i4fIKPY`JMU[kWkaPi4`S`Qm`bVeVWZIKPYJMRYk_mvfi4VWk_XM`b G U[G4G4XZXkWf^PSKRQ4PYkW`GNbG
VWNQ`DP[Mi`ivfIKIKJMJOk_PYNb`KG4Nbi4VaUjRbP0^|i4RbkW P LZWPjLMG4VWRQhPPYMzNbG M9N i
NbXZU[ZGi4V_XVW`^^4PV_PSXRQnNQ4LMPi|VW`f4NbV_PNbG4G]`XIKiV_`MGV_V_MXZ4PSMOkPYPS RP i`USPfG4IKRQRbV_JOPk_kNQUGvNY`bNb;MVaGUDRPYGvNQRbNQkWRQfPG4NQRPYZ`G4i>NQh i4NMMNbzk_ZV_`bV_`V_IK`bG4JMIKkWV_PPYU[`;G4`bVWNQIKIKZJZi>JMi4Nk_m>PRbPPSUS*^4G4PYNbXZXG]MNQkWVeGMNQVW4G4GVaLMXZ`gNQ`/V_ULZXZRbXZPYi4O4VWPS^RQR*PYPH`Qn`V_Mi|G4f4VaX UdP ``
MzZ 9 mVWN*Ii|fivka`bG9ivJZJMRbGi4UdVWN `bV_4XMVWUSi4XNbk_f99 hi`gNQPSRivhNbPY
R Klk_G4
mRdi>NQMPSR]NbZi4X
K
[mMNQRQi4VWXMV_XMKP[Mi4IJZkWP`S
Nb]PYXMRQ` P U[Gi| Xf^GvPShDPYRQ4UY`ivPYMXZk_G>kU[PV_XMV_IK JMMIkWzV_PYiv`]oNQPY4Z`*i>VeivNNd` JMZJZJMRbRQGPYi4OUdVaVaM`]UNQP^VW0` GPSXZMRQf9`*zk_V_fo4PS Nbk_9 MfRQNbPYG0`bVaM`IG4kaivfOoV_`bXMPM9NbG>ZNbPMV_PXM`QivOIKVaNQ`bZPUSi>RbJZNV_IKRbNQPMVWOXPV_ivU[JZXNbV_i4N G4RQXZhli4LM` IXZiUPS`
NbLZV_`bG4PYX 9 Of' OPS ZXMPY ]V_X'X2PYz^4t4PY[Rb fKP[MPSi4lN IO JZkWP]9 G4XPZV_NQUdM'PU[GvGNQRb RQPYO`bJG4XZivOXZV_XMl 3OOVa `bUSRbV_IKhi4VWkWXZi4G4XXNNbhlMLMP XZU`QivNQVWIKGX P
`bO V_OP G4hYPSjRQGZVa`SmZmO9 VWNbK9ivhivXZV_RQkWfMV_499 JMRQG4VWZk_ki4IMVWivk_VWoNgP*f4mNbhMivPRj`QhlivRQG4IKI P SJMPYRQRbPYGOmVaUNbNQMVWPYGX X O 9 G lRbPY[G>mM^4PSRPSmV_XMi4`ik_G4XM`bIKi4ikW`
JPSRbNb9LM RQZi>NQVWGXG4}h O 9 lmVWk_kMivka`G PLZ`bLZivk_kWfG4XNbMP`QivIKP`VaOPG4hSPYRbGiq` O 9 l
{ =Z<>= ^ t *d ZO KlMR v6! 9 [;D>#^d SW> O ~ *9 J uM\u w
0ZJ >> ](^ ;O 9 l]
Dbu> 0
aSSbS >> } OZE>H>[ lMFS l lM" QvZ .PZ5/[ d|S t J Z[[v.9D>* 9Q:/.e|bl M d|S9 A
"
O ~ Mz 9 !
lr
' ) k_G40
<> t = y{ B MZ4
9 U[G4RQRQPYUNQkWfUSk_i`b`bVePY`Ki RQi4XZMOZG4IKk_ f,9 UdM,GVa`b`PSXLMJMP[MJi4PSIRQJZGkWLMPXZmOMPLO N9f NbMIKPV_`QUdU[Zkai4i4XZ`Q`U[VWPZPNb`ZVWivNYN
"
&%
'$
,+
*)
-
.-
0/
21
+43 4365
9
-
7278
KPY IK IKkWiG0
PYXZx`b+LMRbPGv`hNQNbZZi>GN`bmPGvVeh;NQMV_4 9JMDRbGZMivVa`HZVWVWk_XVeNgfNQLMmRQi4X'kWVWNQIKMP]JMk_JV_PYiv`RdivNbZIKivP[NHNQPSPSRd^`PSRQGvfh;GXMPG4hivRQNbPMP
VeNQ,MV_X
Nb`bPYJRbGIXZO`V_V_XMXNbNbZPSPRQI`LZV_IXHOV_XGO mZi4i4XZ`9VWXGMPS9XZWUSLP*i>NbNbZV_G4ivXNt4OV_`lqVWNb.ZVWXOK lkWGY0
Kx+
Gvhlk_NbG4MP
USG4RQ+RbPS
RQPYPSUNNDNQVWivXMX lZKNb G* PHkWG0RQ
9G4 XMx]+G4[Xm>HivXPHNbPSZOPSi4RQIKP[hlJMG4kWRQP Pl`b;PSPHMNb;ZG4ivXMNk_VWf NVeV_h`; JG9 `b `bV_MivkWPHXZhl G4RDO 9 NQG/3 PjuM USG4
Rb
O`bG NbZivN, VeN,Va`3 J
DGQ`Qu>`V_Mk_P(MNQPZi>JZzN RbGO ZivM 9V_ k_VeNglf G4hNbMVauM`*lm V_`*O PSO iUNQkWf ZummG4ZRV_UdVWh9 Nb MPY RbPShlG4 RQPi4LMXZJO
JPSMRQP9 Go4LMPSXZf MW~` LZMivXZNQVeNgf4q VWXMNbzMP M9 PSG[Rb PYI Va`NQMP Zm]MV_UdILZ`NP`bIKi4kW*MPYX V_`
`bIKR i4 kWOV_X( GRQMPS RhlG4RK NbZ
DP0
G4WLZXZ,NQMNQPGUdZPi4XZXMU[G4PXMzNQNQZRbi>V_^N V_i4Okz /GvlNQP i ZRdivXZV_`KMG4LZIAJMJ^>PYRivRQVaivG4MLMk_XZPKMPY,MG`bf P
GvOhVa`g6NbNQZRbV_PYM`bLOP*NQ9RdVW GivXXOVa`G4I VWXO^>LZi4U[RbPVaivMk_PYf`YmOU[GXZ`VaOPYhivRk_Nbk_`MXMP PhlivGRkW_SG>PYRbVWGXZ;Z; G]9 ivV_XVWXNQLMVeNQVWGXi4GLONNbMP`QUSivk_V_XM
<>P H x x 8
*4 A
} *u ]Zg>> 9 MZ>9S0Z >Z > ,l[ v"0 > Wd z >d2vl]f Mw d|;S db"A4Szd>vZ z tP'Z5lM0S [dv>$ OOzbE[[5>29H[%vZK[
/ O 9 Y
d " ;D(!
j>" ;D( U] O 9 lY *d ^
<
hlkaivPYivNbLZPSLMk`YRQmHmHPYi4`*Nb`MlGPk_G4RHP[XMk_OPY J`Q`Hi4PY`U[hlG4NbNbPYRQZ(IPiv^>k_USivkWk_fk_iLMm`bPi``Gvkaivk_hG4XM PSOki44 `jV_^4IKPl`G`VWYXONHhlG4GhRbV_INbkWMivP]NbGPV_hlG4PYX(iv NbLMi4
RQPYG`jLOivNRQPivMXPbRbJM PYRQkWgPYG4^>JivGXhl`bRdNQVei4NQ VWUGNQNQGXVWGNQXVaM`KP G4PYh/U[ika`Nbi4V_ZkW`QfP`
JMV_XRQG>NQ^4MPP'`bLMfIK`IKZivG>NbV_G4VWXMX3V_XfNbZOivNYm USG4XZlMVeNQVWGiXM` PY9 VWXG4XWLZ`Qi>i|NQfOVWGX(NbZzPtPYm^4PYMXLONNG VW Nb - m ` PYiRQUdPSJMkaG4i4hUSPYNb MPf'NQPSRQIK `d`
ZivXi`/ XMgG|XOHhlXMRQPSiUi>NQVWNbGV_^4X9PG4P[h;ONQJMPPSUINdi>NbZ9 V_i|G4^4X(P*lP[OfJPYXMUG4NdXMi>NQXMVWGPYX0ivNbV_G4^LZVWNgXZf0OPYGvh i| i|fOV_hl^4RbPYGRbI PSXZSPYUSRbPG[mivXIKG4RQPSG>^PSR
^>ivRQivRQG4XV_Ji4NMGV_`bk_XPVWNbV_GG4ORQXOPYR4NQLZGli4YRQi4G4XLMhlLMNbXPSRb PNb`*ZPSNbR'ZVaiv`KNPi4 UOk_NQi4LZRbivP|9k_ k_|f3hiv`bRk_SVWhlRbZGNQiI kW`fkaY`ivPSNbRQRQRQ4G4G PXMP[PSOVWNbRJmPYXZU[MNQivV_i>IK4NQVWPSGk_XfJMm;RQNbG4NbZMivivGNMLMV_4NQkWMVNgP0f4RQZi4ivXZNOMG4PSjRQI PP
ivRQi|Pf`PYG4^4h/PYG4RQOi4kNdivjV_XMi|9 V_fOXM`GvhiOk_GPYRbGV_`b^PVWXZKG4`bLMLX
',U[VaV_`PSX^N]VaiUSG4NbXZZMPVeNQFHVWGMXZPY`hlfG4`bR/MPYPS^XZ`bV_LMXMRQ P VWXMWLivNQk_ZVeNgi>fN ZG4Va`R`bNQIKMP0i4kWRbP`g]NXZGvP h
NbP[ZMV_i4`IOJZVakW`bPUSLZ`b`bV_G4i4X`'mkak_ivP[NKPSLZk`hlGR`bVWZIKPJMFHk_VaU[MVWPSNgf fOV_`IKZPSJM^k_V_USV_VeXMNQP kWf,WLUSivG4k_XZVeNgOfVWNbVWV_IKG4XJMk_GV_PYX`KNbNQZZP9i>NPY^4PSXRYNONQZ i>NKiNQPY` N
/ O 9 , J
9 RQi4XZOG4I
NbNb^>ZivPYi>RQV_`bNi4PNbMM
k_PYPj`RQ i4XZVW `OXMi4G4G4RbI RQPV_XMUS^>G4'ivXZRQNQMV_Mi4VePNQMVWk_GNQPYXZPS`RQivI i4k_kWRbf PVWXV_XZV_^XZOG4OPYk_PY^JJV_PYXMPYXZXZOOPSNQPSMXXNDPN4JMV_lRb^4VV_PYG4PXRd`Vem>hMlNQMG4MkaP[M`dbXZm|h]ivNQMV_`^4PSNbP'XV_k_knVeNdUSi|`;G4f4^>XZPi4M`RbVeVaNQi4ivVW`QXZG`XMUSLZPPYIVa,`JMG4NbKXV_G4^ X
Mm m
PS`Nb^V_PSkWjX0Veh;P9NbXMMGvP " N
IRQLZi4UdXZOGk_Ii4Rb^|PSi4RRbVaNQivZZivkWPX`HKj^PS
RQP*XMzivGvXZN,U[GIKIKi|JMf kWPSPSNbPY^kWPSf'X,V_XZOP9PY`bJIPYXZivOk_kWPYPYXRYNmDmOONbPYZJPPY^|XZi4ORbV_VaXMivXU[GP*XIKNbZi|fP
j`bFHVWG4MXZLMPY`kafOG4`bhMNbPPSZ^ 4P* L`DUSivV_G4XMRdRQivP8RbXWPYNbk_LZivPYi4NbPYkWV_V G4NgXZf`df VWm^ivPYRbXZ`0GJGV_RY`` OVWi>NbNjV_G4 IKX3G4`]Nhl~KGR^
C`FG
[I*P TGZKmVW*hgx/OuZ mO J f 9 Z `bP[FN
NQVWS4XZ } [m!
(MZPS?i4
DRQP` m
uV_XNbMPHGRQ`N9UYi4`bP4mivXZ %9 VWXNQMPV_XZOPYJPYXZOPYXNUSi`P"MV_`NbLZ`4V_^4P`
LNbMiZXMPRQPYG4Ii4LZkWLZXZVa`UdNbVaUhlG`NbRUSRQi4G4`bXMPZV_PSX,[RmlM^MLMVaiVaNUdNb3XMMG4PNbNbMPFHP'MNbXZPYivivRbV_XZN^45G P'VWNni|G4V_f4kWLMjPX`hlZRQi48P `QW`LMLMPYIKZXNQUJOkWNQf3(VWGPSXP9J;Rb^Pt PSivRQk_kWfKfk_MG G4Gka`bM P4`YZm;AjF<XZP
ObPSUYPivmMX3mDMG4V_X,OVaUdNdNbivZV_V_X P`
P[OVWJNbMG4V_XMX9PYX`bG4NbVaIKivk_P/kWf`bI`bIivk_ivkk_V_kDXVWNbfX PSRQ
D^>ivkXU&Nb
DM&P'
USG4m4XVaNb`HV_XLMLMXMG4VWLhlG4`RQIUSi4k_`bfKP4mGVeh LMOXZOP 9 f KZgix`
imONbPSZXZPS`bX'VWNgjfP]Nbi4k_i>`bNYG m
Zi|^P Z K Z[Xi4XfUYi4`bP4m4jP]i4k_`bGZi|^PNbZP/hlGkW_G>VWXZFHG4RQG4k_k_i4RbfNbGZPSG4RQPSIrZ
Z<>~~ } < SlM]d> zvM/t ZQvbS KM> v M>[/lM> ZU &4$t
Z[>[vKw:O[> Zl MS [t
}lM>HS>aH[ ZS u| lSu
> [vKJ $u Z[{ [> Mz MZ 9 U Mv DOe
-
:-
;
<
-
=+
.-
+
.-
>-
?+
-
.-
-
"A4B
CD
E
FG
CH
I+
+
"K
LK
>M
K
.M O
P-?Q"M
&M
N-
8+
P-
-
P-
SM
T-
P-
ZY
LVXW
P-
.M
P-
J+
F+
J$
P-
+
P-
P-
,-
pima (continuous)
adult (continuous)
0.5
0.5
0.45
0.45
0.4
0.35
error
error
error
0.4
0.35
0.35
0.3
0.3
0.3
0.25
0.25
0.25
0
20
40
0.2
0
60
10
20
0.2
0
30
0.3
0.4
0
0
0.2
0.3
0.1
50
100
m
150
0.2
0
0
200
50
100
m
150
0.1
0
200
0.7
0.45
0.6
0.4
0.5
0.35
0
20
40
60
0.35
0.4
0.3
0.3
0.25
0
promoters (discrete)
20
40
60
m
80
100
0.4
0.5
0.4
0.45
60
80
100
100
200
m
300
400
0.4
error
0.3
0.2
0.35
0.2
0.1
20
40
60
80
100
0.1
0
0.3
50
100
150
0.25
0
0.4
0.6
0.3
error
10
15
20
25
0
0
300
0.1
0.2
200
0.2
0.4
0.2
error
0.4
error
0.8
0.3
100
sick (discrete)
0.5
0.1
0
0.5
error
error
0.3
0
0
0.2
0
120
lymphography (discrete)
0.5
40
error
error
error
0.45
0.4
20
adult (discrete)
sonar (continuous)
0.5
0.5
60
error
0.3
error
0.5
error
0.4
0.1
40
ionosphere (continuous)
0.4
0.2
20
50
100
150
0
0
20
40
m
60
80
Q HH:Dd]:+ lk_G40
8
OG9G4NbVWPKXZMNQPSZPYi>NMNQMG4P'kaJMV_RQXPS^NQV_MG4PLZ`UYi4M`bV_P`QU[NbLZ`Qi>`bN/VWGNQXMPV_IKXZJMivkWV_V_^4PYP`njNbZi|ivfNPY`NbMzivPXZJMRbPU[RQGG4XZJOGVW`bNbVeV_NQG4VWXZG`XG4 hH `QNQ/Mi4P0`QFH`LZGIRbGJMkWNbaivV_G4RQXf
Mi4GXZk_M`Ym`V_hlIKG4RKVWkaivivRQXk_ff3hlU[G4G4RXNQ`gMNdivPXN G4LM XZM`bGPYk_G4XMivR^iO`
Va`lkaivRQ4UYPi4PY`bP4XMmMG4LZ4VWNb30NbNbZi>PNIK G4RQP*RQP[PYO`JNbRQtVaUNbKV_^4 P*F
b
Kgx O *F8
bMVa`Hi4k_`bGIKPYi4XZ`DNQZi>NjPSVWNbM9 PY RHG4hNQMPY`bPlNbMP]k_ivNNQPSRHi4k_`bGRQ8P WLMV_RbV_XM (u
Va`i`L
'USVWPYXNUSG4XZOVWNbV_G4X0hlGRNbMPi`fIKJONbG4NbVaU `bi4IJZkWPU[GIKJMkWPSOVeNgfNQGP KkWG
[
M
NbU[VakaUMi4`QP]RQ`bPSRbVeZPPYRb`LMPRH`bkWINQ`b`VWGi|GvXfhivivNQkaMk_`b4P]GGJZRbU[VWRbGNbPYZX^I^4V_PSG4RQLZ4`iP``bIKPYiUGNQRbkWVWG>GPjXWPSLZVWRIKV_UdiJMo`k_k_fffIKNbNQZGJOivNbVWNjG4NQ` NbPYVa^4UMPYPSXKVWRQRbNbMGMPSRYGRmHLMNQ4i4M`bP'fNQIKMPSP]JOXMNQMPYGvV_RQNQ`QivV_U[U/NbRQV_VW^4PSIKRQPRbV_GXZXZRYi>ivNQV_^4VW^P'PnLZk_G4`Si|4mOf4VaiP```
NbnZi|P]f4XP`jLMINbGV_PYXMRjVWNbG4Vahivk_NbkWRdfivV_OXMG'V_XMP[PSNbONbPYi4RYIKmJMMkWLOPN]` hl+G4R/VaO`VaV_`QXZU[USRQRbVWIKPi4V_`bXZPYi>NQmVW^G4PXMP*kWGj4VaG4`gLMNQV_kaU RQP[PSOJRbPYPU[`bNj`bV_G4X9PSXMNbPYG'RQivPYNb^4V_^4PSXPNQXZLZi4ivVWk_^kWf P
US;ivGNQUdNQ0PY`LMNjJ0NQMNbPYG`bmZP ivJMXZRQPYOWVaLMUVWNQNbVWPGXZk_VW`SomPSjk_f'P G>J^4PYPYRRhlNdGivRbo4IKPPYm4NQMP[POJJPSPSRQRbVWhlIKG4RQPSIKXNdi4`HXZGU[P XG4|h;XZMi4ivVW^NQiP `nPSNQi|`Yfm PY`YVWNbU[GXNQVWXM
LMGMLZP`RQVWPYXZ`bJMLMLOkeNdNQ``YGvmhsNbMPVWNb`PP[OOVa`bJUSPSRbRQPSVWNbIKP PYV_XXMNdJM`DLOivNdRQ`SPjmOhl`bRQMG4G>I XNbMVWXKP c VWFHLM RQ P*iUd M V_XMPjP Z XZPYi4RbNbXZVWi>XMNNbRQMPSPJNQGM`bPSVeNQGG4RbRQPSf4NbVaFUSi4k
JMRQPSRQ4PYRQOPYVa`QU`bNQVWVWGGXXZ``i4JRbPSP RbhlG4G4RQIRQXMivPXZG4USLOPN/OVa`bLMRQXMJMG4RQN;V_`bUSVWivXZNQ4Udk_f'LMHJPYkWNQGNQZMi>PYNRbGvPhMi4XZRbi4PVW^iPhlnjPYi|fPYUY`Yi4mY`bZPY`LONV_XNQMV_`;MVaV_`UdGZk_G4`PYRbV_`^NbPYVa U
JMPSXZRQVWG4ILMi4RbV_kWhlf9GRVWXLZ`jJZivNbRbGNbVaGU[ZLM`bkaPSivRQRQ^4k_f9P]`bNbIKMPi4kWPSMJi>PYNdU[i4NbP`bP[Nd`OG4V_XIKV_XZMivV_XZUdUSP + GvhJMkWGRQPY4`bVa`gLMNQIV_U*ivRQMPSk_4fRQPYUS`Qiv`bXZVWGXMX'GvN/VWX0RbNQG>MPk_kai4ivRbRQ4PP
+Ak_VWIKVWNY
/g
DhlRQG4X tji4k_`bGivXZi4kWfYPY kWG4Va`gNQV_UKRQPSRbP`b`bV_G4Xi4XZ3GRbIivkH\/Va`bUSRbV_IKVWXivXNpXZi4kWfO`bV_`hlG4R
U[`bkWGV_X4NbV_NbXk_f9LZG4LZ|`v VWXZ>JMvLOtNQ`dNbV_mHIKivPYXZ`dD(k_PYU[`QG4`X`gU[Ndk_LZi>NQOV_PY`NbVaUSNbi4ZkW_ivfNP<NQ
MPUSVWPYhlGXRbNYIKDPYRMVa`i4Va``V_G4XXMIKk_f,i4i4Rbo`bfPYKIU[JMGNbXGvNQNbV_RdUYi4iv`k_NkWf NQG^4G4PYLZRbf R
RQiPYO`bLMVaivkeNd`SG4mvXZi4i4XZkZU[G>G^>XMivPHRQoVaivPSXZfUSOPHV IPYi>RbNQPYRbXZVW0U[PjzVai4``NQHZi>PNOmvVaRQZiv[Nbm MPYRhlRbNQGZXKivXUSG4i4XZ`Q`b`VaLZOIPSRQV_PYXM NbZP/US iM`PVa`D MPYivRbLZP `Q`bV_i4X MVeNQV_ `
IKU[G>GO^>Oi4RbPSVak_ivPYXZUSi4P`IK ivi4NbLZRQVe`QK`VaVaiv`X0`bVWXMVeNQLMkaiviRhlVWLMhkWH;P/U[G4ZXi|^>^4ivPRQVahlivPYXZHUSPYP]RINQZi>ivNQXRbVWk_VWXZDPYivX0RHNbVWMX Va`
`bNQP[RQNi4NQVWVWXZXZVWZXMmONQMPSMPivPYIK`NbJMV_Ik_PYi>`YmNbP`bG
VWk_NG44V_Va``NbXZVaG'U9`RQLMPSRQJMRbPRQV_`b`b`bP*V_G4NbXZivZN/PSRQP4GRbIp ivk;`bPY\/USVaG4`bXZUSRbV_IKV_IKVWXJivGXRNNdivpXXZNi4OkWfOV`bV_PY`RbPYUYXZivXMU[PXZGvVaN`KkWNbPivi>RQXNIhlLZRbGUd0XhUSi4G4`XZNbPY`bRV_MNbPSZRQi4PYX
G4U[GXZIKkWfJZNbivMRQPV_`bG4`bXJPYVaU[`VaivXMkHG4USNi4^4`bPKPYRbVWfXLZ`ZPShlV_LMUdkjVWNbX3ZPNQMP'l4PY XMMPS RdVaiv` kHNbUSRQi4LM`bk_P4f3m `bVWXZi4LZUSP`Q`NbVaivZXP'0G4TXMLZk_f UdJGiv`bX,`bVWZi`kWPfIKUSG4JOXZNbG4USkWNbLMVaU
V_`bXX,VWGNQXPSU[RQGmZPYXVW`hqNbNbRdV_MXMi4z3`ZNYmgNgij9 ` GvHRbP'PY4`QV_Mi|IKzPYJMRb PYPS9 ^ ZVWGi|^LZmV_`V_G4`k_f4RNbm;ZVa`VeivNG4N/V_Z`kWG`bPSV_4X3RQVa^4`gNbNQPZV_UP' RbXMPY4G4RQXMPY`Qi``V_fG4IKX9JOV_`/NbG4NbNbMVaPUK`USLMi4J`bPKPSRQNbV_G4R/i>Ni4kWNbZG4P'RQVeIKNQMGI`N
JZi4RdRi4NQU[V_NbUSVaLMUSk_i4i4kM RU[kWkaGi44`Q `Va:`gVWdNQV_tUSU*Miv!NbRQV_PS G44XRQPY?iv`QhEk_`b4tVW:GGMXRbVWNbUSZi4IKX9t`G4htNbPSPSXMXdPYtRQi4P kW_fVWtIK&V_tXJMh^4RQ G>G4^4k_^4MPPh'?:`bLMG4J?IK?G4 PXhlGV_DX9RbtIJZ:RQ?Gvi!hU NbRbVaPYU[4P &LMtkahivfRQ:V_NQYxPYi>tUdPNQMVW GXMXZV WMLM:PYVWX `
SM
SM
]^_
a`
Ld
Fe
,e
!e
,Q
ji
lk
hi
on
M h?&fhtg g tjp< g xt5 g * g tMd J g m ?&th iUg g eh te ?t&t gg g e tq g 5th5 g E.n8g e
hMMtC g ,U<A<?& m M&t0:&:?t< g A<hqpDt&E,? e t m &tA< g ?srE: g tt:h i
< 8E ChiM< e g 8A e 8?$~tMd?A8hh i ?&<<~ g xt5 g E.n8 e :wht m &t* e g
t:?e e g u
dM:::?tD }|tM~8? M< ?:DA8 M<A8?t: Etht t:??
~ :C g g Mht Evxtwzhy{ &t g & m :: t08 g g ??eh e ?:eDA<th i e e <::|tehhg *i ?&?th ii m 0?g :
8
t8 & h: ~ 8??&A8 % t: a hC tM&? tUt: ?t:
<t:th e j n &e A i :g g n&wtMe ?:<ADt i g &et e <g : b wM~_ h e &g :xA<t g g g } g g t e
h?&thh<5
?h M?t _ EA8DA b ?th ~ g MMh
i ? :g tM i8g e,g tM
n8<t8M:<?t ie :M?e Mtg hs
n&?th M8 8l n,
:
g
g
e
g
m
X\cXy
,e
%
x`6`
$ F%
F
aFs,}C:0,6PssqL0
t i wwg ln t?h Ct:?: e yo
x
C h:h:M hEth~t t&?? Dt t ?th8x e
t j{
?h: sg s:
g ,6J'<zg 0e.g8i :SJiojq g vx g o yo g 5 g e
}q
e M& i <&
8&?tJ Mh tMUwMh:M? * &:M e 8??:w<A<&
t { ttk&g
t e 5t:L:g
Ci 6s8 yosyzxy:ayz g yog x g
M
o $< e <?
hh:q6''a q!6.PS:'0P
{ e
t {
~
m*g
yo
jhMEt:h<