Professional Documents
Culture Documents
ESO 209: Probability and Statistics 2019-2020-II Semester Assignment No. 7
ESO 209: Probability and Statistics 2019-2020-II Semester Assignment No. 7
ESO 209: Probability and Statistics 2019-2020-II Semester Assignment No. 7
2019-2020-II Semester
Assignment No. 7
1. Let X1 , . . . , Xn be a random sample from a distribution having p.d.f. (or p.m.f.)
f (·|θ), where θ ∈ Θ is unknown, and let the estimand be g(θ). In each of the follow-
ing situations, find the M.M.E. and the M.L.E.. Also verify if they are consistent
estimators of g(θ).
(a) f (x|θ) = θ(1 − θ)x−1 , if x = 1, 2, . . ., and = 0, otherwise; Θ = (0, 1); g(θ) = θ.
(b) X1 ∼ Poisson(θ); Θ = (0, ∞); g(θ) = eθ .
(c) f (x|θ) = θ1 , if x = 1, = 1−θ 1
θ2 −1
, if x = 2, 3, . . . , θ2 , and = 0, otherwise; θ = (θ1 , θ2 );
Θ = {(z1 , z2 ) : 0 < z1 < 1, z2 ∈ {2, 3, . . .}}; g(θ) = (θ1 , θ2 ).
(d) f (x|θ) = K(θ)xθ (1 − x), if 0 ≤ x ≤ 1, and = 0, otherwise; Θ = (−1, ∞);
g(θ) = θ; here K(θ) is the normalizing factor.
(e) X1 ∼ Gamma(α, µ); θ = (α, µ); Θ = (0, ∞) × (0, ∞); g(θ) = (α, µ).
√
(f) f (x|θ) = (σ 2π)−1 x−1 exp(− 2σ1 2 (ln x − µ)2 ), if x > 0, and = 0, otherwise;
θ = (µ, σ); Θ = (−∞, ∞) × (0, ∞); g(θ) = (µ, σ).
(g) X1 ∼ Exp(θ); Θ = (0, ∞); g(θ) = Pθ (X1 ≤ 1).
(h) X1 ∼ Poisson(θ); Θ = (0, ∞); g(θ) = Pθ (X1 + X2 + X3 = 0).
(i) X1 ∼ U (− 2θ , 2θ ); Θ = (0, ∞); g(θ) = (1 + θ)−1 .
µ2
(j) X1 ∼ N (µ, σ 2 ); θ = (µ, σ 2 ); Θ = (−∞, ∞) × (0, ∞); g(θ) = σ2
.
(k) f (x|θ) = σ −1 exp(− x−µ
σ
), if x > µ, and = 0, otherwise; θ = (µ, σ); Θ =
(−∞, ∞) × (0, ∞); g(θ) = (µ, σ).
(l) X1 ∼ U (θ1 , θ2 ); θ = (θ1 , θ2 ); Θ = {(z1 , z2 ) : −∞ < z1 < z2 < ∞}; g(θ) = (θ1 , θ2 ).
2. Suppose a randomly selected sample of size five from the distribution having p.m.f.
given in Problem 1 (a) gives the following data: x1 = 2, x2 = 7, x3 = 6, x4 = 5
and x5 = 9. Based on this data compute the m.l.e. of Pθ (X1 ≥ 4).
3. The lifetimes of a brand of a component are assumed to be exponentially distributed
with mean (in hours) θ, where θ ∈ Θ = (0, ∞) is unknown. Ten of these compo-
nents were independently put in test. The only data recorded were the number of
components that had failed in less than 100 hours versus the number that had not
failed. It was found that three had failed before 100 hours. What is the m.l.e. of θ?
1
4. Let X1 , . . . , Xn be a random sample from a distribution having p.d.f. (or p.m.f.)
f (·|θ), where θ ∈ Θ is an unknown parameter. In each of the following situations,
find the M.L.E. of θ and verify if it is a consistent estimator of θ.
(a) X1 ∼ N (θ, 1), Θ = [0, ∞). (b) X1 ∼ Bin(1, θ), Θ = [ 41 , 34 ].
5. Let X1 , . . . , Xn be a random sample from a distribution having mean µ and finite
variance σ 2 . Show that X and S 2 are unbiased estimators of µ and σ 2 , respectively.
6. Let X1 , . . . , Xn be a random sample from a distribution having p.d.f. (or p.m.f.)
f (x|θ), where θ ∈ Θ is unknown, and let g(θ) be the estimand. In each of the
following situations, find the M.L.E., say δM (X), and the unbiased estimator based
on the M.L.E., say δU (X).
(a) X1 ∼ Exp(θ); Θ = (0, ∞); g(θ) = θr , for some known positive integer r.
(b) n ≥ 2, X1 ∼ N (µ, σ 2 ); θ = (µ, σ 2 ); Θ = (−∞, ∞); g(θ) = µ + σ.
(c) Same as (b) with g(θ) = σµ .
(d) X1 ∼ Poisson(θ); Θ = (0, ∞); g(θ) = eθ .
7. Let X1 , . . . , Xn be a random sample from a distribution having p.d.f. (or p.m.f.)
f (x|θ), where θ ∈ Θ is unknown, and let g(θ) be the estimand. In each of the
following situations, find the M.L.E., say δM (X), and the unbiased estimator based
on the M.L.E., say δU (X). Also compare the m.s.e.s of δM and δU .
(a) f (x|θ) = e−(x−θ) , if x > θ, and = 0, otherwise; Θ = (−∞, ∞); g(θ) = θ.
x−µ
(b) n ≥ 2, f (x|θ) = σ1 e− σ , if x > µ, and = 0, otherwise; θ = (µ, σ); Θ =
(−∞, ∞) × (0, ∞); g(θ) = µ.
(c) Same as (b) with g(θ) = σ.
(d) X1 ∼ Exp(θ); Θ = (0, ∞); g(θ) = θ.
(e) X1 ∼ U (0, θ); Θ = (0, ∞); g(θ) = θr , for some known positive integer r.
(f) X1 ∼ N (θ, 1); Θ = (−∞, ∞); g(θ) = θ2 .
8. Let X1 , X2 be a random sample from a distribution having p.d.f. (or p.m.f.) f (·|θ),
where θ ∈ Θ is unknown, and let the estimand be g(θ). Show that given any unbiased
estimator, say δ(X), which is not permutation symmetric (i.e., Pθ (δ(X1 , X2 ) =
δ(X2 , X1 )) < 1, for some θ ∈ Θ), there exists a permutation symmetric and unbiased
estimator δU (X) which is better than δ(·). Can you extend this result to the case
when we have a random sample consisting of n (≥ 2) observations.
9. Consider a single observation X from a distribution having p.m.f. f (x|θ) = θ, if
x = −1, = (1 − θ)2 θx , if x = 0, 1, 2, . . ., and = 0, otherwise, where θ ∈ Θ = (0, 1) is
an unknown parameter. Determine all unbiased estimators of θ.
2
10. Let X1 , . . . , Xn (n ≥ 2) be a random sample from a distribution having p.d.f.
1 − (x−µ)
(
f (x|θ) = σ
e σ , if x > µ
0, otherwise,
µ, which are based on the M.L.E. and belong to the class D = {δα (X) : δc (X) =
X(1) − cT, c > 0}, find the estimator having the smallest m.s.e., at each parametric
point.
3
\
L t b.\,
(tC-'\
LL*' I t\ o{ I cn
F. u.-v z Lr:u : i. !.'r''- .
!-r.') : \ \ ='^ ' '
1I (: vr
I ,,r 1., 1v rr'-a) gv r "l
r!
'- I i ai oa " ' t
-' ir .}\ r..:/,
\.N{.i.ia'/ f'.*'
>-^,
'r" rrel 't\^i-1fr\4 ' ^,- i
t"u.L' - \ l +l i
h\ Lr.r
v\ lr-or). \.:-L"1S$r'
\t S:L':)' GL*r\ jz
-\-,!\- "
A\Y\\--
q- }-
L
ti.' \-1Y!!:'), -
* i]'/ G--' *:f: L
; u"--
ilfl,-.r tV.,t-9 l
1.ifl'-r :
\'^-,.r., c*- *.
qYi'L
tr *^"ca
\.\* x- ]+J
\ '*T <*\Jv
1-
t.
td\ K\U \"- \\- r\ t \.r :. ) $.',uLI \ J L'rq - flltz)
=
, Ls't^o^g
-i-- 1 i*-r... LL
\ \r1
{7^rv
L-V\^\ \ ^- S-f A, = $"'\ b - 3 4.,-r
' / ,\
gr> -, 1- A .
-Eti
.t\ 11.'.o'oli'-.
G-ryi'l+€+tlr
ft s-,.11\1iA+
l'vout-i
' .\A , i\: |
*r-t{ + ,.1 i i'--
-' iL. '-
t-i" C(-l-. ;- i.
L^i 11 \ - .v li '/11- \- j
i+-
;
*
n N,\
., !,?- !,a* ' i !rt. St.t\ ,
Jl
J.
V\- \;',1'.o^3
1 a/ ',u
tA-
iAr-- rr
>)r\ .. x-
-1
,/
*.-ttnta; '
L\I'rr) -- \.
D -
\avi0,^a):-o-' '...-) tt*" )- L\- Stt',' €l- u-'- I
\o \i tt.- s.J B>*' cF C-*.^+.-i eA+ir^^-J--A ef h
o^i -L
t?) |ret; iq r.{r,,r =r-eli
-
f\.L.€ * t (^ 7 ,:t t\.L-€ "\ ?r\r L4 tnutr ): l-e-rT
I51 \,.r.L.!- u 1 -19 S 6yJ f,t*'-r 1tUr ,.,r 6. (3u-}rar'\'o'^'T {t^-.Jti+' tlr$
bi\L i'i
C-. l-
\i \; -'j3 a-'1;;*-h^) )
-\
=2 \-aC ; flr* ) =9 Lr.,,-,.L\ -, G*1"^.\cJ \ov -Q\S
Bgt*.) 2 s . $o
\i) trxlu\: i t-,
I
tf b) 2T
, \F{^o--r -1-= 1p-c'. L'iYr\., - - '- l*-l )
O' \'i
I
Sc 1r.'- -€ . v{. g \-,t\ 1-T -:) \-.- L- E- "1,, lrs ,
) tr-t s 1-\ .n ln' t- I U 111 zr ) .
i ;- i : T-
-4 \t.'-,\t; f* .u,.='r
' .*-r;i ;" r-.-drr\r:j 'n"\' t !r,,'',.\Lt " (^'*rr^le-i
-i J'
\L) -*. [-n^],.-^ ii*i-')
\?r --; . tA 1*trr a-)a
\\u..-'l= ["Ldth,'a')= ]
\-'
\ u o.L.j-
^7s
L LI! - ^L\'\ I /
\zt
\r^ f- 1r"s
!
X ---t p\-\'-- --\ \..nr^ -5 h- o - *I7 - }r.
.)P.11
{ -fr V lr.\'- o-\
d ,* r. -f- c- t rnx CJ \t""o- d Gt'\'l i )"*J \t" A a*\
=
c- ) -va1\z-.htvd; .
i\
tL '.r t i1^',, -Sri; >t_ ') = iq \ t"-/t*1:> i): rlL*c")<s-t-) =T l)$rr*,.<
\._e \
L:l
; - r -L !
'
-ii
9"ro-! \ ): \^r \^ Lx;.iA*<-J, bt $L.
Etxt>
u' i;
911\1
'-'-:- / L!,.1I ' $l- ui-s sr$:- {0..S.
L
\-0,\,
? a \-'
>\.6 ]- . a\
\.in r: - ri > ',l1\1-i51 1
Srrrtr =
l\
F\-+ t---
t)\Fr-Fr-.1 =
i4 I'r=bQJ.* }. i
i"-t {^orva
\sc
e_ 'Y
.*t.t.d rg
b '.i^. S'? . s\ + ''^ ^-
n -\cl
-) v-
16 LC'-t
-l J
..
-v
t'("
, t .N \-
.n
tn Lt \!
\ -
J ' '. - t-g>-o
,l {-
;
.* 5- I -v,
4 Lx tB Ltr
zo
{ .1
" ! t'i
{
L>r-,
,t1 i
r b*!t a+i- i,., '1,^4ii'-ia€-l ^A il.--,r
4_V-U.
i aAO t1. \
/\I It -
.t
i -, lL'r
'-x i'- t f To aJ in \rnq.hi.qi ?.rl J $: g.-.
^ T *'' ',r- ! x;
t Li-\i i itj. !* { 2H-
)
13
$- !" i$\- ,\] t--\
L-7
t' .'?
.i.
ll*t .-x iS J i i-l,, : 'Jn v l. n Lu, j x
\-j^j'{ i v: rr La- 1
L.A(\jf A jr t/l\
3 L'c" \{'-i
!- i-S. \ '.n ?-t-i *
LA
\nu1!\: \ J,. )
d
\: ,-
Y!.I
1
/-
h-.-
ttsJ
1
1)1 \x.L.1". sr ? J-r. p =3r' lY{xi ? (+
\e { ossa)"r
1$,
t- 1/.r
{ +ro'=/, { A,n*
\ .[ '- ).,,,1
,
.'. -.! ? li
\\$i +d^ Lr.pT\ a< q vv) 4u**ti: - }t .\!
i:*-*1 !n,,iL,' :--; L ?CI;
";
" '- i-r G.^ar4;s-3
t,\.:4_\l :.r \
1
\?-
=L'1 +/ d*, I
o-".+i,.***ii"^; S {t+€
- \ q- -^ ' l
*9 t
€^ \
J-
h-r
ilr,-u, Lzl ),t
1r\ {-
vl*
t
r
j- :Ly.l. -. -Lx +)
!- r
\- .Jg 'tj- i > '\ E- .-L - ?^'u
'Js, 1l \.-, t^L f, 'v'\' \?1 ,.^
.'-i' f- r-i\'
>i ++ ix ) t- ''s . * - ;Ysi>'' ;
-E*l -1 r:^
L! L
Lr 1 >-
1- v--- ,'"4
)?
-
i-:
\4$\5, r- 1
i -- -t
-v :t
fTr-:------- L's_ ^l
\ A rs1 tr' \t' i.!):
or-
!\ r ':--, -)
!fveb$,t.^^( 1 fat
i:- ', L.€2 {.t q tl
t\. So \-a' v\.
\r
5-v Lft'^ua! 1 b'i
\Fi^ r.^{ \ -- a\i
an
'r
Eu\T" I : \rir-r l' I 'n+Y-) ) V
-lL\ r,
v\
b. t :rr-rl- ' \-'**v-'. ) i
t.,r\L\; -__L
"-,,^
\a1n-r)" lx'rvr')
l' ) !u tr' u'€' "i |igi -r
t ^,*12 \-t
\
-)_
;.
J / "n-t -) rst L\ ' A
/-tt- -
\-\ \ \^-)
,IG
-\ Ls\- - -\ \-
.G f-o- I
i + \- ..?
>) t"\l\-- ll
.i 1-
(;l'u
Lc) t\.u,e,\ b * "q. Soi,r\.u.€. d 0rrl -l, t*.\-I) : e_T=
\-ri..,.-r T-- T l-' o.r ]ltM-,* \.t^\) -
"+
7\
A l- 1"i\ ) ? \'n+)
*-.....-.._...:....'_
-
o\
v V t?s
2t-'
/b \. = -
)z-
v1 . 1.rar ) t
I '\ \ h
L n:r:-
gi
a
+ w)i u)
A! .t
)'t- 0 V $ -;rc
)--> a\
j^-i );-. /\c-rt<a \s'a L'+r'S 0'J 'R'N'S') U^'$U^ y $)$- -Vt!0
Sr** \'wo^
At-n'cl cFe A<*4- L' A -
LJ$rvrc^). I "\ $j i^^ ')ur' \ou<"
)^ril'nj 2 q.)j ., r.a-!L.-
a l x\.
,}zll
2\ l^r.\ I: 't
"- t)\ ' air-i-t^J
; L''?;
- {lr-<-t-
,i^\I / it-ti1 h /
=a
V tLi-a-)
Eq\*i'l--^) -3-
Fz.-1v.-\r $oL v-$&l-T-a-r -\
-?\ l./al\'r I / - A t
- +LLs\{"'-*)."i 'i-o\,\
I .. \ 'Xn** !.r.
\',,\ b'Jtr\v
T*, i'- r*u.,^" o\ n'y E'
r !u Fr t2' +
\ \' v' ^.
'\' \tt'''- i . F .\
L'Ltrt-!t"'r l S. J^c
U) l\.L'e' 4 9; \\-)
lgr \'
ti} r ..A tn\Y \ > ^ (\- rJ,.r^lr; t At'
tr" il12-'^
-x^4
\1r*\.- *>+
-l
u-/
L^
rtsr.\!\- l\!r1t \ . Ly\ \*
-'-\ l-uu \c,-"-) )
o\
t).\ tr. u. e, d\ |rs) I Er tll; \f _
4-
I
qe€
L ^\a
''!
= l-'t-
rt S-r i-: ::lt €-u \a*): L *
-?t ts\l\ > \0.-\!\ :- 3"
!e i Tr.u. C' dr g i'n X\^r - So
i t't- i - ( Y-
'
'1l{1*1 \lt .'' a-^ v
1
Io
^r'\-'^.$t-
rzgL},,-r ) C /
V
:-\ srr\.L); Y d\-J S^\\
*\^\ -u
Yr--.
) i
v _Lr"
\t 'f .L
1 en |t*
l\ 1.r\\ \ - Yrlu\\ \; Et L $r*r
1-v\ 2bt\\-1*l €.u\{]r )
1 )-'
F. \.n.rv\
\\- \.-- 1trY\11^1
) -
\a
.n \L
-! ' Y\ f" - zB'I.r- { )
\.-\tt*vt----' ) -tt '
= 'it- ) Y.ni-t
'^"
'i r'f
^v' .r.^YlY N-
)-Yb ?
'-+ -'-111{ 4 v. \-l -" '
1 --Y
-r-, *_v) >a { h?Y, =c- :
: )----a;;;f,1
- ' ) {'".--
Lo
\r.,\.1 -\\ J I
r\\ \1.r-,c-'\ _i e.
c $ T. So tr..'_€. d\o'
l- L -r -,e,
-ur-
i_
v s
\. S- -= -L
Zs\'-rL--n'
-\) \'
t^\at-
s\- . r \- €v\t{.-s-) ) - -
t . -'l-'-1
' bn'\\ \
\\co{' lB \-
\
! L*\x-'s'1
J- }- )o
- V1
qq J'ozr -\A'-0 \A' A'€' ' Cvl{<'ri- -
Su u\ \a;{u. l'L"- tr^
rf g i.*y*-)-r t iX:--*r)\ Tl- t';\'/'rtr"): t''t\{'-x-)'v}}1'
D"\r'"e
lu\r.-/'-)> >u\.
\-Yi- t') 4 l*:' tr') :\ Zs l) Lrt-:'r 1 t
I,' r I, -rt, G Too-i'-'- ;\'q'"^\r!-e =+
\f !€-'t8'
L s Lb\'. l,) ') > ?\))-
T*-
ZU i!r\;, t,r ) ; fl\)l- \ q L€ '
Nlr"
.\ rF
VO [lr;\x.-t") ) =
\
v sao i\** t, i,- rr. ) A I Y,- x. i
Ul LL'r/:',, ) ,
1
)!$ r
i
C\{,vl-
or^'^!, 9r$,)
v\"-
g \r"_x-l - ?tq I \> \
---=.-- I
'.i
dtt\\l.Y'i d';q 151;'-*'t
, \) !^
n'ut-'J'
:t> o
etL
g=) L $trru\"; [t-;\-rr)$ LFtf- V 04\ 4 \
1:o
1l*., b" \tJ \ e€. \r 5!r9r :
uA trni rrrrrrrr ?:--<--( J
r'-'
L.
Lq \ {1r1-M1 Lt, r T'a v-{ '- \ t
.-\
-taS rT
I' I -*1^-t \ n ''
\1
'\l \ni C; b.l '> C2 Aot .
Tv, , \* S"8 @, f t"\\\ "r\'-i Z<J' J ra+.i
"-ttoa1
\t-':lpM \t" c{e- . \g-t 1 )
'- '9! xr- r .Q^-a -Yr
T,..-,1 11.'^^r *\ -)t*0 E-l P
o
tx\nr-*t.,t-l\ { Xtr)-tr--o )t I
"s\e \f I - }"' Lg\ [{'1r\- {1r\-r) tl"''r'!-til
: o{t Zg \ ',3r,.r - )Li-rr-
T gs \ (-{.',-t"-e )LJ
\1trr\t )-- ao( Eu \ L*t^r -ao)- rf lt ) Ls\ ({t.r-*tr'-\l
LX69r-t}l
*-
?\ t\cD"' ls\a L€s\l-d1*l-iL,l-t)tl )o'
?*u .n
\^ \,".,rirr.\r^r
.}rgJ J
T\ \q4 1 .. - !rtr.: L k6. il1*\QX
{row 1'
,ln\
-1
?e { i i- Xrui-'t xc,\ ) L dir rt a-o ' )
C. 1
Lu\ LXt*r-/s-.t-\ 'L) -.)
\r\n-r \ t1- l
. -!A- L
)
(*'-L
1
\u
\-E
n\n-r ) l)-t )t-t A: ol:r
t-i 4) d1 4q<
LL
-
- \^t,r-.\ A\ 1t-+)h-t;n*-'
-t \ { }+\ -e
O4A<l4i '!-'1. x *)
\^1 r^-r- \) I\ll \,.
i1
x'r- -.' /I
+ )
C= '-
*1,*1+ *11
_\
/| Fq^.*t -V^-l qr\-l-,.'*s\on.,) \-\ *4 Cl-a,-l I \oio l'x\ : 1
1^"^ 4r(
A,^Jl,Utl \A,^.q_ a.* R-s<-- \^uo*J^.-. \o,^+ -
T-l- .T
L-
i;i
r-rK h-.^
E * Lfa"
Zs L?-' ;
_Y iw
r;-- .t'
t--' $
-''\.t'Y'
i-v
\*r L'l S
r \gr
-r*r",
!\ .,\
L
1
, ^.,-..:
!-' '/ '
,- 1*a
,tt \.jvrs -r V/\
_ \'^<
a^ "
L=vl 'o*> ;4\d,*J
-- .Y (-
r-1' -n
tl
'/9j
!.*, l-* Lfur,.,. U+ € n1\\i 1\ \J \i- .i'*i e<-\ *J - {-i l
^TL_/
o.\)\u-5;n l4-\1- r
^y\
\r {--:- n \,ra.A.r--
- l\Tr/ ll X \_ v,.d ;a.r 4,"^-$&;\-
'\'1
Y-
\ h"l' t \ h<Lv
1t
{'2a* \}Gv<'.*4J'
\r' \-r**.
)
^!
- \ c.J\ V\-?--
)Lru..l
\b=, \') u, L, u. rn T= tg -
\- RJ . t, t .r \
'J, (-Yn'1xJ
{' r<\
\t-\, ) ---'-,
)
v
-\ o\-D'\i /