Dattakumar Akalwadi 1PE17IS029

Subject name n Big Data analytics subject code-17CS82 Page 1

℅.i) T╟◙k T◘╟╔k═◘ ▒in┤ Had╗p:- A T╟♂kTra╩┌═◘ ▓╫╖ a ∟♦d≤ ▒in┤ ░▼≤ ╩▄ust╧r ░↔╞≡ ┼c╔╧p♪╖ ▓ta◙┌╖ - M╞p, Re╠u╩∑ ╞nd
S╘◄╝█≤ ♥♠e○╞♫╫╕╖ - ▓f◘♦▌ ╞ J♥╚T○╞╔k╬◘. E↕╧○≠ T╞◙┌T◘a╩k╬r ▓╪╖ c╕╨╪╙►re╦ ▒▬╓↔ ┼ ╢╧≡ ♦╨ ╢l♥ts, ░↔═s≤ ▓╫nd╫╔┼♪≤ ░▲∑
∟u▐b╧◘ ♦╤ ▒♫a♀┌╖ ░▲╟≡ ░╓≡ ╩╞▀│ ac╔═♣♪.

░╫╪)N┼m╬☻o╦≤ ▓╪▀│ HDFS:- T╒∑ Na▐╬N♥╦∑ ▓╪╖ ▓↔≤ ╩╧▀ter♠╪═╔≤ ♦╤ a▀┤ HDFS ░╨╓█† ╢y♂t╬m. I≡ ▒┌e═p╖ ▒▲∑
╠╪rect╣≠ ▒tr═≤ of ╟╛ ░╤╪█e╖ ░in┤ ▓▼≤ ░╤╓█≤ ╢y♀♪e▐, ┼☻d ░☼◘╟c┌╖ ▒‼h═r† ╟c○║╖ ░↔∑ ╔▄u◙♫╬◘ ░▲∑ ▒╨╓▄≤ da♪╞ ▓i╖ ▒┌═♣☼. ₥d.. ... Th†
N╟m╧No╦≤ ╡e♂p╕d╖ ▓▼≤ ╢►╩╔e├╤►█ ╡═q►═♀t╖ ▒b≠ ╡╧t►○▀╫☻≈ a ▓li♂≡ o╤ ╡╬█═v╟☻≡ D╟☼┼N♥╠≤ ╢er↕er╖ ░‼h╧r† ▒▲∑ d╞♪╞ ▓l╫↕╧♂.

▓╪╓i) Nam╧n♥d≤ ░e▀♪═r ▓╫☻┤ ╢┼f═▌o╦∑ :- In┤ S╞╨╬M♦╠∑ N╞meNo╦∑ ▒♣╧○f╣▌╖ co╛╬╩♫╫╕│ of ░╚▄♦c┌ ╡ep╣☼╖ ₡▒╨◘j▐ ▒╨◘♦▐
╦╟☼╞▀♥d═♂. Na▐╬No╦∑ ▒═▀☼e◘╖ ╢╞╤═▐♦d∑ a◄♪o▐╟♫╓╩╞╛≠ ╦►○╓☻≈ ₠░f☼╖ ░╓☼╖ ╢♪╟r≡ ▓►p. N╞▌╬N♦d∑ ░le╟v╧╖ S┼╤╬m♥╠∑ ╞f☼╬r ░▼∑
Da♪┼N♥╠╬╖ ╘┼↕∑ ╡╬♣╣☼e╦ ▓▲╞≡ ←║≡ ▓╚l♦╔k╖ ╟r† ╟v╞il┼ble.

▒╪v) S╬c╕╦╞◘≠ N╞▐╧☻o╠† ▒i▀┤ ╘a╦╗‰ hd╨╖ :- S═╔╕d┼○≠ N╟meN♦╠† ▓╫n┤ h┼╠╗‰ ▓╓╖ ┼ ╢♣╧╔╓╟╛≠ ╠╧d╪c┼♫e╦ ∟o╠∑ ▒╪☻│
HDFS ╩▄◄◙☼═r ▓▬╘║≤ ←╟╓☻│ ▓fun╩♪╪╕┤ ▒i╖ ▒☼‡ ▓☼┼k≤ c╘╬╔┌♠♦╓▀♪╖ ♦╤ ▒↔† ▓╨╪▄† ╢↓s♫e▐ ←╬♫╞d╞♫╞ ▓p○╧◙╧▀≡ ╕┤ ∟┼▐╧☻o╦e. I≡
▓i╖ ∟♦≡ ╟ ▓╚a╩k◄‰ ∟a▌═☻♦╦e. I≡ ▓j►♂≡ ╩╒╬ck♣♥int╖ ∟╟▌╧☻o╠═’╖ ▒╤i▄∑ ╢↑s♫╬▐ ∟╞▐═s♣╟c╧. Th† S═c╕da○≠ N┼▌eNo╦∑ ▒i╖ ┼
╒e▄p═◘ ▓t‡ ▓▼† ▓♠r╓▌a○≠ N┼▌╬No╦≤ ▓b◄≡ ∟♥≡ ╡╬♣▄╟╩† ░f╣ ░♣○╫▐┼r≠ ∟a▌╬n♦╦e.

▓v) HDFS “W○╪t† ╕╩∑ R═╞╦ ←┼☻↑” ▓♣╟─╧○▀│ :- HDFS ▓╪╖ ←╣† ▒╨╣ ▓b╟☼╩╘ ▓♠r♥ce├╓☻≈ ▓╫▀┤ ░♠▄┼c† ♦╤ ╠a♪╞ ░►♀╞╙†
▓╚≠ ▓u♂╧r♀. T╒∑ ▒╬mph╞◙╪╖ ░╓╖ ╕┤ H╪╥╘ ▒▲◘o►╥╘pu≡ o╤ ╦a♪╞ ┼╔╩═s╖ ╡┼▲er ▓▼┼n┤ ▒▄o‹ ▒▄a♫╧☻╩≠ ♥╨ ╠a♪╟ ╞╩╔╬├. HDFS
▓╓╖ ╠╧si╥ne╦ ∟♥≡ ▒☼‡ ╢♪╣† ▓↔∑ ╠at╞ ░bu≡ ╘♥‹ ░╨╟s≡ ╠╞♪┼ ╔╞▀│ ₥░b† ░╚† ╡e☼◘╪ev═d ▒▬╘╫l∑ ╞▀╞l↓→╓☻╥.

▓v╓) I▀♠►≡ Sp█╓♫╖ ░in┤ M╟pR╬╦u╩≤ :- W╘╬▀│ ╟ M╟♣R═╦◄╔∑ ░j♥b ₥l╫╖ ▓╫╖ ╡►▀│ ▓♪‡ ▓♣roc╬◙╖ ▓inp►≡ ╦a☼┼ ╕∑ ♥╤ ▒▲†
▓▼╪n≈ H╟d╗‰ ░f◘a▌e‼╣k ╠♦╬╖ ▒╫╖ ▒♪‡ ╦ivid∑ ░↔≤ ▒inp►≡ d┼t┼ ▒╓nt‡ ╢▐┼╛e◘ chunk◙, ▒▼╬s† ╩╘►▀k╖ ╞r∑ ╡╬f╬┬═╠ ┼╖ ░╫▀♠►≡ ╢♠▄╫☼╖
▒in│ H╟╦╗♠. F╣ ▓e╟c╒ ▒╪☻♣►≡ ╢pl╪≡ H╟╦╗‰ c◘╧╞♪e╖ ╕∑ ←┼‰ ▒♪╞◙k ▓♪‡ ▓♠ro╩╬◙╖ ╡╬╔╣╠╖ ▒╪n│ ▓▼╟≡ ░╓▀♠◄≡ ╢♠█╫♪.

▓v╪╫) ╢╒►╝█∑ ╢♫═‰ ▓╪▀┤ M╟♣R╬d◄╩≤ :- S╘◄╝l∑ ╢♫e‰ ░╪▀┤ Ha╠╗‰ ░t○╞n◙╨╧r╖ ░▼∑ ←a‰ ♦►t♠u≡ ▓f○♦m Ma┴═◘ ░t‡ ╟
Re╦◄╩╧r ░╫n│ M┼♠Re╦►c╬. S╣≡ ▓♠╘┼◙† ▓╪☻┤ M┼♠Re╦◄╩∑ ╔♥v╧◘╖ ▒▼≤ ←╬○╙╪n≈ ┼☻╠ ╢╣☼╪▀≈ ♦╨ ←a‰ ♥u☼pu☼s. D╞♪╟ ▒╤r♦▐
░↔≤ ←╟┴═○ ╟◘≤ ╥r♥◄p═d ▒b≠ ▒↔∑ ▒k═↑, ╢♠l╓≡ ┼▐╕≈ ╡═d►╔╬r╖ a☻╠ ╢╣☼╧d ▓b≠ ▒▲† ▓k═y. E↕╬r≠ ╡╧╦u╔╧◘ ♥bta╪☻╖ ╟╛ ░↕╞▄◄╬╖
a├o╩╪┼☼e╠ ░wi▼ ░▼† ╢╞m≤ ▒key.

v╪╓) YARN :- YARN ░i╖ ▓▼≤ ←╞╪▀┤ c♦▐♠╕╧☻≡ o╨ H╞╦╗‰ ▓↕2.₧. YARN ╒e▄♣╖ ░☼‡ ♥p╬n│ ░►‰ H┼╠╗‰ ▒╚≠
┼╛♥▬in≈ ▓♫‡ ▒♠○o╔═♂╖ ┼▀╠ ╡►▀┤ ╦┼♫┼ ▓╨╣ ▒╚╞☼c╒ ▓p○o╔═├╪▀╥, ╢☼r╬╟▌ ▓♠◘♥╩e├╫n╙, ▒╪▀♫er┼╔ti↕∑ ▒♠○oce├i▀≈ a▀╦ g○┼♣h ▓p○o╩╬├╪▀≈
░w╘╓c╘ ╟◘∑ ╢t╣═╠ ░╓☻│ HDFS.

2. ▒╪)S♠╧╩►█╞☼╓v† Exe╩u☼╓╕┤ ▓╪n┤ H┼╠╗♠- In│ H╟╠╗♣, S♣e╩u█╟♫iv≤ Ex╬╩◄♫╪╕│ ▓╫╖ ╞ ▓♣r♥c╧♂╖ ▓↔a≡ ░♫╟┌═╖ ▓p█╞c∑ dur╫▀≈
▒▼≤ ╢l♥‼e○ ▓e↨╬c◄♫╪╕│ ♦╨ ┼ ▒♫┼sk a≡ ╟ ∟♥d═. I☻│ ▓↔╪╖ ▓♠◘♦╔e├, ▒↔∑ ←a◙♫═◘ ∟o╦≤ ╢♫┼○♪╖ ░ex╧╩u♪╪n≈ ┼n♥↔╬○ ░i▀◙t╞☻╩≤ ♥╤ ░▼╟≡
╢a▌† ▓♪┼◙k ╕┤ ░▼† ♦↔╧r ∟♥╠╬. A☻d ▒▼† ▒☼a◙┌ ░‼h╫╩╘ ░╪╖ ░╨╓☻╓she╠ ▓f╓◘s≡ ░╓╖ a╔╩╬♣♪╬╦ ╞n╦ ▒↔∑ ▓exec►♫i╕┤ ♥╨ o▼╧r ▒╓╖ ╢☼♦┴═╦
░b≠ ▓k╓╛i☻≈ ▓▼a♫.T╒∑ ╙♥╟█ ♦╤ S♠e╩►█┼♪╪v† ▓ex╬╔u♫╓╕│ ▓i╖ ╡ed◄╩╪n≈ ▓▲† ▓╬↨╧╔◄☼╓╕│ ▒♫╪▌═, ░b◄≡ ∟♦≡ a≡ ░▲† c║≡ ♦╨ ╔l►◙♫═r
 Page 2

░╧╝╫c╪enc↑. In┤ ╞ ₠Buh≠ Bu♂≠ C▄u♂t═○, ▓▼╓╖ ▒‼╓╛ ╡═s◄l≡ ▓╓☻┤ ╡╧╦◄ci▀≈ ░↔∑ ov╧○a╛ ▓▲◘o►gh♥►♪. ╢p╬╔◄█╟☼iv∑ ▒╬↨╬╩◄t╪╕│ ▓╓╖ ╟
▒╨╬┼♫◄◘† ▒╫☻┤ H┼d╗‰ ▓‼╘═☻│ ▓↔∑ ╒┼╦╗‰ ▒╤r╞m╧▬╣k ╢t┼○♪╖ ▒♫‡ cl╕≤ ░▲≤ “l╕≈ ╡►└╪☻g” ░♫╟♀k ░╫▀┤ ╟☻♦▲╬◘ ∟♥d╬.

▓i╪) Ra╩┌ Aw╞◘╬n╬◙╖ ▓╪n│ HDFS-Rack Aw╟r╧n╬◙╖ ▒╪▀│ H╞╦╗‰ ▓╫╖ ▒↔∑ c╕c═♣≡ ▓▲╟≡ c╘♦║e╖ c█║═◘ D╟♪ano╦╧╖ ▓b╟♂e╦ ╕┤
▓▲† ╡ac┌ ░╪n╤╣▌a♪╪╕. B≠ ╦╧╤╞◄█☼, H╞╠╗‰ ░╓☻s☼╞╛┼♫i╕│ ╞├◄m═╖ ▓▼a≡ ╟╛ ▒↔≤ ∟o╠╬╖ ▓╚╬▄╕≈ ▓☼‡ ▒▲≤ ╢am≤ ╡a╔k.T‡
▓╪m♠r♦↕≤ ∟╬☼‼╣┌ ▓t◘╞╝╓╔ ░w╒╫▄∑ ╡╧┼d╫n╥/w◘╓♪╫▀≈ HDFS ░╨╫▄╧╖ ▒╪☻┤ ▒▄╟○╥∑ ╔█u◙☼╬r╖ ♦f H┼╠╗♣. N╟m╬N♥╠∑ ╔h♥║╧╖ ╦┼☼╟
∟♥d╧◙, ░‼h╪c╒ ╞○† ╕│ ▒▼≤ ╢╞▐∑ ╡┼╩k ╣ a ∟═╞○╚≠ ╡♥╩k ▒t‡ ╡╧╟d/ ▓▬◘╫♪† ╡╬que◙t♂. HDFS Name☻o╠∑ ┼╔h╓╬↕═╖ ▓▲╓╖ ╡ack
▒i☻╨╣▐┼♪i╕│ ░╚≠ ←╟i☻ta╫☻╓n≈ ╡a╔┌ ▒id╖ o╤ ▒╧╟╩h ╠╟t╟ ∟♦d╧.

T╒∑ ←╞╫▀┤ ░♠►◘♣║≤ ♦f R╟╔k a▬╟r╬☻╬s╖ ▓╪╖ ░t♥:

I▐p◘♥v† ╠╟ta ╡el╪╟╚╫l╫♪≠ an╦ ╠┼t┼ ┼v╞╓█╞b╪l╓ty.

B╧─═r ╩▄►s♪╬r ░pe○╤╣m┼▀╔═.

P◘╧↕╬n♪╖ d╞♪a ▓▄║╖ ▒╪╨ ▓↔† ░═☻♫╪○† ╡╟ck ░f╞╓█♂.

▓╫╓╫) HDFS Ch╧╩k ░p♥╪nt♀- Ch╧╩k♠♦╓☻☼╓n≈ ░i╖ ╟ ▓♣r♥╔╧◙╖ ░▲┼≡ ▒♫┼┌═╖ an│ ░f◙╪m┼g∑ an╠ ▓╧╦╫≡ ▓█o≈ ╞n╦ ╔♦m♣┼c♫╖ ▓▼em ▒╓▀♫‡
a ∟═‹ ▒╨s╫▐┼ge. Th╓╖ ▒w╟↑, ░╓☻♀☼╧┼╠ o╨ ╡╧♣█╞↓╪☻≈ ╟ ░♣o♪e▀♫╫┼╛≠ ░◄☻b♦►▀╠╧╠ ░╧╦╪≡ ▓log, ▒▼≤ N╟m╧No╠∑ ╔╟▀│ ░l♦╟d ░▼∑
▓f╓☻┼█ ▓i▀-▌═▐╣≠ ╢☼╟♫† d╪◘╬╩tl≠ ▓╨◘♦▌ ▓▼∑ ░╨◙╪▌╞╥╧. T╘╪╖ ░╪╖ ╞ ░f┼r ←╣† ▒╬╝╪c╓╬☻≡ ♥p╬○a☼╪╕│ ╞▀╠ ╡╬╠u╔═╖ N┼▌eNo╦†
╢♫artu‰ ▓☼╪m╬.Chec┌♠o╪n≡ ∟♥╠∑ ▓╪╖ ░▼≤ ▓╓m♠█═m╧▀♪┼☼╓╕┤ ♦f ╢ec╕╠╟r≠ ∟╞▐† ∟♥╠╧. I≡ ▒f╧♫╩╒╬╖ ▓♣╬◘io╦╫╔╟╛≠ ▒▲† ▓╨╖ ▓╓m╟╙≤
┼☻╦ ▓ed╓≡ ░█♥≈ ▒╨r♥▌ ▓↔† ∟┼▐† ∟od† a▀╠

←╬r╥≤ ▒▲╧▐ ░lo╩┼╛↓. Th≤ ╡═♀►l☼in≈ ╢♪┼☼e╖ ╩╞╛e╦ ┼╖ a c╘═╔k♣o╪n♪, ╞☻╦ ▓u♠▄♦┼╦ ₥f↔† ▓↔† ∟e‹ ←═◘g═╠ ▒╤╖ ▓╫▌╞╙≤ ▓♪‡ ∟a▌†
∟♦de.

░╫↕) HDFS S▀╟p◙╒♥t╖ -HDFS ╢n╞p♂╒o♪╖ ▓e▀╟b▄≤ ▓↓♥u┤ ░t‡ ╩╞p♪►○† ░♣♦i▀☼-▒╫n-▓♪i▌≤ ╔♦♣╓╬╖ ♥f ▓▲† ₡▓╨ig≤ ▓╨i▄≤
╢↓♀♪╧▐ ╟n╦ ▒♣◘♥♫ec≡ ░y♥◄○ ░╫▌p╣♪┼▀≡ ╠╟♫a ╟╙a╓▀s≡ ▒◄◙╧◘ ╣ ╞┴▄╓╔╞♫╓╕┤ ░╧┬╣♀. Y♥◄┤ c╞n│ ░tak∑ ╢na♠♂╘o♫╖ ♥╨ ▒▼∑ ▒en☼i○≤ ░╤il†
╢↑♀♪e▌ ╣ ╢♣╧╩╓f╫═d ╢ub♪r╧═╖ ╕│ ░↔† ▓╤╪l∑ ╢↓◙t╧m.W† ╩an┤ ╩╘═╔┌ ╢☻╞♣♀ho♪╖ ▓╫n┤ ┼ ╦ir╧╩♫╣≠ ▒◄♀╫☻≈ ▓▄╖ ╩♦┐╞☻╦.
S▀┼p♂╘♥♪╖ ♥f ╞ d╫r═╩♪╣≠ ░w╓╛ ░b≤ ╢t╣═╦ ▓╪▀┤ . ╢▀aps╘o≡ ╠╫r╬c♫╣≠ of ▒▼∑ ▒╨♦█╦e◘. T╒† ▒♠╪╩t◄○† ▒╚elo‹ ╢╘♦‼╖ HDFS
d╪○e╩♫╣≠ /◄◙e◘/╘d╤♂/▀►▌b═◘╖ ╘╞╖ ┼ ▒f╓l≤ ╩┼╛═╠ ∟◄▐╚╧○╖ ░▼╞≡ ▓╓╖ ┼l♀‡ ╢╞↕═d ▓╪n│ ╢▀a♣♂ho≡ d╓◘et╔╣≠ /◄♀╧r/╘╦f◙/▀◄▌╚╬○s/.

▒↕)N┼m╬No╦† HA -HDFS ╟r╔╒i☼═╔♫►○∑ ░fo╛♥‼╖ ←╟♂♫╬r /s█╞v† ▓☼♥♣♥▄♦g≠ ▓i☻│ ▒wh╫╩h ←a♀♫═◘ ▒╓╖ N╟▐eN♦d† ╞☻d ╢▄╟ve╖
░i╖ Da♪╞N♦╠e. N┼▌e☻o╠† ╢♪╣═╖ ←e♪a-d┼♫╞ ░╪.e. ∟◄mb═○ ♦f ▓blo╔┌♂, ▒↔╧╪r ▓█♥╩┼☼╫╕, ╡╬♠▄╪╔┼╖ ┼n╦ o↔╬◘ ╠═♪┼╓▄♂. Th╓╖ ←e♪a-
d╞t┼ ▒╪╖ av╟╪l┼╚l≤ ▒in│ ←╬▐╣≠ ░╓n┤ ▓▲≤ ←╟♂t═r ▓f╣ ░f┼◙♪╬r ╡╬tri╧v╟█ ♥╤ d╞☼a. N╟▐╬No╠∑ ←╟╓▀☼╞╪n╖ ╟☻╦ ←a▀┼g╧╖ ▒↔∑ ╢▄┼v∑
∟o╠e♀, ┼n╦ a├ig☻╖ ▒t╞♂┌╖ ▓t‡ ▒▼e▌. I≡ ╢╒o►█╦ ░╚† de♣lo↑╬d ╕┤ ╡e█╓╟╚▄≤ ha◘╦‼┼○≤ ╟╖ ▒╓≡ ░i╖ ▓▼† ╔╧n☼╧◘♣╓╧╔† o╨ HDFS.
Be╨╣≤ H┼╠╗‰ №.₧.₧, ░▲∑ N╟▌╬N♥╠≤ ▒wa╖ ┼ ╢╓▀╥l† ░♠♦╓☻≡ ♦╤ ▓fa╓l►r† (SPOF) ░╓▀│ ╟☻│ HDFS ╩█u♂t═r. Each
╩█◄♂♪═◘ ╘ad ╟ ╢╫n╥▄≤ N┼m╬Nod╬, a▀╠ ▒╓╤ N╞m╬No╠∑ ▒╤ai█♀, ▓↔† ╩▄►ster ╞╖ ┼ ▓wh♦l≤ ░▬♥u█d ▒b∑ ₥♥a≡ ♥►≡ ╢╬◘↕╫╔e◙. Th∑
╩lu◙☼╧○ ▓▬i╛ ▓b† ▒un┼v╟╪█abl≤ ░◄▀t╓l ░↔† Na▌═No╦∑ ╡e◙☼┼r♫╖ ╣ ▒╚○o◄╙╒≡ ╕│ ╟ ╢╧p┼◘┼♫≤ ←╟╔╒i☻═.

░↕╓) Ho‹ ▓t‡ d═l╬♪† ┼ ╦╓r╧ct╣≠ ░╪n│ HDFS - ℅Us† ╟☻┤ HDFS ▒╨╫l† ←╞n╞╙╬○ ▒♪‡ ╠╬▄╬t† ╠╪◘ect╣╓╧◙. S╧≤ ░↑ou◘
H┼╠╗‰ ╦╪s♫◘╓b◄t╫╕'╖ do╩►▌╬n☼┼♫╪╕│ ░☼‡ ╠╬☼er▐i▀≤ ░╪f ▓╪≡ ▒♠◘ov╪╦╧╖ ╟ ▒╤╪▄∑ ←╟n╞╙er.
 Page 3

№.L♦≈ ░╓n☼‡ ░↔≤ H┼╠╗‰ N┼▐═N♥╠∑ ░►◙╫☻≈ ▒▲† d╞♪┼ba◙† ┼╦mi☻i♀☼r┼t╣'╖ ac╩♦◄▀≡ ┼n╦ ▓◄♂≤ HDFS'╖ ╡▐r ╔o┐╞☻d ░☼‡
d╧▄═☼† ▒▼∑ d╫re╩♪╣╫e♀.

3)N╟m═▀♥╠† ▒♣═○╪♥╠╪╔╟╛≠ ╡e╩e╫↕╬╖ a ╒═ar♫be┼≡ a☻╠ ╟ B▄♦╔┌ ╡ep╣≡ ▓╨◘♥m ▒╧a╩╘ D╟♪a▀♦╠≤ ▓╫☻┤ ▓▲∑ ╩l◄s♪═○. Ev╧○≠ Da☼a▀o╦≤
╢en╦╖ h╧╞○tb═a≡ ←╧├╟g≤ a╤♫╧r ▒ev═◘≠ ⅔ ╢e╩╕d╖ ▒♪‡ N╟▐═▀o╦e. T╒≤ h╧╟l↔ ╡╬♣╣≡ ▒i╖ ▓j◄s≡ ▒╪☻╨╣mat╓╕┤ ╞bou≡ a ▓♣╟rt╓╩►▄┼r
Da♪╞▀♦╠† ▓▼╟≡ ░╪╖ ░▬╣┌╓☻≈ ▓pr♦♠╬r█≠ ╣ ∟♦♫. I☻│ ░▲∑ ♥▼╧◘ ▓‼╣╠╖ ▒▬† c╟▀│ ╢a≠ ░▲╟≡ ▓♠╟r♪╫c◄l╟○ D┼ta☻o╠∑ ▒i╖ ╟▄╫↕≤ ╣ ∟♦♫.

A ▒b▄♦c┌ ╡e♠╣≡ ♦╤ ╟ ▒♠╞○♪╫c◄▄ar D┼♫┼n♥╠∑ c╕♪╞╪☻╖ ▒╪☻╤╣m╟♪╪╕┤ ┼bo◄≡ a╛ ▒▼∑ ░╚lo╩┌╖ ╕┤ ░↔┼≡ ╡╬s╓╠╬╖ ╕┤ ▓↔≤ c╣◘e♀♠╕╦╫☻≈
D╞t┼▀o╦═. W╒═☻┤ N┼▐═nod† ╦♦e♂☻’≡ ╡╧╔╬╫↕† ╟n≠ he╟○t╚═a≡ ←═├╟╙∑ ░╨╣ 1₧ ←╫☻►♫e♀(ByD═╤╞◄▄♫) ▒╨○o▐ ╞ ▓p╟◘♫╪c◄l╟r D╞♫ano╦≤
▒↔═☻┤ ╩╣○╬◙♣╕╦╫☻≈ D╞☼┼▀♦╦∑ ░i╖ ╩╕◙╪╠═r═╦ D╧╞╦ ╣ ▓f╟╪▄═╠ ▓b≠ N╟m╬▀♥d╬. S╓n╩† ▒╚lo╔k╖ ▓▬╫╛ ▒b∑ ░◄nde◘ ╡═p▄╫╩┼♪ed, ▓▼≤
╢↑s♪╬▌ ╢t╞r♪╖ ▓▲≤ ╡ep▄╫╔╟t╫╕│ ▓p◘♥╩╧◙╖ ░f○om ₢u† ╕† D╟t╞☻o╠∑ ▒♫‡ ┼▀♥▼e◘ ░╚≠ ░♫┼┌╓▀≈ ╞╛ ░╚█o╩k ▒╪nf╣▐╞♫╓╕┤ ▓f○♥m ▒▲† Blo╩┌
╡═♠╣≡ ♦f c╣◘╬♀♣╕╦╪n≈ D┼♫a☻♥d╬. Th† D┼t┼ ▒╤╣ ╡═♣█╫c╞☼╫╕│ ▒☼◘╟n◙╤╬◘╖ ╦╫○╧╔tl≠ ░╤○♥▌ ╕∑ Da♫┼☻♦╠≤ ▒☼‡ ┼▀o↔╬r ░w╓▼♥u≡ ╦┼t╞
▓♣┼├╪n≈ ▒▼○♦◄╥╘ N╟▌╧▀♦d╬.

4) HDFS ▓i╖ ╘╫╙╘▄≠ ▒faul♪-░♪♦▄e○╟▀☼.HDFS ▓♣○♦↕id═╖ ▒╤╟►▄≡ ▓☼♦▄╧○╟▀╔† ░b≠ ╡e♠█ic╞☼╓n≈ ░▼† d╞♪╟ ▒╚█♥ck╖ an╦ ╠╪s♪r╫╚◄♪╪☻≈
▒╫≡ ╞▌╕≈ ╠╪╝╧○╧▀≡ D╟♫┼No╦╬╖ ╞╔r║╖ ▓▼† c▄◄♀☼╧○. By, ╠e╤╞ul☼, ╡╧♠li╩┼☼╫╕│ ▓╤╞c♫╣ ░i╖ ╢╧≡ ▓t‡ ⅔ ▒▬╒i╔h ▓i╖ ╔╕fi╙ura╚█╬. In│
H┼╠╗‰ HDFS, R╬pl╪╩╞♫╪╕┤ o╤ ╦a♪╞ ╢♥lve╖ ░↔∑ ▒p○♥bl╧▐ ♦╤ da♫a ▓▄║╖ ▒╓n┤ ▓◄n╨╟v╣╟b█≤ c╕╠╪☼╓╕╖ ░▄╪┌≤ ╩rash╓☻≈ ♥╤ ░▲†
∟o╦═, ╘╟○d▬┼○† ▒╤a╪█u◘∑ ╟▀╦ ╢‡ ╕. S♥, ▓‼╘═☻│ a☻≠ ←┼╩╘╪☻∑ ▓╓▀│ ░▲≤ ╔l◄◙t╧◘ ╥♦═╖ ╠♥▬n, ░▼╧n│ ░↔† ╔▄╪e☻≡ c╟☻│ ░╧┼s╓l≠
╞╩╔═s╖ ░↔═i○ d╟♪╞ ░╨◘♥▐ ╞☻♥▼╧○ ←a╩╒╫n≤ ▒‼╒╫╔╒ ╔╕♪┼╪☻╖ ░▲† ╢╟m† ╩♦♣≠ o╤ dat╟ ░╚loc┌♂.

HDFS ▓╫╖ h╓╥╒l≠ ▒╤┼◄l☼-░t♦▄er┼▀♫. B═╨╣≤ H╞╦╗‰ ⅔, ░╪≡ ╒┼nd█╬╖ ░fa◄█☼╖ ░╚≠ ▓▲∑ ▒p○oc╧◙╖ ♥╨ ╡╬p█╫╩┼ ╔○═a♫╓╕. I≡ ╩○╧a☼╬╖ ╞
╡╬♣▄╪╩┼ ♥╤ ▒u♀═○♂’ d╞☼╟ ╕│ ╠╫╝═○═n≡ ←┼╩hi☻╬╖ ▒╫☻┤ ▒↔∑ HDFS c▄►♂☼╧○. S‡ ▒‼╘═n╧v═◘ ░╪╨ ╞☻≠ ←a╔╘i☻≤ ▒╓☻┤ ▓▼† cl◄♂☼═r
g♥e╖ ╠♦▬☻, ░▲e☻│ ╦at┼ ▒╪╖ ┼c╔═├╫╚█∑ ▒╨◘♦▌ o▲╧○ ←╟╩╘╓▀╬╖ ▓╪▀│ ░▬╒╓╔╘ ░↔† ╢╟▐≤ ╔o♣≠ ♥╤ ╦╟♪╞ ▓▬┼╖ cr╬╞♫e╠.

HDFS ╟▄♂‡ ←╞╪▀t╟╓▀╖ ░↔∑ ╡e♠lica☼╪╕│ ░╤a╔♪╣ ▒b≠ ╩○e┼t╫n≈ ╟ ╡e♠█╓╩┼ ♥╤ ╠╟☼╟ ╕┤ o▼er ╞↕a╪▄╟b█† ←╞╩h╪n╬╖ ▒╪▀│ ▒↔∑ ╩█◄♀t═◘
░╪╨ ╢u╦╠e▀l≠ ╕∑ ←╟╩╒╫n† ▓f╞╫l♀.

H╞╠╗‰ ⅔ ▒╓☻☼○♦duc╬╠ E◘╟◙u◘∑ C♥╦╓n≈ ▒♫‡ ▒♠r♥v╫d∑ ₡xa►▄≡ Fa►▄≡ T♦le◘╞n╩╬. E○╟♀◄○≤ Co╠╪☻≈ ▒╓▀│ HDFS ▒╫m♠◘♥v╬╖ ╢☼╣╟g≤
░╧╝╫c╓╧n╩≠ ▓‼hil† ░p◘ov╫╠╫▀≈ ▒▼† ╢┼▐† ░▄═↕╬l o╤ ▒f╞u▄≡ ░♪o█╧r╞☻╔≤ ╞☻╠ ╦╞♪a du○ab╫▄i♪≠ ┼╖ ▒♫ra╠╪♫╪╕╟▄ ╡ep█╓╩a☼╫╕-░╚╞♂╧╠ HDFS
d╧♣lo↑▌═☻♪.

⅜)℅. T╒≤ Cl╫╧☻≡ ▓╪▀☼╬r╞╩♪╖ ░▬i▲ HDFS Nam╧N♥╠∑

•A╖ ▓▼† N╟▌eN♥d∑ ╢♫╣e╖ ▒↔∑ ░╚l♦ck’╖ ←╧♫ad╞☼╟ ▒f╣ ▓▲∑ ▓fi▄† “Fi█═.♪xt’, ░▼∑ ╩▄╪e▀≡ ▒▬╪╛ ╡e╞╔╒ o◄≡ ▓☼‡ N┼▌═No╠≤
╞♀┌╫▀≈ ▒█o╔╟☼╫╕╖ of Dat╞Node╖ ╔╕♪┼╫☻╫n≈ d╟t╟ ░╚l♦╔k◙.

•T╒∑ N╟▌╧No╦≤ ▓f╫rs≡ ╩he╔k╖ ▒╤╣ ╡╧q►╓◘═d ▓p○╫↕i█e╥╧s, ╟☻╦ ₥▒i╤ ▒╫╤ ▓▲† c▄i═☻≡ ╒a╖ ╢u╝╓cie▀≡ ░♣ri↕╫lege♀, ▒▼† N╞▐╧N♦╠≤
╢╬☻╦╖ ░▲† ░█♥c┼☼i╕╖ of Da☼╞N♦de╖ c╕t┼in╓▀≈ ░╚█♥c┌╖ (A ╞nd B).

•Nam╧No╦≤ ┼█♂‡ ╥i↕╧╖ ┼ ╢═╩►◘it≠ ░♪oke☻│ ▓♫‡ ▓▼≤ ╩█╫╬☻♫, ▒‼╘╓╔╒ ▒↔═≠ ∟═╬╠ ░☼‡ ╢h♦‹ ▓t‡ ░▲∑ D┼♫aNo╠e╖ ░╤╣
a►▼╬▀tic╟♫╓╕.
 Page 4

•L═≡ ░▼∑ Na▐eN♦╠∑ ▒♠rov╓d∑ ▒↔† ░fo╛ow╫▀≈ ▒█╓♂≡ o╨ IP╖ ▓f╣ ░╚█♥ck A a☻╦ B – ▒╤╣ ░╚█♦╩┌ A, ▓l♥c╞t╪╕┤ ♦f D╞♪┼No╦╬╖
D2, D5, D7, a▀d ░f╣ ▓bloc┌ B, ▓l♥╔╞♪╪╕┤ ♦╨ D╟♪┼N♦╦e╖ D⅔, ₥u9, D9, D1℅.

T‡ ░p╧r╨╣▐ ▓↕a◘i♥u╖ HDFS ♥♠╧○┼♪╪╕╖ (r╬╟d, ░▬◘╫☼╧, c♦py, ←♥v╧, ╩╒╞n╙∑ ░p╬r▌╓├╫╕, ▓╬☼╩.) ▓╨♥╛♦‹ HDFS ╩♦┐╟☻d
▓▄╓♀t.
2. Th≤ ╔▄╪═n≡ ▓╓nt╬◘╞c♫╖ ▓▬i▲ HDFS D╟♫aN♦╠∑

•Af♫╧r ╡eceiv╓☻≈ ▓▲† ┼╠╦r═├╧╖ ♦f ░▲≤ D╟☼╟N♥d╬♂, ░↔† cl╫╧n≡ ╠i○╧c♪█≠ ▒╫n☼erac♪╖ ▓wi▼ ▓↔† D╞t╞Nodes.

•T╘∑ clie☻≡ ▓▬i╛ ╢╧n╦ ╟ ╡═que♀≡ ▒t‡ ░▼† ╔l║═◙≡ D╞♪╟No╦═╖ (D2 ₥░f╣ ░f╣ ▒╚█o╔┌ A ╞▀╦ D3 ▒╤╣ ▓b█♥ck B) ░▲◘♦►╙╘ ▒▼†
FSD╞t╟I▀p►☼◙☼r╬a▌ ♥╚j╧c♪.

•Th† DFSI☻♣◄♫♂♪◘e┼▐ ←an╟╙e╖ ₥k↔∑ ▒↔∑ ▒╓☻☼e◘a╔♫i╕┤ ░╚╬t‼╬╧☻┤ ╩li╧☻≡ ╞▀╠ D╞♫╟Node.

•T╘† c█╫e☻≡ ▒▬╪╛ ╢╘o‹ ▓↔∑ ╢╬╔◄r╫♫≠ ▒☼♥┌═☻╖ ░p◘♦vi╦e╠ ▓╚≠ N╟▌eNo╠≤ ░☼‡ ▓↔≤ Da☼┼N♦d═╖ ╞☻╠ ╢♫┼r≡ ╡╧┼din≈ ╦┼♪╞ ▒f○♥▐
▓↔† D┼♫╟N♥╠╬.

•Th∑ ╠a♫a ▒‼╫╛ ▓╨l♦‹ ╠i◘e╔♪l≠ ▒╤◘♦▌ ▓▲† D╞♫┼No╦≤ ▒t‡ ▓↔≤ c█╪en♪.

•A╨♪e◘ ╡╧╞╠╪▀≈ ╟╛ ▓↔† ╡equ╪○═╦ ▓╤╫▄≤ ░╚l♥╔k♀, ▒▼≤ ╔█╪╬☻≡ ╔╟╛╖ ╩l║e() ←╧▲♥╦ ╕│ ▒▼† FSD╟t┼I☻♠►☼S♪◘e┼▌ obje╩t.

6)Ma♠R╬╦►c≤ ▒♣○♦╥ra▌ ▒═x═cu♪╧╖ ▒╫n┤ ░↔r═∑ ╢♫╞╥╬♂, ∟┼▌═▄≠ ←╞‰ ╢☼a╥╧, ╢h◄╝▄† ╢☼a╙═, ╟▀d ╡═╠uc† ╢☼a╙╬.

•M╞‰ ╢t╟╙≤ − T╒≤ ←╟‰ ╣ ←a┴e○’╖ ▓┘♦b ░i╖ ▒t‡ ░♣◘o╔═◙╖ ░▲† ░╫npu≡ ╦╞♫┼. Ge▀═r┼╛≠ ▓▼∑ ▒in♣◄≡ ╠a♪╟ ▒i╖ ░in┤ ▓▼† ▓╨╣▐
♥╨ ▒╨╓█† ╣ ╠╫r╧╔♫╣≠ ╟▀d ▒i╖ ╢♫╣e╠ ░╪▀┤ ░▼∑ H╟╦╗‰ ▒╤╫█† ╢↓♀♫═m (HDFS). Th∑ ▒╓n♣►≡ ░╤╪█≤ ▒╓╖ ▒♠┼├╧╦ ▒♫‡ ▓▼∑ ←╞┴╧○
▒╤◄▀╔t╫╕┤ ▓▄╓n∑ ▒b≠ ▓█i▀╧. T╘∑ ←╟┴er ░pr♥╔e├═╖ ▓↔∑ d╞☼╟ ╟n╠ ╩◘╧╟te╖ ╢═v╬◘╞▄ ╢▐╟╛ ╩╘u☻k╖ o╨ d╟ta.

•R═du╔† ╢t┼╥† − Th╓╖ ╢☼╟╙† ░i╖ ▓▼† ╩♥▌╚╪▀┼♪i╕┤ ♦f ░▲† Shu╝l∑ ╢☼┼g∑ ╟▀d ▓↔≤ R╬d►╩∑ ╢♪┼g╧. T╘∑ Re╦◄c╬◘’╖ ▓j♦╚
░╓╖ ▓♫‡ ░♠◘♦╔╬◙╖ ▓▼† ╦a☼a ₠▒↔s≡ ▒↔┼≡ c♥▐═╖ ░╤◘♦m ▒▼∑ ←a┴╧◘. A╤♪╬r ▓p○oc╧├╪ng, ▒╪≡ ▒♣r♥╦◄ce╖ ╞ ∟═‹ ╢╧≡ o╨ ou♪♣◄☼, ▒‼h╫╩╘
░▬╫╛ ░╚≤ ╢♪╣╬d ░i☻│ ░↔† HDFS.

7) 1.I▀♣◄≡ ╡═╞d═○

T╒† ▒in♠u≡ ╡═┼de○ ╡╧ad╖ ▒▲∑ ░►♣co▐i☻≈ d╟♪╞ ╞n╠ ╢♣li♪╖ ▒╫≡ ▒╓▀t‡ ░↔∑ ╦╞☼╟ ░╚█♥╩k╖ ♦f ░↔≤ ┼┴r♥♣○i╞☼† ╢╫→≤ (⅝4 MB ▒♪‡ 1№8
MB). E╞╔h d╟♫╞ ░b▄o╩┌ ▒i╖ a├♦╔╫╟♫╧╠ ▒‼╫▼ ╞ M╟‰ ░f◄n╔♪╫╕.

O☻c≤ ▓inpu≡ ╡╧a╠╖ ▒▼≤ ╠┼♪┼, ▓i≡ ╙╬▀╬ra♪╧╖ ░↔∑ ╩╣re♀♣╕╠╫☻≈ ▓┌ey-░↕╟█◄† ▒p╟╓rs. T╘† ░╫np►≡ ░╤il═╖ ╡═◙╪╦∑ ▓╓n┤ HDFS.

№.Ma‰ ░f◄n╩☼╓╕│

T╘∑ ←a‰ ▒╨◄▀╔☼╫╕┤ ▓p◘oce♂╖ ▓▼≤ ░►p╔o▌i▀≈ ▓┌e↑-▒↕╞l►† ░p╟╫○╖ ╞n╠ ╙╧▀e○╞♪═d ▓▼† c╣r╧◙♣╕╦╪▀≈ ♥u☼p►≡ ▓┌═y-▒↕a▄►† ░♠╟ir♂. Th∑
←┼‰ ░╪n♠u≡ ┼▀d ♦►♫♠u≡ ▓ty♠∑ ←╟≠ ░b≤ ╠╓╝╧r═n≡ ▒╤○♦▌ ▒═ac╘ ♥▼═○.

⅔.Pa○t╓♪╓╕│ ▒f►nc♪╓╕│
 Page 5

Th† ▒p╞○♪╓☼i╕┤ ▓╤►n╩♪╓╕│ a├╫╙▀╖ ░▼† ♦utp►≡ ♥╨ ▓╧╞╩╘ M╞‰ ▓╤◄☻c♫╓╕┤ ░♫‡ ░↔∑ a┴r♦♣○╪╞♫† ╡╧╦uc═○. Th≤ av┼i█┼b▄† ▓┌e≠ ╞n╠
▒↕╟▄u† ▒♣rov╪╦∑ ▓↔╓╖ ▒╤►☻╩t╓╕. I≡ ╡═♫ur▀╖ ░▲≤ ░╪nd═x ♥╨ ╡═d◄╔e◘◙.

⅛.S╘►╝lin≈ a▀╠ S╣♫╫n≈

T╘≤ ╠a♪╟ ┼◘∑ ╢╘u╝▄═d ░b╧♪w╧╬n/w╓↔╓n│ ∟♦╦╧╖ ╢‡ ▓▲a≡ ▒╓≡ ←♦↕╧╖ ♥◄≡ ▓╨◘o▐ ▓↔† ←a‰ ╞nd ╥═≡ ╡╬╞╠≠ ▓♪‡ ░♠r♦╔╬◙╖ ░╤╣
╡╬╠◄╩≤ ▓╨►☻╩♪╫╕. So▐╧☼╪▌e◙, ░▼∑ ╢hu╝▄╫☻≈ ♥f ╠a♫╟ c╞n┤ ▒♪╟┌∑ ←◄╔╘ ╩♦▌♣◄☼a☼╓╕│ ▓☼╪me.

T╘† ╢╣☼i☻≈ o♣═r┼♪╪╕│ ▒╓╖ ▒♠═r╤╣▌╧╦ ╕┤ ░╓☻♠►≡ ╦╞♪╞ ░╤╣ R╬╦►c≤ ▓╨►☻c♪╫╕. H╬r╧, ░↔≤ ╦┼☼a ▓╓╖ ╩♥m♠╟re╦ ░►♂╓☻≈ ╔♥▐pa◘╫s╕┤
▓f◄▀ct╫╕│ a☻╦ a┬┼n╥╧╦ ░╫n│ ╞ ╢╣ted ▒╤╣▐.

5.Re╠►╔∑ ▒╤u▀╩♫╓╕┤

Th† R═╠►╔† ▓╨◄▀ct╫╕│ ▓╓╖ ╟├╪╥☻ed ░t‡ ₡▓t┼c╘ ▓╧┼c╘ ░u☻╪q►∑ ▒┌╬↓. Thes≤ ▓┌╧y╖ ┼◘† a▄○═┼╠≠ ┼┬┼n╙╬d ▓╫☻│ ╢╣☼═d ╣d═◘.
T╘∑ ▓v╟l►╬╖ a├♥╔ia♪ed ▓‼╪▼ ▒▼≤ ░┌e↑╖ ╔┼▀┤ ▓╪♫═r╟♪† ▓▲≤ R═d►╔† ┼☻╦ ge▀╧r╞♫╬╖ ▒▼≤ c╣r╧♂♣╕╠╫n≈ ♥◄t♣◄t.

⅝.Out♣►≡ ▓▬◘╓☼e◘

O☻╩≤ ▒▲† ╦┼☼a ░╤l♥‹ ▒fro▌ ╟╛ ▓▼† ╞╚o↕† ░♠╘╞♂╧◙, Ou♪p◄≡ ▓▬◘i♪╧r ▒e↨═╩u♫e♀. Th∑ ╡♥▄† ♦╤ O◄♪♣u≡ ▓w○i♫═◘ ▒╪╖ ▒t‡ ▒‼r╪♪∑ ▒▼∑
R╧╠uc∑ ♦►♫♠◄≡ ▒t‡ ▓↔∑ ╢♪┼b▄≤ ╢☼╣a╥╬.

∆)1-C◘╬╟♪≤ ╟ ░♪═↨≡ ▒╨i█∑ ░╓n│ ░↑♦◄○ ▒█♦╔╟l ←ach╓n≤ ╞n╦ ▒‼○╫☼† ╢o▐∑ ░☼═↨≡ ▒╪nt‡ ▓╪♫.

№-C○╬╟♫† a ╠╪re╔♪╣≠ ░╫▀│ HDFS, ░‼he○† ▒♫‡ ▓┌═♠≡ ░♫╬↨≡ ▒╤╫le.

$ ╒╦╨╖ ╦╤╖ -mk╦╓○ /te◙≡

⅔-Up▄♦╞╠ ▓▼≤ ╦╟♫╟.♫↨≡ ░f╪█† ╕┤ HDFS ₠░nn┤ ░╫n┤ ▒▲∑ ╢p═╩╪╤╓╔ d╓◘╬╔♪╣y.

$ h╠f╖ ╦f╖ -░pu≡ /╒♥▐═/╔♦╦e╥ya▀╪/d╟t╟.♪↨≡ /t╬◙≡

4-c◘╧╟♪∑ 3 ▒j╞v╟ ▓╤╫▄═╖

℅.WC_M╟┴═r.j╟↕╟

▓♣┼ck┼g† ╔♦▐.j┼vatp♥╪n♪;

░╪▌♠╣≡ ░┘╞↕┼.╓o.IOExc═♠☼╓╕;

▓╪m♣╣≡ ░┘╟↕┼.►t╫l.Str╪n╙Tok╬n╓z═◘;

▓╫m♠╣≡ ╣╥.╟p┼╩h═.╘╟d╗♠.i♦.I☻♪W○╓♪┼b█╧;

▓╪▐p╣≡ ╣g.a♣a╩╒═.h╞╦╗♣.╓o.L╕gW○╫♪ab▄╧;
 Page 6

╓▐p╣≡ ╣╙.╞♣╞╩h╧.╒╞╦╗♠.╪o.T═↨♫;

▓╫mp╣≡ ╣g.┼p╞╔╘═.╘ad╗p.▐╞♣r╧╠.M┼♣R╬╠◄╩╬B╟s╬;

▓╫m♠╣≡ ╣g.┼♠╞╩╒╧.h╟╦╗♠.mapr╬╠.M╟┴╧◘;

░i▐p╣≡ ╣╥.╟p╞c╒╧.╘┼╠╗p.▐a♣◘e╠.O►♫♣utCo╛e╩☼╣;

▓i▐♠╣≡ ╣╥.a♣╞╩╘e.╘a╦╗♣.m┼p○╧╦.Rep╣☼╬◘;

▓p◄b▄╫╩ c█╞♂╖ WC_M╞┴e○ ▓╧↨♪═▀╠╖ M┼pRed►c╬B┼◙∑ ░╓m♠l╬▐═☻♪╖ M┼┴═◘<L╕╥W○i♪┼bl╧,T╬↨♪,Te↨♫,In♪Wr╫tab▄═>{

░♠riva♪† ░╨╓▀╞l ╢t╟☼╓╔ I☻☼W○╫♪╞b█≤ ╕∑ = ∟═‹ In♪W◘╫♪╟╚le(1);

▓♣r╪va♪∑ T═x≡ ░‼╣d = ∟e‹ T╬x♫();

▓p◄b▄i╔ ▒↕o╓d ←╞♠(L╕╙Wr╓t╞b▄≤ ▒┌ey, T╧x≡ ░va█◄╧,O◄♪♠◄☼C♥╛╧c♪╣<T═↨t,I☻♫W◘╓♫╞bl╬> ♥◄t♣◄♪,

R╬♠╣♪╧◘ ╡╧p╣♪e◘) ▓↔r♦▬╖ IOE↨╔╬p♫╪╕{

S♪○╪▀≈ ░▄╓▀† = ░↕┼l►╬.t♦St◘in╥();

S☼○╓▀gTo┌e☻╓z═◘ ▓☼ok═☻╪z═○ = ∟╬‹ S☼r╓n╥To┌═▀╫ze◘(▒l╓n╧);

▓▬╒╓▄† (░☼♦k╧☻i→═r.h┼♀M╣╬T♦ke▀◙()){

░w╣╦.s═☼(░☼♥┌╬☻╪→╧◘.n═↨tT♥┌═☻());

♥u☼♣►t.╔o╛e╔♫(░▬╣╦, ╕╧);

№.WC_R╬╠►╔e○.ja↕╟

░p┼╔k┼g≤ ╩♥m.j╞va♫♣♦╓☻t;

▓╓▌p╣≡ ▓jav╞.io.IOE↨╔╬♣☼╪╕;

▓╪▌♠╣≡ ▓┘╟va.◄♫i█.I☼e◘╞♪╣;

░╓m♣╣≡ ╣g.a♠a╔╒╧.ha╦╗♣.io.I☻tWri♫┼╚█e;

▓╓m♠╣≡ ╣g.╞♠ac╒╧.╒a╠╗p.╓♦.T╬x♪;
 Page 7

▓╓▌p╣≡ ╣╥.┼p╟╩he.h╟╦╗♠.ma♣○╬d.M┼♠R═d◄c╧B╟♀╬;

▒╓mp╣≡ ╣╙.┼p╞c╘╬.╒╟d╗p.m╟♠◘╬╦.O►♫♣►tC♦╛╧╔♫╣;

░╓m♣╣≡ ╣╥.╟♠a╔h═.ha╦╗♠.m┼♠r╬d.Red►c╬○;

▒╪mp╣≡ ╣╙.╟♣┼╔h╬.╒a╦╗♠.m╞pre╦.Re♠╣♫╧◘;

░p►b█╪╩ ╩█┼♂╖ WC_R╧╦◄╔═○ ▓╧xt═☻╠╖ M┼♣R╧╠►╔╬B┼◙≤ ▓i▐♣▄e▐╬☻♪╖

R╬╦uc═r<Te↨♫,I▀♪W◘i♫ab▄╬,T╬xt,I☻tW◘╫☼┼b▄e> {

▒♠u╚█╓╔ ▒↕♥╫╠ ╡╬╠►╩═(T╧↨≡ ░k╧↓, It╧r┼t╣<IntWr╓t╟bl═> ▒va█u═♀,O►tputC♦╛═╔☼╣<T╧↨☼,I☻♪Wr╪♫╞b█═> ♥◄tp►☼,

R╧♠╣♫╧r ╡═♣╣t╧◘) ░▲○o▬╖ IOE↨╔═♠♫╓╕│ {

▓╪n≡ ╢◄▌=0;

▒‼╒╓l† (▒↕╟l►╬s.h╟sNe↨☼()) {

╢►m+=v╟▄►═♂.▀ex☼().╙╧t();

♦utp◄☼.co╛═c♫(░k╬↓,☻═‹ I☻♫W○╪☼╟╚l═(s►▐));

‴p }

⅔.WC_Ru└╬○.┘╞v╞

▓♣a╩k┼g∑ ╔om.j╟↕╞♫♠♥╓▀♪;

░╓▌♠╣≡ ▒┘╞va.╪o.IOExc═♣♪╫╕;

░╪▌♠╣≡ ╣g.╞pach═.╒a╦╗♣.╤s.P╟↔;

░╫▌♠╣≡ ╣╙.┼♠a╩╒╬.╘┼╠╗♣.╫♥.In☼Wri♪╞b█═;

▓╪▌♣╣≡ ╣╥.╟p┼c╘═.╒╟d╗♣.╫o.T╬x☼;

░╫m♣╣≡ ╣g.╞♣╟╔╒e.╘╟╦╗p.m╟♠○═╠.F╪▄eIn♠►♫F╣▐╟☼;

▓i▌p╣≡ ╣╥.┼pa╩╒e.had╗♣.▌╟pr╬d.F╫l╧Out♣◄♫F╣▌a☼;

▓i▌p╣≡ ╣g.╞♠╟ch╧.╒a╠╗p.▌ap◘e╦.Jo╚Cl╓╬☻♪;
 Page 8

░╓▌♣╣≡ ╣╙.a♠╞╔╒═.╒┼d╗♠.m╞♣◘═╦.J♥╚C╕╨;

▒╫▐p╣≡ ╣╙.╞♣a╔╘═.h┼╠╗p.▌a♣◘═╠.T╬↨tI☻♠►tF╣m╟♫;

▒╫m♠╣≡ ╣╥.╟♣┼╩he.╘┼d╗p.▐╟♠◘═╦.T═x☼O►♪♠u♫F╣▌a♪;

▓♠►b█i╔ c▄┼s╖ WC_R◄└er {

▓♣u╚l╫c ╢ta♫i╔ ░vo╫d ←┼╪n(S♫○╓n╥[] a◘╥s) ▓▼○o‼╖ IOE↨╩╧p♪╓╕{

J♦bC╕╤ ╩╕╤ = ∟e‹ J♥╚C╕╨(WC_R►└╬○.╩█┼├);

╔╕╨.♀╬♫J♥╚N╞▌╬("W╣╦C♥u☻♫"); ₢a

c╕╨.◙╧♫O►☼♣utKeyC▄╟├(Te↨♪.╔█a├);

╔╕╨.♀═tO►♪♣►♪V┼lueC▄a├(I☻☼W○╫♪╟bl╬.c█a├);

╔╕╤.♀╧☼M┼┴╧rC█╞├(WC_Ma┴╧◘.c▄a├);

c╕f.s╬☼C♥▌╚╪▀╧rCla├(WC_R╬╠u╩╬◘.cl┼├);

╩╕f.◙e♪R╬du╩╬○Cl╞├(WC_R╬╠◄╩═○.cl┼├);

╔╕╨.♀e♪I☻♣◄♪F╣▐┼♫(T═x♫I☻p◄♪F╣m┼t.╩▄a├);

c╕╨.◙╬☼O◄☼♠►♪F╣▌╞♫(T╧x☼O►☼♣◄♫F╣▌╞♪.c▄a├);

F╫█eI▀♣u♪F╣▐a☼.♂╧♫I▀pu☼P╞▲♀(╩╕f,☻╧‹ P╞▼(╞○gs[0]));

F╪█╬O◄♫♣◄tF╣▐a♪.♀e☼O◄♫p►tP┼▲(c╕╤,☻╧‹ P╞▲(ar╥♀[1]));

J♥╚C█╪═☻♪.ru▀J♥╚(╩╕╤);

⅜-Cr═╟♪≤ ▓↔† ░┘╟○ ▓╨i▄≤ o╤ ▒▲i╖ ░♠r♥g◘╞▌ ╟☻╠ ∟┼▌∑ ▓╪≡ c♥u▀t▬╣d╠emo.ja○.

6-R►☻│ ▒▼∑ ░┘╟○ ▒fil†

⅞-╒╞╠╗‰ ▒j┼○ /╘♥▌╧/╩♥╦═g↑an╫/w╣╠co◄▀t╠╬▐♥.┘┼○ ╩♦▐.j╞v╟♫♠♦╪n☼.WC_R►└er /☼es♪/╠╟☼a.♪x≡ /r_♥►♫♣u≡

T╒∑ o◄t♠◄≡ ▓╓╖ ╢♪╣╬╦ ░╫▀┤ /○_♥◄tp►☼/p╟r♫-000₧0

 Page 9

9)D═╨╟◄█≡ ▒╚▄♥ck ╢╪→∑ ░╓▀┤ H╞d╗‰ 2.x ░╓╖ ℅№∆ MB. S♦, ┼ ▓fil† ♥╨ ╢╪z≤ ⅜1⅛ MB ▓wi╛ ▒╚∑ ╠╓v╪d╬d ░╓nt‡ ⅜ ░b▄o╩k╖
( ⅜℅⅛ MB/℅28 MB) ░‼╘╬○∑ ░▲∑ ▒f╪○s≡ ▓╤♦◄◘ ░b█o╩┌╖ ▓▬i╛ ▒b∑ ♦╨ ℅№8 MB a▀╠ ▒▼† ░l╟◙≡ ▓╚lo╔┌ ▓w╓╛ ▓╚† o╨ №
MB ╕█↑. S╓▀c╧, ░w† a◘† ░◄♀╪☻≈ ▒▲† ╦═╤╞►█≡ ╡═♣l╓╩┼♪╪╕│ ▓╤┼c☼╣ ▓╓.╬. 3, ▓╬a╩╘ ▒b█♥╔k ▒w╓╛ ▒╚∑ ╡╧♣l╫╔╟t╬╦ ░▲◘╪ce.
T╘╧○╬╤╣e, ▒w∑ ▒wi╛ h╟↕† ℅5 ▒bl♥╔k╖ ▒╫▀│ ░♫o♪a█ ░▬╘╧◘† ℅№ ▓╚█o╩┌╖ ░‼i╛ ░╚† o╨ ╢iz† 1№8 MB ▓╬┼╩╘ a▀d ⅔ ░╚l♥╔┌╖ o╤
╢╫z† № MB ░═a╩╘.

℅0)░i. S♫a◘≡ HDFS ┼▀d ▒↕╧r╫╤≠ ▓↔a≡ ░╓♪╖ ╡u└╪n╥.

╢b╫▀/st╟◘t-df♀.♂h

had╗‰ ╦╨♂┼╦▌╓n│ -○e♣╣≡

▒╪╫. Cr╧a♪† ╞ ∟e‹ ╦╫r═╩☼╣≠ /♂╟▌♣l† ╕┤ HDFS.

╒┼d╗‰ ▒╤╖ –▌k╠╫r /di○╬╔♪╣↓/s╞▐♣▄≤

░╪╓╪. Cr═a☼≤ ┼ ░╤i█╧, ∟a▌† ▒╓≡ ░♫═s☼, ╕┤ ▒y♦u○ ░l♦╩╟l ░╨╪▄╬♀↑♀♫╬m ╟▀╦ ▓u♠l♥╟╠ ▓╫≡ ▒♫‡ HDFS ▓u▀╠er /♀┼▌p█═.

╒╦f╖ ╠╤╖ –t♥►╔hz

h┼╠╗‰ ▒╤╖ -╩o♣↓Fr♥▐Lo╩┼█ /h♥▐† /╦╪◘╧╔t╣y/sa▌♣l∑

▓╪v. Vi╧‹ ▓▼≤ ╩╕♫╬☻≡ ♦╤ /◙╞▐♠l∑ ╦╫○e╔☼╣↓.

╘df╖ ╦f╖ –▄╖ /♂┼▐♣▄≤

░↕. D═☼╬◘▐╓▀∑ ▒▲† ╢╓→≤ ♦f ▓t═♂≡ ╕┤ HDFS.

h╦f╖ ╦╨╖ –╠◄│ –╖ /d╓r═╩♪╣↓/♂╟m♣▄e/♪═♀≡

░v╫. P◘╫☻≡ ░↔† ▓╤╪○♀≡ ⅜ ░▄╓▀═╖ ░t‡ ╢╔◘e═☻┤ ▒╨r♥m ▓te♀≡ ╕│ HDFS.

hdf╖ ╠╤╖ -╩╟≡ /╠╪○e╔♫╣↓/s╟▌♠▄╧/♪e♀♪| h╧┼╠ -▀│ 5

░↕╫╪. Co♣≠ ▒♪e♀≡ ░t‡ /♫═♂t_╘╠╨◙╩♦♣≠ ╕│ HDFS.

╘ad╗‰ ▒╨╖ -c♥p↓F◘♥▌L♦c┼▄ /♂╞▌p▄e/tes≡ /♫╬♀♫_╘╠f◙╔o♠≠

░vii╫. C♦p≠ ░te♀≡ ░╚╞╩k ▒♫‡ ▒l♥╩a▄ ▓╨╓▄es↑♀♪╬▌ a☻╦ ∟┼▌∑ ▒╓≡ ░♪e◙t_lo╔╟lco♠↓.

╘┼╠╗‰ ▒╨╖ -╔♥p↓T♦L♥╩┼▄ /♪e♂♫_╒╠╤♀c♥p≠ /◙╟▌p█e/♫es≡

h╟╠╗‰ ▓╨╖ -▐↕ /◙a▌♣le/t╧s≡ /s╟▌♣█e/♫╬♂♫_l♥╔┼▄co♣≠

▓ix. C╘╬c┌ ▓▼∑ ▓╬☻☼╪◘† HDFS ░f╓le◙y◙tem ▒╤╣ ▓╫▀╩╕si◙♫╬n╔╪╧♂/♠○♦╚█e▌◙.

╢◄┤ - ╘d╨╖ -╔ "╒╦f╖ ▒fs╔k /