Video compression makes big gains New reson in space f known a nire-fume | Aletta dw oper New standards for video | Presi whe compreson'n ine | ony compre grt any sb compression plus new IC _| tstediaes rane compression, Genery, | ane tets recone ages ut wee : ttle ht sieve high emprenan | ended wih a2 compression to se chips will change the world \‘0'Gon to 30:1 for mages and 501 to | bard distinguish om the ona. Video of computing, broadcasting, | 20 teste any tat recon at, ven ser compression rales : nctsaaaareet ere tert, | 10, canbe Secomprcsaed with cove and communication Toles meds doc batthreom. | ag eran guy perouoraare rower estan: | SUMBAROS. ck open standards cul itty escded video in| ferthan 3 Sch ecmgiare asd ny | Son te rth of eect wn Stace alloc. incetne applets such wmedcalin | appease Tee dig veo stands REGEN croton | aes For ou, anes inteted by | athe heen rope are eat Po Zalusieconng sn, | soy arti nin an ay dogs | topaphic Experts Grup OPEC) Santé SSRs Sow technology | nay suas ancoret erp an | fra pre compres: the Const romises to anleah'a |e the dag ofa medal conan, | tie Cmts on herman Tephoy ln sew of ides apie | Comets far eommercal dual and | anelegphy (ITT Recommendation Sissons | smerny ina | #0 ie emi at Vigial laserdisc, lectronc camer, video- preferred becase the save on storage and | Moving Pictures Experts Group (MPEG) for ‘one and -conerencing system, image and | Communication bandwith fulhmation compression on digital storage Interactive vdeo tols on personal com. | These les algrithms iso general ex- | media (DSM). puters and werkstatons, progam delivery | plitapects ofthe aman vil system. For | JPEG's proposed standard is a sill» | (On cable and satelite, and high definition | instance, the eyes much more receptive to | pcture-codng algorithm developed by ae television (HDTV). Unite the dal audio | fine dealin the hminance (or brighiness) Search team under the auspices of the In technology ofthe 8s, however, many othe | signal than nthe choriance (or oor sig- ternational Standards Ongaiztion (SO) {ppizatonsol dgtl vdeo hinge onthe use nals, Consequently, helumiance signals | The team convened in 1987 and the a ‘tdata compression. The audio bandwidth, | usualy sampled at a higher spatial resol | gorithm s curently an SO committee dat Siler alls ebout20kHe, which translates | ton. (Forexampl,inbradcastquaitytele- 10818 recommendation. The scope ofthe al into digital data rate of about L4 megabits | Vision, the digital resolution ofthe sampled | gorithm is broad: it comprises a boseline pet second for high-quality stereo sound, luminance signals 720 by 480 pixels while | lossy approach nd an extended lossless 2p- Spe video sure sls onthe ter | othe colo sg ay be oly 280 by | puch, as wel as incpendent fantone hand, require much higher bit tes, rng- | 240 pixels.) Second, the encoded (or com- ting coding techniques ferent from the ‘ng from 10 Mb/s for broadcast-quality ‘baseline one. Only the first approach | ‘eo tomerethan 00 bis or TY willbe dacised her i Seas “The JPEG baseline algrtm falls Even when sill pictares are i UConn amare under the heading oftransform-based vobved, ns nage shal atom , ane inge coding. Acolor image can be ‘roan is node ae URC somes in ee cts Sthrslion fos to pcce | (MMMCAUUM RUC RESSSUII | hice inary lore, ee, Tine ae 24 eet lo. | ‘ BOI | en ues compatrintcys Sty Spies ge with close to analog EN Grin rte ‘Siupesed orm, Tha wilt ton a renee TTen iat ted for color aeence sa “Rees te. OCT na SEL ape eon cand indy a CMYK ean ge ‘Meanwhile, to facilitate industry eeeceeeeeeeeeeeeete ta, yellow, and black) in the printing in- | pure aca vebeing dered | pressed) representation ofthe lannance | dust Wik ech er sytem, the fers and tung pictures nd fr | Sgulsaeed me sagem | set prsare ced component. This ‘lone St of ce nay | Seahorse res or cmpasn de | TiStbralliveepapotce, some cfthen | "Alcs the ewe ss temative fo energy | Gllytem, for nthe C MAPK syste penser des aviotcninaenet | with hgh sta feaueny than nth ow | Each componente soc eae Teh he Sane cnet compcton, | sata fequeny. Idec an age ona | the JPEC ence and decoders aed HUvWiTwonts Conpresaenwetnvs ould | Ich prune conpater monte were | nto ononeappngbcks 8 by poe imbalance 5 he ore staineuescttran sn Pye | Sack an white the uta ewer woud | wig te women cee cosine Conran in spce frail ips and | See a ufo gay rstead ol the aera | transform (DCT) with an 8-8 ere Scinepse adn veo sigs. Con | ing checkroat pater. Ts detcency |The el Ot coef, compated oon om | Shicied by cout the hphiteucney | asa2Durayt® ty onumbers preset Peng H. Ang, Peer A, Rust, and David Auld | coefficients with fewer bits and the low ones | the frequency contents of the given block. LS) Logic Corp. ‘with more bits. The DCT coefcient value in the upper let- | 6 os 591 §1.05199 EEE vr rec OCTORER‘ant comer ofthe 2-D array messures the | Joint Photographic Experts Group encoder and decoder ener ofthe 2ererequeneyor diet c= | ‘en term. (For exaple, the onal encoder ‘by-Simage as aconstan vabe, tenonly | “PES Spee {hed term nthe tansformed space snon- sor) The er 8 ete a seraing axon fare! ecient they get a | Ial Sleweeeploa gal ierms euniacea: | yess] | gts etency fom ef fo ng Siem tac oat so ergeten SE eT amit eatin spt ego Se Raney cat oe a er Se aba ‘Shin bee ec ol Serenata he ewer naieer | ae Siciterectay cesar | hme tance cme SAS | STAC jactemimepctarecint | See tec cee Tite tine cso | He are re-ordered into a one-dimensional array | ie athe ace ee Mela Sy nee as Seimei et | Seal a rae eter Sean coin | misertcesine transom (61: ores |e fie drain eqn dain dla peg Eaton ening: 29 22x car mahoo bat enone rman vis heer is an oes cae inteuer eis. tatiman cate: 21 rep cada ha wes edeterned vale eng code was, Anvereearetecasne ransom (BOT: iz | cnasion fom te fequency I te Saal ‘ara, PEG decoder Inverse quantization: scaling up of pevasty we oy quntzd daa rgevrange nutes c z nim Photographie Experts Group PES): ‘oun engees and scsi om mary com Bares wooo sechng formu a tnd GEELBI. Telslelels[s[=[e/éle! | tod forthe comeresson and decompression Atala crises, shoo | ‘ab of cb, died ages ‘Moving Pears Experts Group (MPER: 3.7010 oe Ee eee 4 ae "ae | | emilscriaemtasese dies [21 (ye Ts eh oe pe en . hier Progltie caging: he cag ofeach pl by ‘arting te clerence bateen scare ave {has edicts vue, orp Yor pst UES. | 2) Me Baseline algritho forthe compression oil images incuded in the ont Phatograh ‘Quantization: 2 process wey claeresen | c Eqerts Group JPEG) proposed standard divides the image ino 8-8 sel lacks, represented | eSbymany ts esesed doo instvar tesan | hereby abt Bok for spicy In he encoder, th 16 el aay-cae images fis di va equrng ve is tied, ten undergoes adr case transform (DCT) that yds 16 frequency confi’ ‘anton otag: rong orton is | The t-dimencomal rays ead ia gang fashion 10 reorder iin amen array. The | tans rm ae oan et, sat | tices bined by ganlton hr us db 10 then coded ing Ha ter eh as enue) ‘man table, shown her a simplified version. Varlatitengt exding: xcang sa asto eats | "The decoding ath tales he varible length coding (VLC) output cs nut and recovers the | caters chart nmber obese Human , quantised cous, lites each by 10 nese quantization) and turns he ina array cotng | into a 2D one through an incerse 2igang operation, An inverse DCT operation subsequently arlbletenet decade: dcasng al cade lds a 4O-nt image, representing a compression ratio of 1.6: here. Much higher ratios cam ors ttle enh 0 a dl | peal Be ache rg, i ei ae ee WwJena encoded, both using Huffman syle ‘coding bet kaye with diferent parameters Hurfnan coding i a wellknown means of reducing the numberof bits needed to rep- resent a dataset witht losing any infor ttn. The de codficients are dferentially encoded go that the de coefficient of the previous 8b block ofthe same campo- eats used fo pret the de coefficient of the curent &by-8 block andthe diference between these two de terms is encoded. ‘The Hulman code table forthe de term is ‘ated onthe diference values. "The sigaag-coded ac coatclents ar ist runlength coded. This process reduces ‘cach Bty-8 block of DCT cosets toa number of events. Each event represents a onzero coefficient and the number of receding er coefficients. Since the high Frequency coeticients are noe key tobe zero Hufman-coding these events makes I possible to achieve efficent compression "The JPEG baseline gorithm proves or ‘up to to lables each for de and ac coet- ent coding In JPEG decoding, the encod. Ing algorithm simply rum in fevers, and {therefore commonly deserted asa rmetri algorihm ‘As for videotelephony, the CCITT Recommendation H.261 specifies a meth ‘od ofcomamunieation or visual telephony. I oftencalled the p64 standardbecause the dita ate onthe communication chante is times 6 kobe pee second, where pis 2 postive integer less than or equ fo 32. orp-l, then, alow quality video sgal or use in picture phones can be transmitted ‘over atk ine. If p=S2,ahigh-qualty ideo signal for teleconferencing can be transmitted over a2-Mbis ine. “The sandard species the ergnization and interpretation ofthe transmitted bits 0 that tro coder decodes (codecs) fom ferent manufacturers may successful s- tablish a videoconferencing session. A CCITT encode is more complicated than the JPEG encode, adiough one can dsin- ‘ish ama functional Blocks such 25 the DCT and the quantizer (Fig. 2, top). The decoder, however i Tess complex (Fig. 2, bottom ‘dete description ofthe baseline a- orth is beyond the scope ofthis arte Instead, an overview ofthe tectniques used willbe given "The CCITT coder scaled hybridbecause it combines transform codingit i alo DeTbased—with predictive coding, in wich lok inthe current frame s preit- fom block in the previous fame using 3 feedback loop. In cont the JPEG a- forth basically operates la at open lop dis est at the end of each image.) eis {his inter-frame prediction tha resus ina higher compression rato, ‘Als, instead of basing predictive coding purely onthe dilerence between the cu rent frame and the reconstructed image in the fame memory, the CCITT H.281 san ‘dards an optional specication for mation 8 compensation, This increases the predictive | the data rate may not exced the 15 Mis oder eficioncy tracking be wter-srae | oftoay's digital storage media There are ‘notion and hence its succes at bitrate | ongoing development fort to increase the fata transer rate for next-generation media) Preset media inch compact is Aves, digital aio tape (DAD drives, and fulkmetin compression aigorit with bod intra ante odes. Uke H.26, CCITT encoder ‘magnetic hard disks. “The standards committe for MPEG has CCITT decoder 12) The first ofa sequence of frames is intracode in he fal maton compresion scheme ro pase by th Consulative Commits for International Telegraph and Talephony (CCITT) Tike JPEG, each 8p lock of te frame s encoded withthe discret cosine rasform (DCT and them quanti op) AL pont 1). there are to signal paths: oe eds toward 1 recever though laslss coder and optional errorcorection ciety: the oher—a ‘feedbacks ives quate and wdergesineerse DCT to eld a reconsiruce blk for “Sorage in frame memory. Reconsracion is meedad because inter frame compression wsts Droitoe coding, which requires the encoder o trac the behavior of the decoder fo prevent (he decoder’ constructed tmage from diverging from the orginal input. The coder can be bypassed instead of te signal being toon ot 2) bose loss and widow influence Cte rcostracon roe, When the ete frame has bon cessed, a recone mage sem bythe decoder i soe in the frame memory at [3 Nest, infer frame coding so ‘lied. To compensate for motion, each 8-8 block nthe curentframe is matched with @ vac window nth frame mers Then Ee mation vetr that eresnt te off tan {he current black and block nthe rian reconstructed image that form the best mack [4] fended and sont fo the rcier The prior a 5] ges the mation compensated Sy bck from he consid frame. The diference een tis nd th orginal blocks trans form coded, quantized and code fore vig sen tothe reeioer. The CCITT decoder ot fom) jirst comet incoming bit steam errs, ond then dco the dain he wane nth ‘decoder. Paseage through the incerse quontier andthe inverse DCT vis the DCT coe ‘ont Ai) lok lik ome in the encodersedbac ao has bon constructed and stored Inthe jrame memory Inner frame mode, motion sectors erie from the variable-length decoder aye used to provide the location of the pdt blocks.soteonplete its workand the system an ito spectfcaions remain infix, Toa | ig gerbe uncon te 1.261 | | Grenlee Gada snes, However, theapecies funtion an mote: tiratonfeomponsaton and coding ac Sire Tecra secon phe of standart sin dubbed MPEC2 hs began sms | tien cocing for up to 10 Mb with be fare ga af ghey ress. | sttcon SoustioNs an cg ido ap. Pesos wil qa lorcet sion | Ament fbecone bu bated. een cdf 1 ee wc ry o nunceents of ip se solatone domes an ico comprcsct. Some ae tonsa approche er cone Sock dft sana PEG and #20 | “Shuton fr JPEG mere ofered iby Lube Minojsens ne Sane Ce Saee ee eras | Smet sasinectip C50 smoxnce ISIS aed corms oa cary olthe PEC dat The company mearem | reworking he den met he et JPEG spectctons LS Lae's sem Euston (orp elton cts the BES DCT nner wih the LMS thanizer pus PSG ral ength coer $e toning so foci fet cost der iceame sale che ers | | Salta esd cheaper pst pcawes. "The areca aposehes of C-Cabe and St Lage ar sma Bt te C1580 | Sate fpr mpleren the JPEG a feelin bet the er may change sch | JPEG parameters 2s image resolution, num. beralnpncs an eqn ad Tati coe bles wed HOG ois te mle fom Lt | Lai ad Gans Conmnrations Aer elas (OCA. Ga En St ba seunce asevechip ulin oe ay teracren arpotion eo encoding a Scag tien 1.20 in Soper S50 atl GCA lone wih chp into fay hut moth ter, Bath | eben cede ron spective ace baling has | | oe St ie cons fur 9 cease cong ecg ce $e rector oe te U2 for ton | estinaton, the DCT 154730, the L740 or umng nd LGD rier de | | Sedan Tae ater ce cps are te Teene Bove-Choudhurr-toguenghen | {iciDerorsoretng colette LTD Moot wrote nth ence dL | Lan tanaeenga acoder a pee toit2oL The four processor may be sed in ny | wamforesbsed compression syste For inne toe MPEG aco clog Lop | {ime the varblelength code tan be Sawin tbe LS cps | SION RLEIBUT, Psp a Ire bcs ve ic system desaper te conocer om compen | tebiecureattpsem eve The parted | | fad dosonpesdo of ages anon | aC, Gone uP Wise Csr | ster mew Many nev applications ia “image compresion board that compl sith the Joint Photographic Experts Group OPE) propsedslondard are becoming avelable. The one shown here—Visionan, JPEG Compre: sion Engine jrom Rad Technolgy Corp, Amberst, Nha tre LSI Lagi Corp. ICs eforming raster to block conerion, th dst cosine transform, and guntuation and ndings commectono Rapid Technology's Visionary Video Boa inthe bac) alos rel time video data o tls to be diety transfered between the to boars sot requ compat microcode aa | _ In short, the technology encompasig err ear 0 oe siglo tert the ores inthe esey af ogra salon, | ofbeaeing commana withthe | thee ctetp er Gem Incl Cup, | word of comping. Ten eas om 0% Sta Can, Caf anda une chip ft | tee hve unis wil ot be dt | {VC ise, CalfThe wor nel 730, mse Comes 9s proscar an sly | YOPROE MTR Two textbooks wih nt fron bancomponts nia’ Dg | Gcesoe cf enrl nneencedng tech Wise hneache (ND aracise Th | ques ae Dil mae Presng Wi Poulpecenot insane mccode | fun KPa Os Wey and Sons, New Tovucion an ejpore the compression | York 1 and Dita mag Presi y ‘ico abo eytheszes apis prin. | Wese. Reading, Mass, 180). Arch C. Treo The dspay processor tke naps | Lather wrote an [EEE Scrum article on | ffommencry and dle themontbe CHT | foteractive dig video (DVD technology in Stee May 22, ltl has been shipping a | September 1s, ad sabsequety authored Setar protic igh ig perform | a defi book on DV econo ened Gmpresson and decorpestion based on | Dil Viko the PC Emevonment, 2nd {restr quaizaton ago achieving | ton OeGrawfl New Yer, 19, An feaktne performance or 256by 240 | olerrecen book on HDTV is ened Ingen A eatue of ltl approach ts | BDTV: Adeanced Tessin forthe BCS by rorramanaiiy. K-Bhir Benson and Donal G. Fink Tris product amouncement, UVC eins | (MeGraw-Hi, New York, 188. achipcapable of realtime 5002 compres: | The Apel 81 ae of the Commis Sion using purely ta rume techniques. | son ofthe Asociaton or Compuling Ma ‘One other company, SCS-Thomson | ckiny (CACRD was devoted to emersing Meroeectronce, Phoenix, Are, fas 20- | compression stars with relevance toured passable fraseina compres. | digital raltimeda, Sons ftasseverd DCT processors | ARQUTTHE ABHOR, Png. Ang 0 ned (STV200, STVI208, and ALZD and amo- | LSI Logie Cor, Mpa, Cal, m ay | Sn estimation pecestor STVS2O). | 1B ein presen pec ma aero he igi signal rocesing DSP) theo eran wile digas under | insiess unit which nroduced ne of Sored by the Federal Communcations | image and vdeo compression ICs in Sep isa’ cet ae that vars | tember 1290. Sevag! HDTV approach Inthe con |" Peter A, Ruct (MD joined LS Logic in Jong rena, ilres 6 aeady growing | Ju 1986 Hes curenya senior member Ihe miopation of deo wth graphics and | othe DSP groups techneal sta. fu, Ohenrefered toasted” p- | David Aldine LSt Lol in 1290, He pleatons these willbe used in nteracive | incarrenty he apoiations manage ofthe ‘ation, net generation graphics ays | DSP gop. Pro toning She was with ‘Gm network ideounfeenang nd other | moe Corp. which tr became part of ser endl sftes. SGS-Thomton Micelecrons. | 19