Modeling Visual Information Processing in Brain: A Computer Vision Point of View and Approach

0RGHOLQJ9LVXDO,QIRUPDWLRQ3URFHVVLQJLQ%UDLQ $&RPSXWHU9LVLRQ3RLQWRI9LHZDQG$SSURDFK Emanuel Diamant VIDIA-mant, P.O. Box 933, 55100 Kiriat Ono, Israel HP D Q O #    Q H W  L O Abstract.  :H OLYH LQ WKH ,QIRUPDWLRQ $JH DQG LQIRUPDWLRQ KDV EHFRPH D FULWLFDOO\ LPSRUWDQW FRP SRQHQW RI RXU OLIH 7KH VXFFHVV RI WKH ,QWHUQHW PDGH KXJH DPRXQWV RI LW HDVLO\ DYDLODEOH DQG DFFHVVLEOH WR HYHU\RQH 7R NHHS WKH IORZ RI WKLV LQIRUPDWLRQ PDQDJHDEOH PHDQV IRU LWV IDXOWOHVV FLUFXODWLRQ DQG HIIHFWLYHKDQGOLQJKDYHEHFRPHXUJHQWO\UHTXLUHG&RQVLGHUDEOHUHVHDUFKHIIRUWV DUH GHGLFDWHG WRGD\ WR DGGUHVV WKLV QHFHVVLW\ EXW WKH\ DUH VHULRXVO\ KDPSHUHG E\WKH ODFNRI DFRPPRQ DJUHHPHQWDERXW ³:KDWLV LQIRUPDWLRQ"´ ,Q SDUWLFXODU ZKDW LV ³YLVXDO LQIRUPDWLRQ´ ± KXPDQ¶V SULPDU\ LQSXW IURP WKH VXUURXQGLQJ ZRUOG 7KH SUREOHP LV IXUWKHU DJJUDYDWHG E\ D ORQJODVWLQJ VWDQFH ERUURZHG IURP WKH ELRORJLFDO YLVLRQ UHVHDUFK WKDW DVVXPHV KXPDQOLNH LQIRUPDWLRQ SURFHVVLQJ DV DQ HQLJPDWLF PL[ RI SHUFHSWXDO DQG FRJQLWLYH YLVLRQ IDFXOWLHV , DP W U\LQJ WR ILQG D UHPHG\ IRU WKLV EL]DUUH VLWXDWLRQ 5HO\LQJ RQ D QHZ GHILQLWLRQ RI ³LQIRUPDWLRQ´ ZKLFK FDQ EH GHULYHG IURP . ROPRJRURY¶V FRPSOH[LW\ WKHRU\ DQG &KDLWLQ¶V QRWLRQ RI DOJRULWKPLF LQIRUPDWLRQ , SURSRVH D XQLI\LQJ IUDPHZRUN IRU YLVXDO LQIRUPDWLRQ SURFHVVLQJ ZKLFK H[SOLFLWO\ DFFRXQWV IRU WKH SHUFHSWXDO DQG FRJQLWLYH LPDJH SURFHVVLQJ SHFXOLDULWLHV , EHOLHYH WKDW WKLV IUDPHZRUN ZLOO EH XVHIXO WR RYHUFRPH WKH GLIILFXOWLHV WKDW DUH LPSHGLQJ RXU DWWHPSWV WR GHYHORS WKH ULJKW PRGHO RI KXPDQOLNH LQWHOOLJHQW LPDJHSURFHVVLQJ 1 Introduction 7KH H[SORVLYH JURZWK RI YLVXDO LQIRUPDWLRQ LQ RXU VXUURXQGLQJV KDV UDLVHG DQ XUJHQW GHPDQG IRU HIIHFWLYH PHDQV IRU RUJDQL]LQJ DQG KDQGOLQJ WKHVH LPPHQVH YROXPHV RI LQIRUPDWLRQ>@%HFDXVHKXPDQV DUHNQRZQWREH YHU\HIILFLHQWLQVXFKWDVNVLW LVQRW VXUSULVLQJWKDWFRPSXWHUYLVLRQ GHVLJQHUVDUHWU\LQJDJDLQDQGDJDLQWRJHW DQVZHUVIRU WKHLU ZRUU\LQJ SUREOHPV DPRQJ WKH VROXWLRQV WKDW +XPDQ 9LVXDO 6\VWHP KDV GHYHORSHG LQ FRXUVH RI PLOOLRQV RI \HDUV RI QDWXUDO HYROXWLRQ 1HDUO\ KDOI RI RXU FHUHEUDO FRUWH[ LV EXV\ ZLWK SURFHVVLQJ YLVXDO LQIRUPDWLRQ > @ EXW KRZ LW LV GRQH ³LQ YLYR´ UHPDLQV D SX]]OH IRU PDQ\ JHQHUDWLRQV RI WKLQNHUV SKLORVRSKHUV DQG FRQWHPSRUDU\VFLHQWLILFUHVHDUFKHUV 1HYHUWKHOHVV D ZRUNLQJ WKHRU\ RI KXPDQ YLVXDO LQIRUPDWLRQ SURFHVVLQJ KDV EHHQ HVWDEOLVKHG DERXW WZHQW\ ILYH \HDUV DJR E\ W KH VHPLQDO ZRUNV RI 'DYLG 0DUU >  @ $QQH 7UHLVPDQ >@ ,UYLQJ %LHGHUPDQ >@ DQG D ODUJH JURXS RI WKHLU DVVRFLDWHV DQG IROORZHUV 6LQFH WKHQ LW KDV EHFRPH D FODVVLFDO WKHRU\ ZKLFK GRPLQDWHV WRGD\ LQ DOO IDUWKHU GHYHORSPHQWV LQ WKH ILHOG 7KH WKHRU\ FRQVLGHUV KXPDQ YLVXDO LQIRUPDWLRQ SURFHVVLQJ DV DQ LQWHUSOD\ RI WZR LQYHUVHO\ GLUHFWHG SURFHVVLQJ VWUHDPV 2QH LV DQ XQVXSHUYLVHG ERWWRPXS GLUHFWHG SURFHVV RI LQLWLDO LPDJH LQIRUPDWLRQ SLHFHV GLVFRYHU\ DQG ORFDOL]DWLRQ  7KH RWKHU LV D VXSHUYLVHG WRSGRZQ GLUHFWHG SURFHVV ZKLFK FRQYH\V WKH UXOHV DQG WKH NQRZOHGJH WKDW JXLGH WKH OLQNLQJ DQG ELQGLQJ RI WKHVHGLVMRLQWLQIRUPDWLRQSLHFHVLQWRSHUFHSWXDOO\PHDQLQJIXOLPDJHREMHFWV ,Q PRGHUQ ELRORJLFDO YLVLRQ UHVHDUFK WKLV GXDOLW\ LV UHIHUUHG WR DV SHUFHSWXDO DQG FRJQLWLYH IDFXOWLHV RI YLVLRQ ,Q FRPSXWHU YLVLRQ WHUPLQRORJ\ WKHVH DUH WKH ORZOHYHO DQGKLJKOHYHOSDWKVRIYLVXDOLQIRUPDWLRQSURFHVVLQJ$OWKRXJK7UHLVPDQ¶VWKHRU\ >@ GHILQLWHO\ SRVLWLRQV LWVHOI DV ³$ )HDWXUH,QWHJUDWLRQ 7KHRU\´ WKH GLIILFXOWLHV L Q GHILQLQJ SURSHU UXOHV IRU WKLV IHDWXUH LQWHJUDWLRQ KDYH LPSHOOHG D JURZLQJ GLYHUJHQFH EHWZHHQ SHUFHSWLYH DQG FRJQLWLYH ILHOGV RI LPDJH SURFHVVLQJ >@ 2EYLRXVO\ WKDW ZDV D ZURQJ DQG D FRXQWHUSURGXFWLYH GHYHORSPHQW DQG KXPDQ YLVLRQ UHVHDUFKHUV ZHUH DOZD\V DZDUH RI LWV KDUPIXO FRQVHTXHQFH >@ )RU WKLV UHDVRQ WKH VRFDOOHG ³ELQGLQJ SUREOHP´ KDV EHHQ DQQRXQFHG DV D FULWLFDO H[SORUDWLRQ JRDO DQG PDVVLYH UHVHDUFK HIIRUWV KDYH EHHQ GLUHFWHG WR LWV UHVROXWLRQ >@ 8QIRUWXQDWHO\ ZLWKRXW DQ\ GLVFHUQDEOHVXFFHVV ,Q FRPSXWHU YLVLRQ WKH VLWXDWLRQ LV HYHQ PRUH EL]DUUH 7KXV IDU FRPSXWHU YLVLRQ FRPPXQLW\ ZDV VR EXV\ ZLWK LWV HYHU\GD\ SUREOHPV WKDW WKHUH ZDV QR WLPH WR UDLVH EDVLF UHVHDUFK YHQWXUHV 3ULQFLSDO LGHDV DV ZHOO DV WKHLU SRVVLEOH VROXWLRQV DUH XVXDOO\ ERUURZHG IURP ELRORJLFDO YLVLRQ UHVHDUFK 7KHUHIRUH IROORZLQJ WKH WUHQGV LQ ELRORJLFDO YLVLRQ IRU GHFDGHV FRPSXWHU YLVLRQ 5' KDV EHHQ GHHSO\ SOXQJHG LQWR ERWWRPXS SL[HORULHQWHG LPDJH SURFHVVLQJ /RZOHYHO LPDJH FRPSXWDWLRQV KDYH EHFRPH LWV SULPH DQG SHUVLVWHQW JRDO ZKLOH WKH FRPSOLFDWHG LVVXHV RI KLJKOHYHO SURFHVVLQJZHUHMXVWQHJOHFWHGDQGGLVUHJDUGHG +RZHYHU LW LV LPSRVVLEOH WR LJQRUH WKHP FRPSOHWHO\ ,W LV JHQHUDOO\ DFNQRZOHGJHG WKDW DQ\ NLQG RI LPDJH SURFHVVLQJ LV XQIHDVLEOH ZLWKRXW LQFRUSRUDWLRQ LQWR LW WKH KLJKOHYHO NQRZOHGJH LQJUHGLHQWV )RU WKLV UHDVRQ WKH ZKROH KLVWRU\ RI FRPSXWHUEDVHG LPDJH SURFHVVLQJ LV DQ HQGOHVV VDJD RQ DWWHPSWV WR VHL]H WKH QHHGHG NQRZOHGJHLQDQ\ SRVVLEOHZD\ 7KHROGHVWDQG WKHPRVW FRPPRQSOR\ LVWRFDSLWDOL]H RQ WKH GRPDLQ H[SHUW¶V NQRZOHGJH DQG DGDSW LW WR HDFK DQG HYHU\ DSSOLFDWLRQ FDVH ,W LV QRW VXUSULVLQJ WKHUHIRUH WKDW WKH ZKROH UHDOP RI LPDJH SURFHVVLQJ KDV EHHQ DQG FRQWLQXHVWR EH IUDJPHQWHGDFFRUGLQJ WR WKHKLJKOHYHO NQRZOHGJH FRPSHWHQFH RIWKH H[SHUWV LQ WKH FRUUHVSRQGLQJ GRPDLQV 7KDW LV ZK\ ZH KDYH WRGD\ PHGLFDO LPDJLQJ DHURVSDFH LPDJLQJ LQIUDUHG ELRORJLF XQGHUZDWHU JHRSK\VLFV UHPRWH VHQVLQJ PLFURVFRS\UDGDUELRPHGLFDO;UD\DQGVRRQ³LPDJLQJV´  7KH DGYHQW RI WKH ,QWHUQHW ZLWK KXJH YROXPHV RI YLVXDO LQIRUPDWLRQ VFDWWHUHG RYHU WKH ZHE KDV GHPROLVKHG WKH ORQJODVWLQJ FXVWRP RI FDSLWDOL]LQJ RQ WKH H [SHUW¶V NQRZOHGJH,PDJH LQIRUPDWLRQFRQWHQW RQ WKH:HE LV XQSUHGLFWDEOHDQG GLYHUVLILHG ,W LV XVHOHVV WR DSSO\ VSHFLILF H[SHUW NQRZOHGJH WR D UDQGRP VHW RI GLVWDQW LPDJHV 7R PHHW WKH F KDOOHQJH WKH FRPSXWHU YLVLRQ FRPPXQLW\ KDV XQGHUWDNHQ DQ HQWHUSULVH WR GHYHORS WKH VRFDOOHG &RQWHQW%DVHG ,PDJH 5HWULHYDO &%,5 WHFKQRORJLHV >@ >@ +RZHYHU GHSULYHG RI DQ\ UHDVRQDEOH VRXUFHV RI WKH GHVLUHG KLJKOHYHO LQIRUPDWLRQ FRPSXWHU YLVLRQ GHVLJQHUV ZHUH IRUFHG WR SURFHHG LQ RQO\ RQH SRVVLEOH GLUHFWLRQ RI WU\LQJ WR GHULYH WKH KLJKOHYHO NQRZOHGJH IURP WKH DYDLODEOH ORZOHYHO LQIRUPDWLRQ SLHFHV>@ >@ ,Q GRLQJ VR FRPSXWHU YLVLRQ GHVLJQHUV KDYH RQFH DJDLQ GHPRQVWUDWHG WKHLU UHOLDQFH RQELRORJLFDO YLVLRQWUHQGV DQGIDVKLRQV,Q ELRORJLFDOYLVLRQ DUDQN RIWKHRUHWLFDOD QG H[SHULPHQWDO ZRUN KDV EHHQ GRQH LQ RUGHU WR VXSSRUW DQG WR MXVWLI\ WKLV D ERYH PHQWLRQHG WHQGHQF\ 7ZR ZD\V RI WKLQNLQJ FRXOG EH GLVWLQJXLVKHG LQ WKLV UHJDUG FKDRWLFDWWUDFWRUVPRGHOLQJ>@>@DQGVDOLHQF\ DWWHQWLRQPDSPRGHOLQJ >@  >@ :H ZLOO QRW UHYLHZ WKHVH DSSURDFKHV LQ GHWDLOV :H ZLOO RQO\ QRWH WKDW ERWK RI WKHP SUHVXPH ORZOHYHO ERWWRPXS SURFHVVLQJ DV WKH PRVW SURSHU ZD\ IRU KLJKOHYHO LQIRUPDWLRQUHFRYHU\ %RWK DUH FRPSXWDWLRQDOO\ H[SHQVLYH%RWK GHILQLWHO\ YLRODWH WKH EDVLF DVVXPSWLRQ DERXW WKH OHDGLQJ UROH RI KLJKOHYHO NQRZOHGJH LQ WKH ORZOHYHO LQIRUPDWLRQSURFHVVLQJ ,W ZLOO EH D PLVWDNH WR VD\ WKDW FRPSXWHU YLVLRQ SHRSOH DUH QRW DZDUH RI WKHVH GLVFUHSDQFLHV 2Q WKH FRQWUDU\ WKH\ DUH ZHOO LQIRUPHG DERXW ZKDW LV JRLQJ RQ LQ WKH ILHOG +RZHYHU WKH\ DUH WU\LQJ WR MXVWLI\ WKHLU DWWHPSWV E\ SURPRWLQJ D FRQFHSW RI D ³VHPDQWLF JDS´ DQ LPDJLQDU\ JDS EHWZHHQ ORZ DQG KLJKOHYHO LPDJH IHDWXUHV  7KH\ VLQFHUHO\EHOLHYHWKDWWKH\ZRXOGEHDEOHWREULGJHLWVRPHGD\>@ ,W LV ZRUWK WR PHQWLRQ WKDW DOO WKHVH GHYHORSPHQWV ± IHDWXUH ELQGLQJ LQ ELRORJLFDO YLVLRQ DQG VHPDQWLF JDS EULGJLQJ LQ FRPSXWHU YLVLRQ ± DUH HYROYLQJ LQ DWPRVSKHUH RI WRWDO LQGLIIHUHQFH WR SULRU F ODLPV DERXW KLJKOHYHO LQIRUPDWLRQ VXSHULRULW\ LQ WKH JHQHUDO FRXUVH RI YLVXDO LQIRUPDWLRQ SURFHVVLQJ 6XFK LQGLIIHUHQFH VHHPV WR VWHP IURP D YHU\ ORRVH XQGHUVWDQGLQJ D ERXW ZKDW LV WKH FRQFHSW RI ³LQIRUPDWLRQ´ ZKDW L V WKH ULJKW ZD\ WR XVH LW SURSHUO\ DQG ZKDW LQIRUPDWLRQ WUHDWPHQW RSWLRQV FRXOG DULVH IURPWKLVXQGHUVWDQGLQJ  5HH[DPLQLQJWKHEDVLFDVVXPSWLRQV (YHU\RQH ZKR LV QRW GHDI NQRZV WKDW ZH OLYH WRGD\ LQ WKH ,QIRUPDWLRQ $JH ZKHUH LQIRUPDWLRQ LV DQ LQGLVSHQVDEOH LQJUHGLHQW RI RXU OLIH :H FRQVXPH LW FUHDWH LW VHHN LW WUDQVIHU H[FKDQJH KLGH UHYHDO DFFXPXODWH DQG GLVVHPLQDWH LW ± LQ RQH ZRUG LQIRUPDWLRQ LV D UHPDUNDEO\ LPSRUWDQW FRPSRQHQW RI RXU OLIH %XW FDQ VRPHRQH H[SODLQ PH ZKDW ZH KDYH LQ PLQG ZKHQ WKH ZRUG ³LQIRUPDWLRQ´ LV XWWHUHG" 0\ DWWHPSWV XQGHUWDNHQ VHYHUDO \HDUV DJR WR JHW P\ RZQ DQVZHU IRU WKLV TXHVWLRQ ZHUH VR GHVSHUDWH WKDW , ZDV DOPRVW UHDG\ WR D FFHSW WKH VWDQFH WKDW LQIRUPDWLRQ LV DQ LQGHILQDEOH HQWLW\ OLNH ³VSDFH´ DQG ³WLPH´ LQ FODVVLFDO SK\VLFV HJ )RUWXQDWHO\ DW WKHHQG ,KDYH KLW RQDQ LQIRUPDWLRQGHILQLWLRQ ILWWLQJ P\YLVXDO LQIRUPDWLRQ KDQGOLQJ DLPV ,W WXUQV RXW WKDW WKLV GHILQLWLRQ FDQ EH GHULYHG IURP 6RORPRQRII¶V WKHRU\ RI ,QIHUHQFH >@ &KDLWLQ¶V $OJRULWKPLF ,QIRUPDWLRQ WKHRU\ >@ DQG .ROPRJRURY¶V &RPSOH[LW\ WKHRU\ >@ 5HFHQWO\ , KDYH OHDUQHG WKDW .ROPRJRURY¶V &RPSOH[LW\ DQG &KDLWLQ¶V $OJRULWKPLF ,QIRUPDWLRQ WKHRU\ DUH UHIHUUHG DV UHVSHFWHG LWHPV RI D OLVW RI VHYHQ SRVVLEOH FRQWHVWDQWV VXLWDEOH WR GHILQH ZKDW DFWXDOO\ LQIRUPDWLRQ LV >@ ,Q WKLV UHJDUG , ZDV YHU\ SURXG RI P\VHOI WKDW , ZDV OXFN\ WR D YRLG WKH WUDSV RI 6KDQQRQ¶V ,QIRUPDWLRQ 7KHRU\ ZKLFK LV NQRZQ WR EH XVHIXO LQ FRPPXQLFDWLRQ DSSOLFDWLRQV EXW LW LV DEVROXWHO\ LQDSSURSULDWH IRU YLVXDO LQIRUPDWLRQ H[SORUDWLRQV WKDW , DP WU\LQJ WR FRQGXFW 7KH UHDVRQ IRU WKLV LV WKDW 6KDQQRQ¶V LQIRUPDWLRQ SURSHUO\ GHVFULEHV WKH LQWHJUDWHG SURSHUWLHV RI DQ LQIRUPDWLRQ PHVVDJH ZKLOH .ROPRJRURY¶V GHILQLWLRQ LV VXLWDEOH IRU HYDOXDWLRQ RI LQIRUPDWLRQ FRQWHQW RI VHSDUDWH LVRODWHG VXESDUWV RI D PHVVDJH VHSDUDWH PHVVDJH REMHFWV 7KLV LV LQGHHG PXFKF ORVHUWR W KH ZD\ LQ ZKLFK KXPDQVSHUFHLYHDQGJUDVSWKHLUYLVXDOLQIRUPDWLRQ 7KH UHVXOWV RI P\ LQYHVWLJDWLRQ KDYH EHHQ DOUHDG\ SXEOLVKHG RQ VHYHUDO RFFDVLRQV >@ >@ >@ >@ DQG LQWHUHVWHG UHDGHUV FDQ HDVLO\ JHW WKHP IURP D QXPEHU RI IUHHO\ DFFHVVLEOH UHSRVLWRULHV HJ DU;LY &LWH6HHU WKH IRUPHU 5HVHDUFK ,QGH[ (SULQWZHE HWF 7KHUHIRUH , ZLOO RQO\ UHSHDW KHUH VRPH LPSRUWDQW SRLQWV RI WKHVH HDUO\SXEOLFDWLRQVZKLFKSURSHUO\UHIOHFWP\FXUUHQWXQGHUVWDQGLQJRIWKHPDWWHUV 7KH PDLQ SRLQW LV WKDW LQIRUPDWLRQ LV D GHVFULSWLRQ  D FHUWDLQ DOSKDEHWEDVHG RU ODQJXDJHEDVHG GHVFULSWLRQ ZKLFK .ROPRJRURY¶V WKHRU\ UHJDUGV DV D SURJUDP WKDW ZKHQ H[HFXWHG WUXVWZRUWK\ UHSURGXFHV WKH RULJLQDO REMHFW >@ ,Q DQ LPDJH VXFK REMHFWV DUH YLVLEOH GDWD VWUXFWXUHV IURP ZKLFK DQ LPDJH FRQVLVWV RI 6R D VHW RI UHSURGXFLEOH GHVFULSWLRQV RI LPDJH GDWD VWUXFWXUHV LV WKH LQIRUPDWLRQ FRQWDLQHG LQ DQ LPDJH 7KH .ROPRJRURY¶V WKHRU\ SUHVFULEHV WKH ZD\ LQ ZKLFK VXFK GHVFULSWLRQV PXVW EH FUHDWHG DW ILUVW WKH PRVW VLPSOLILHG DQG JHQHUDOL]HG VWUXFWXUH PXVW EH GHVFULEHG 7KHQ DV WKH OHYHO RI JHQHUDOL]DWLRQ LV JUDGXDOO\ GHFUHDVHG PRUH DQG PRUH ILQHJUDLQHG LPDJH GHWDLOV VWUXFWXUHV DUH EHFRPH UHYHDOHG DQG GHSLFWHG 7KLV LV WKH VHFRQG LPSRUWDQW SRLQW ZKLFK IROORZV IURP WKH WKHRU\¶V SXUH PDWKHPDWLFDO FRQVLGHUDWLRQV LPDJH LQIRUPDWLRQ LV D KLHUDUFK\ RI UHFXUVLYH GHFUHDVLQJ OHYHO GHVFULSWLRQV  RI LQIRUPDWLRQ GHWDLOV ZKLFK XQIROGV LQ D FRDUVHWRILQH W RSGRZQ PDQQHU $WWHQWLRQ SOHDVH DQ\ ERWWRPXS SURFHVVLQJ LV QRW PHQWLRQHG KHUH 7KHUH LV QRORZOHYHO IHDWXUHJDWKHULQJ DQGQR IHDWXUH ELQGLQJ7KH RQO\ SURSHUZD\ IRU LPDJH LQIRUPDWLRQHOLFLWDWLRQLVDWRSGRZQFRDUVHWRILQHZD\RILPDJHSURFHVVLQJ 7KHWKLUG SURPLQHQWSRLQW ZKLFKLPPHGLDWHO\ SRSVXS IURP WKHWZR MXVW PHQWLRQHG DERYH LV WKDW WKH WRSGRZQ PDQQHU RI LPDJH LQIRUPDWLRQ HOLFLWDWLRQ GRHV QRW UHTXLUH LQFRUSRUDWLRQ RI DQ\ KLJKOHYHO NQRZOHGJH  IRU LWV VXFFHVVIXO DFFRPSOLVKPHQW ,W LV WRWDOO\ IUHH IURP DQ\ KLJKOHYHO JXLGLQJ UXOHV DQG LQVSLUDWLRQV :KDW LPPHGLDWHO\ IROORZV IURP WKLV LV WKDW KLJKOHYHO LPDJH VHPDQWLFV LV QRW DQ LQWHJUDWHGSDUW RILPDJH LQIRUPDWLRQFRQWHQW DVLW LV WUDGLWLRQDOO\ DVVXPHG,W FDQ QRW EH VHHQ PRUH DV D QDWXUDO SURSHUW\ RI DQ LPDJH ,PDJH VHPDQWLFV PXVW EH VHHQ DV D SURSHUW\ RI D KXPDQ REVHUYHU WKDW ZDWFKHV DQG VFUXWLQL]HV DQ LPDJH 7KDW LV ZK\ ZH FDQ VD\ QRZ VHPDQWLFV LV DVVLJQHG WR DQ LPDJH E\ D KXPDQ REVHUYHU  7KDW LV VWURQJO\ DW YDULDQFH ZLWK WKH FRQWHPSRUDU\ YLHZV RQ WKH FRQFHSW RI VHPDQWLF LQIRUPDWLRQ )ROORZLQJ WKH QHZ LQIRUPDWLRQ HOLFLWDWLRQ UXOHV LW LV LPSRVVLEOH WR FRQWLQXHWRSUHWHQGWKDWVHPDQWLFVFDQEH H[WUDFWHGIURP  DQLPDJH DVLQ >@ >@ RU VKRXOG EH GHULYHG IURP ORZOHYHO LQIRUPDWLRQ IHDWXUHV  YLD WKH VHPDQWLF JDS EULGJLQJDVLQ>@>@ DQGPDQ\RWKHUV7KDWVLPSO\GRHVQRWKROGDQ\PRUH 3 Computer Vision Implications 7KLVQHZ GHILQLWLRQRI LQIRUPDWLRQ KDVIRUFHG XVWR UHFRQVLGHURXU IRUPHU DSSURDFKWR LPDJHLQIRUPDWLRQ SURFHVVLQJ7KH YDOLGLW\RIRXU QHZDVVXPSWLRQV DQGWKHLQHYLWDEOH FKDQJHV LQ GHVLJQ SKLORVRSK\ WKDW DFFHSWDQFH RI WKHVH DVVXPSWLRQV LPSO\ KDYH PRWLYDWHG XVWR WHVW WKH LVVXHV LQ DIUDPHZRUN RI D YLVXDO URERW GHVLJQ HQWHUSULVH7KH HQWHUSULVH LV DLPHG WR FUHDWLQJ DQ DUWLILFLDO YLVLRQ V\VWHP ZLWK VRPH KXPDQOLNH FRJQLWLYHFDSDELOLWLHV ,WLV JHQHUDOO\DJUHHGWKDW WKH ILUVWVWDJH RIVXFK DV\VWHP KDVWR EH DQ LPDJH VHJPHQWDWLRQ VWDJH DW ZKLFK WKH ZKROH EXON RI LPDJH SL[HOV LPDJH UDZ GDWDKDV WREH GHFRPSRVHGLQWR DILQLWH VHWRI LPDJHSDWFKHV 7KHODWWHU DUHVXEPLWWHG DIWHUZDUGVWRDSURFHVVRILPDJHFRQWHQWDQDO\VLVDQGLQWHUSUHWDWLRQ $ SUDFWLFDO D OJRULWKP EDVHG RQ WKH DQQRXQFHG DERYH SULQFLSOHV KDV EHHQ GHYHORSHG DQG VXEMHFWHG WR VRPH V\VWHPDWLF HYDOXDWLRQV 7KH UHVXOWV ZHUH SXEOLVKHG DQG FDQ EH IRXQG LQ >@ >@ >@  7KHUH LV QR QHHG WR UHSHDW DJDLQ DQG DJDLQ WKDW H[FHOOHQW SUHYLRXVO\ XQDWWDLQDEOH VHJPHQWDWLRQ UHVXOWV KDYH EHHQ DWWDLQHG LQ WKHVH WHVWV XQGRXEWHGO\ FRUURERUDWLQJ WKH QHZ LQIRUPDWLRQ SURFHVVLQJ SULQFLSOHV 1RW RQO\ DQ XQVXSHUYLVHG VHJPHQWDWLRQ RI LPDJH FRQWHQW KDV EHHQ DFKLHYHG LQ D WRSGRZQ FRDUVHWRILQHSURFHVVLQJ PDQQHUZLWKRXW DQ\ LQYROYHPHQWRI KLJKOHYHONQRZOHGJH $ KLHUDUFK\ RI GHVFULSWLRQV IRU H DFK DQG HYHU\ VHJPHQWHG ORW VHJPHQWHG REMHFW KDV EHHQ DFKLHYHG DV ZHOO ,W FRQWDLQV WKH FHQWHU RI PDVV FRRUGLQDWHV WKH GLUHFWLRQ RI REMHFW¶V PDLQ D[HVHV REMHFW¶V FRQWRXU DQG VKDSH GHSLFWLRQ UXOHV LQ D V\VWHP RI WKHVH D[HVHV D QG RWKHU REMHFW UHODWHG SDUDPHWHUV REMHFW UHODWHG LQIRUPDWLRQ  ZKLFK HQDEOH VXEVHTXHQW REMHFW UHFRQVWUXFWLRQ 7KDW LV H[DFWO\ ZKDW ZH KDYH SUHYLRXVO\ GHILQHG DV LQIRUPDWLRQ  7KDW LV WKH UHDVRQ ZK\ ZH VSHFLI\ WKLV LQIRUPDWLRQ DV ³SK\VLFDO LQIRUPDWLRQ´ EHFDXVH WKDW LV WKH RQO\ LQIRUPDWLRQ SUHVHQW LQ DQ LPDJH DQG WKHUHIRUH  WKH RQO\ LQIRUPDWLRQ WKDW FDQ EH H[WUDFWHG IURP DQ LPDJH  )RU WKDW UHDVRQLW PXVWEH GLVVRFLDWHG IURPWKH VHPDQWLFLQIRUPDWLRQ ZKLFKDV ZHXQGHUVWDQG QRZ LV D SURSHUW\ RI DQ H[WHUQDO REVHUYHU 7 KHUHIRUH LW PXVW EH WUHDWHG RU PRGHOHG LQDFFRUGDQFHZLWKVSHFLILFKLVKHUFRJQLWLYHLQIRUPDWLRQSURFHVVLQJUXOHV :KDW DUH WKHVH UXOHV" $ FRQVHQVXV YLHZ RQ WKLV WRSLF GRHV QRW H[LVW DV \HW LQ WKH ELRORJLFDO YLVLRQ WKHRULHV DQG LQ WKH FRPSXWHU YLVLRQ SUDFWLFH 6R ZH KDYH WR EOD]H RXURZQWUDLOV:HGHFLGHGWKXVWR PHHWWKLVFKDOOHQJHE\VXJJHVWLQJDQHZ DSSURDFK EDVHG RQ RXU SUHYLRXVO\ GHFODUHG LQIRUPDWLRQ HOLFLWDWLRQ SULQFLSOHV 7KH SUHOLPLQDU\ UHVXOWV RI RXU ILUVW DWWHPSW ZHUH SXEOLVKHG UHFHQWO\ LQ >@ $V LQ WKH FDVH RI SK\VLFDO LQIRUPDWLRQ ZH ZLOO QRW UHSHDW KHUH DOO WKH GHWDLOV RI WKLV SXEOLFDWLRQ :H ZLOO SURFHHGZLWKRQO\ DEULHI UHSURGXFWLRQRIVRPH FULWLFDOSRLQWVQHHGHG WRIROORZ XSRXU GLVFXVVLRQ +XPDQ¶V FRJQLWLYH DELOLWLHV LQFOXGLQJ WKH DSWQHVV IRU LPDJH LQWHUSUHWDWLRQ DQG WKH FDSDFLW\ WR DVVLJQ VHPDQWLFV WR DQ LPDJH D UH HPSRZHUHG E\ WKH H[LVWHQFH RI D KXJH NQRZOHGJH EDVH DERXW WKH WKLQJV LQ WKH VXUURXQGLQJ ZRUOG NHSW LQ KXPDQ EUDLQKHDG 7KLV NQRZOHGJH EDVH LV SHUPDQHQWO\ XSJUDGHG DQG XSGDWHG GXULQJ WKH KXPDQ¶V OLIH VSDQ 6R LI ZH LQWHQG WR HQGRZ RXU YLVXDO URERW ZLWK VRPH FRJQLWLYH FDSDELOLWLHV ZH KDYHWRSURYLGHLWZLWKVRPHWKLQJHTXLYDOHQWWRWKLVKXPDQNQRZOHGJHEDVH ,WJRHVZLWKRXWVD\LQJWKDWWKLVNQRZOHGJHEDVHZLOOQHYHUEHDVODUJHDQGGHYHORSHG DV LWV KXPDQ SURWRW\SH %XW ZH DUH QRW VXUH WKDW WKH UHTXLUHPHQW WR EH ODUJH DQG KXJH LV YDOLG LQ RXU FDVH $IWHU DOO KXPDQV DUH DOVR QRW HTXDO LQ WKHLU FRJQLWLYH FDSDFLW\ DQG WKH PDJQLWXGH WKH FRQWHQW RI WKHLU NQRZOHGJH EDVHV LV YHU\ GLYHUVLILHG WRR 7KH NQRZOHGJH EDVH RI DHULDO SKRWRJUDSKV LQWHUSUHWHU LV FHUWDLQO\ GLIIHUHQW IURP WKH NQRZOHGJHEDVHRIURHQWJHQLPDJHVLQWHUSUHWHURU,986LPDJHVRU3(7LPDJHV7KH NQRZOHGJH EDVH RI RXU YLVXDO URERW KDV WR EH VPDOO HQRXJK WR EH HIIHFWLYH DQG PDQDJHDEOH EXW VXIILFL HQWO\ DPSOH W R HQVXUH URERW¶V DFFHSWDEOH SHUIRUPDQFH &HUWDLQO\ IRU RXU IHDVLELOLW\ VWXG\ ZH FDQ EH VDWLVILHG HYHQ ZLWK D UHODWLYHO\ VPDOO VSHFLILFWDVNRULHQWHGNQRZOHGJHEDVH 7KHQH[W FUXFLDO SRLQWLV WKH NQRZOHGJHEDVH UHSUHVHQWDWLRQ LVVXH7R GHDO ZLWKLW ZH ILUVW RI DOO PXVW DUULYH DW D FRPPRQ DJUHHPHQW DERXW ZKDW LV WKH PHDQLQJ RI WKH WHUP ³NQRZOHGJH´ $ TXHVWLRQ WKDW XVXDOO\ KDV QRW D FRPPRQO\ DFFHSWHG DQVZHU :H VWDWH WKDW LQ RXU FDVH D VXLWDEOH DQG D VXIILFLHQW GHILQLWLRQ RI LW ZRXOG EH ³.QRZOHGJH LV D PHPRUL]HG LQIRUPDWLRQ´ &RQVHTXHQWO\ ZH FDQ VD\ WKDW NQRZOHGJH OLNH LQIRUPDWLRQ PXVW EH D KLHUDUFK\ RI GHVFULSWLYH LWHPV ZLWK WKH JUDGH RI GHVFULSWLRQ GHWDLOV JURZLQJ LQ D WRSGRZQ PDQQHU DW WKH GHVFHQGLQJ OHYHOV RI WKH KLHUDUFK\ :KDW HOVH PXVW EH PHQWLRQHG KHUH LV WKDW WKHVH GHVFULSWLRQV KDYH WR EH LPSOHPHQWHG LQ VRPH DOSKDEHW DV LW LV LQ WKH FDVH RI SK\VLFDO LQIRUPDWLRQ RU LQ D GHVFULSWLRQ ODQJXDJH ZKLFK EHWWHU ILWV WKH VHPDQWLF LQIRUPDWLRQ FDVH $Q\ IDUWKHU DUJXPHQW EHLQJ SXW DVLGH ZH ZLOO GHFODUH WKDW WKH PRVW VXLWDEOH ODQJXDJH LQ RXU FDVH LV D QDWXUDO KXPDQ ODQJXDJH $IWHU DOO WKH UHDO NQRZOHGJH EDVHV WKDW ZH DUH IDPLOLDU ZLWKDUHLPSOHPHQWHGRQDQDWXUDOKXPDQODQJXDJHEDVLV 7KH QH[W VWHS WKHQ LV SUHGHWHUPLQHG LI QDWXUDO ODQJXDJH LV D VXLWDEOH GHVFULSWLRQ LPSOHPHQWWKH VXLWDEOH IRUPRI WKLV LPSOHPHQWDWLRQ LVD QDUUDWLYH D VWRU\ WDOH >@  ,I WKHGHVFULSWLRQKLHUDUFK\ FDQEHVHHQ DVDQLQYHUWHG WUHHWKHQWKH EUDQFKHVRIWKLV WUHH DUH WKH VWRULHV WKDW HQFDSVXODWH KXPDQ¶V H[SHULHQFH ZLWK WKH VXUURXQGLQJ ZRUOG $QG WKHOHDYHV RIWKHVH EUDQFKHVDUH VLQJOHZRUGV IURP ZKLFK WKHVWRULHV DUHFRPSRVHG RI ,QFRPSXWHUYLVLRQWHUPLQRORJ\WKHVHVLQJOHZRUGVDUHGHILQHGDVQRGHV 7KH GHVFHQW LQWR GHVFULSWLRQ GHWDLOV KRZHYHU GRHV QRW VWRS KHUH DQG HDFK VLQJOH ZRUGFDQ EHIDUWKHU GHFRPSRVHGLQWRLWV DWWULEXWHVDQG UXOHVWKDW GHVFULEHWKH UHODWLRQV EHWZHHQ WKH DWWULEXWHV $W WKLV VWDJHWKH QRWLRQ RI SK\VLFDO LQIRUPDWLRQ FRPHV EDFN WR WKH JDPH %HFDXVH WKH ZRUGV DUH XVXDOO\ DVVRFLDWHG ZLWK SK\VLFDO REMHFWV LQ WKH UHDO ZRUOG ZRUGV¶ DWWULEXWHV PXVW EH VHHQ DV PHPRUL]HG SK\VLFDO LQIRUPDWLRQ GHVFULSWLRQV  2QFH GHULYHG E\ D YLVXDO V\VWHP IURP WKH REVHUYDEOH ZRUOG DQG OHDUQHG WR EH DVVRFLDWHG ZLWK D SDUWLFXODU ZRUG WKHVH SK\VLFDO LQIRUPDWLRQ GHVFULSWLRQV DUH VROGHUHG LQ LQWR WKH NQRZOHGJH EDVH 2EMHFW UHFRJQLWLRQ WKXV WXUQV RXW WR EH D FRPSDULVRQ DQG VLPLODULW\ WHVW EHWZHHQ FXUUHQWO\ DFTXLUHG SK\VLFDO LQIRUPDWLRQ DQG WKH RQH DOUHDG\ UHWDLQHG LQ WKH PHPRU\ ,I WKH VLPLODULW\ WHVW LV VXFFHVVIXO VWDUWLQJ IURP WKLV SRLQW LQ WKH KLHUDUFK\ DQG FOLPELQJ EDFN RQ WKH NQRZOHGJH EDVH ODGGHU ZH ZLOO REWDLQ ILUVW WKH OLQJXLVWLF ODEHO IRU D UHFRJQL]HG REMHFW DQG VHFRQG WKH SRVLWLRQ RI WKLV ODEHO ZRUG LQ WKH FRQWH[W RI WKH ZKROH VWRU\ ,QWKLV ZD\ REMHFW¶V PHDQLQJIXO FDWHJRUL]DWLRQ FDQEH DFTXLUHG D ILUVW VWDJHRI LPDJH DQQRWDWLRQ FDQ EH VXFFHVVIXOO\ DFFRPSOLVKHG SDYLQJ WKH ZD\ IRU IDUWKHU PHDQLQJIXO VHPDQWLFLPDJHLQWHUSUHWDWLRQ 2QH TXHVWLRQ KDV UHPDLQHG XQWRXFKHG LQ RXU GLVFRXUVH +RZ WKLV DUWLILFLDO NQRZOHGJH EDVH KDV WR EH LQLWLDOO\ FUHDWHG DQG EURXJKW LQWR WKH URERW¶V GLVSRVDO" 7KH YLJLODQW UHDGHU FHUWDLQO\ UHPHPEHUV WKH ILHUFH GHEDWHV DERXW OHDUQLQJ FDSDELOLWLHV RI QHXUDO QHWZRUNV DQG RWKHU PDFKLQH OHDUQLQJ WHFKQRORJLHV :H DUH DZDUH RI WKHVH GHEDWHV %XW LQ RXU FDVH WKH\ DUH LUUHOHYDQW IRU D VLPSOH UHDVRQ WKH WRSGRZQ IDVKLRQ RI WKH NQRZOHGJH EDVH GHYHORSPHQW SUHGHWHUPLQHV WKDW DOO UHVSRQVLELOLWLHV IRU NQRZOHGJHEDVHFUHDWLRQKDYHWREHSODFHGRQWKHVKRXOGHUVRIWKHURERWGHVLJQHU 6XFK DQ XQH[SHFWHG WZLVW LQ GHVLJQ SKLORVRSK\ ZLOO EH OHVV VXUSULVLQJ LI ZH UHFDOO WKDW KXPDQ FRJQLWLYH PHPRU\ LV DOVR RIWHQ GHILQHG DV D ³GHFODUDWLYH PHPRU\´  $QG WKH SULPH PRGH RI KXPDQ OHDUQLQJ LV WKH GHFODUDWLYH OHDUQLQJ PRGH ZKHQ WKH QHZ NQRZOHGJH LV H[SOLFLWO\ WUDQVIHUUHG WR D GHYHORSLQJ KXPDQ IURP KLV H[WHUQDO VXUURXQGLQJ )URP D IDWKHU WR D FKLOG IURP D WHDFKHU WR D VWXGHQW IURP DQ LQVWUXFWRU WR D WUDLQHH 7KHUH LV HYLGHQFH WKDW WKLV LV QRW DQ HVSHFLDOO\ KXPDQ SUHURJDWLYH (YHQ DQWV DUH WUDQVIHUULQJ NQRZOHGJH LQ D VLPLODU ZD\ >@  6R RXU SURSRVDO WKDW URERW¶V NQRZOHGJH EDVH KDV WR EH GHVLJQHG DQG FUHDWHG E\ WKH URERW VXSHUYLVRU LV VXIILFLHQWO\ FRUUHFWDQGLVILWWLQJRXUJHQHUDOFRQFHSWRILQIRUPDWLRQXVHDQGPDQDJHPHQW 4 Brain Vision Implications 6LQFH WKH EHJLQQLQJ RI WKH FRPSXWHU YLVLRQ DJH WKHUH ZDV D F RPPRQ EHOLHI WKDW ELRORJLFDO YLVLRQ LV DQ HQGOHVV VRXUFH RI LQVSLUDWLRQ IRU WKH FRPSXWHU YLVLRQ GHVLJQV DQG WKDW WKH PDLQ LGHDV ZKLFK XQGHUSLQ FRQWHPSRUDU\ FRPSXWHU YLVLRQ LPSOHPHQWDWLRQV DUH ERUURZHG IURP WKH IUXLWIXO ILHOGV RI ELRORJLFDO YLVLRQ UHVHDUFK ,Q WKH ,QWURGXFWLRQ 6HFWLRQ RI WKLV SDSHU ZH KDYH VKRZQ WKDW VXFK IDUIHWFKHG FUHGLWV DUH JURXQGOHVV ,Q WKH FRXUVH RI WLPH RQO\ WKH ERWWRPXS SURFHVVLQJ SKLORVRSK\ KDV UHPDLQHG DV D FRPPRQ IHDWXUH WKDW VWLOO FDQ EH IRXQG ERWK LQ ELRORJLFDO DQG LQ FRPSXWHUYLVLRQ GHVLJQV +RZHYHU SUDFWLFDO LPSOHPHQWDWLRQVRI WKLV SKLORVRSK\ KDYH OHG WR YHU\ GLIIHUHQW DQG LQFRPSDWLEOH GHYHORSPHQWV PDVVLYH '63ED VHG SDUDOOHO SURFHVVLQJ LQ FRPSXWHU YLVLRQ DQG VHOHFWLYH DWWHQWLRQEDVHG VHTXHQWLDO SURFHVVLQJ LQ ELRORJLFDO YLVLRQ 7KLV GLYHUJHQFH LV DQ DQQR\LQJ PLVIRUWXQH ,Q >@ , WULHG WR DOOHJH WKDWWKHUH PXVWEHD JHQHUDOXQGHUSLQQLQJ EDVLVDEOHWR UHFRQFLOHWKH WKLVGD\ GHWDFKHG VXEGLYLVLRQV, EHOLHYHWKDW WKHXQLILHG LQIRUPDWLRQSURFHVVLQJIUDPHZRUN SURSRVHGLQ WKLV SDSHU FDQ EH XVHIXOLQ SXUVXLQJ WKLV JRDO ,Q WKLV UHJDUG LW LV WHPSWLQJ WR VHH KRZ ELRORJLFDOYLVLRQ UHVHDUFKFDQ EHQHILWIURP WKH SURSRVHGQHZ LGHDVDQG WRZKDW H[WHQW HOHPHQWV RI WKHVH QHZ LGHDV FDQ EH GLVFHUQHG LQ WKH RQJRLQJ ELRORJLFDO YLVLRQ H[SHULPHQWV :KLOH WKH PDLQVWUHDP RI ELRORJLFDO YLVLRQ UHVHDUFK FRQWLQXHV WR DSSURDFK YLVXDO LQIRUPDWLRQ SURFHVVLQJ LQ D ERWWRPXS IDVKLRQ >@ LW WXUQV RXW WKDW WKH LGHD RI SULPDU\ WRSGRZQ SURFHVVLQJ ZDV QHYHU EHHQ H[WUDQHRXV WR ELRORJLFDO YLVLRQ 7KH ILUVW SXEOLFDWLRQV DGGUHVVLQJ WKLV LVVXH DUH GDWHG E\ WKH HDUO\ HLJKWLHV RI WKH ODVW FHQWXU\ 'DYLG 1DYRQ DW  >@ DQG /LQ &KHQ DW  >@ 7 KH SURPLQHQW DXWKRUVZHUHSHUVLVWHQW LQWKHLUYLHZVRQ WKHPDWWHUV DQGIDUWKHU UHVHDUFKUHSRUWV KDYH EHHQ SXEOLVKHG UHJXODUO\ XQWLO WKH UHFHQW WLPH >@ >@ +RZH YHU LW ORRNV OLNH WKH\ DOO KDYH EHHQ RYHUORRNHG ERWK LQ WKH ELRORJLFDO DQG LQ WKH FRPSXWHU YLVLRQ 2QO\ LQ WKH ODVW \HDUV D WLGH RI QHZ HYLGHQFH KDV DSSHDUHG WKDW GHILQLWHO\ DGYRFDWHV IRU WKH WRSGRZQSURFHVVLQJSULPRUGLDOLW\>@>@  7KH ILHOG RI FRJQLWLYH YLVLRQ LV QRW UHDG\ \HW WR OHDYH WKH WUDGLWLRQDO LQIRUPDWLRQ SURFHVVLQJ GRJPDV +RZHYHU VXSSRUWLQJ HYLGHQFH IRU D ³GHFODUDWLYH´ LQWHUSUHWDWLRQ RI SK\VLFDO LQIRUPDWLRQ FDQ EH DOUHDG\ IRXQG LQ >@ ZKHUH LW LV FRQYLQFLQJO\ VKRZQ KRZDFRORULVEHLQJ³DVVLJQHG´WRDQREMHFW .QRZOHGJH WUDQVIHU IURP WKH RXWVLGH DQG LQIRUPDWLRQ GHVFULSWLRQ H[FKDQJH LQ FRXUVH RI NQRZOHGJH EDVH EXLOGLQJ DQG GHFODUDWLYH OHDUQLQJ DFFRPSOLVKPHQW KDYH EHHQ REVHUYHG QRW RQO\ LQ KXPDQV 7KH\ DUH XELTXLWRXV H YHQ DPRQJ IDU PRUH SULPLWLYH OLYLQJ EHLQJV DQWV WKDW OHDUQ LQ WDQGHP >@ ZH KDYH DOUHDG\ PHQWLRQHG LQ 6HFWLRQ  7KH VRFDOOHG +RUL]RQWDO *HQH 7UDQVIHU UHVSRQVLEOH IRU DQWLELRWLF UHVLVWDQFH GHYHORSPHQW RI EDFWHULD >@ FDQ DOVR EH VHHQ DV D VXSSRUWLQJ HYLGHQFH IRU DWRSGRZQH[WHUQDONQRZOHGJHEDVHFUHDWLRQSKHQRPHQRQ +RZHYHU WKH PRVW VXUSULVLQJ LQVLJKWV DUH VWLOO DZDLWLQJ WKHLU IDUWKHU FODULILFDWLRQ DQG FRQILUPDWLRQ ,I RXU GHILQLWLRQ RI LQIRUPDWLRQ DV D GHVFULSWLRQ LV FRUUHFW WKHQ WKH FXUUHQWEHOLHI WKDW DVSLNLQJ QHXURQ EXUVWLV D YDOLGIRUP RI LQIRUPDWLRQ UHSUHVHQWDWLRQ DQGH[FKDQJH >@GRHV QRWKROG DQ\ PRUH9DULDQFHV LQ VSLNHV¶KHLJKWV RU GXW\WLPHV DUH QRW DQ DGHTXDWH DOSKDEHW WR LPSOHPHQW LQIRUPDWLRQ GHVFULSWLRQV RI D GHVLUHG FRPSOH[LW\ :H FDQ EROGO\ VSHFXODWH WKDW D ELRPROHFXODU DOSKDEHW ZRXOG EH D PXFK EHWWHU DQG DSSURSULDWH VROXWLRQ IRU VXFK FDVHV 6XSSRUW IRU WKLV NLQG RI VSHFXODWLRQV FDQEH GHULYHGIURPWKH UHFHQWDGYDQFHVLQ PROHFXODUELRORJ\ UHVHDUFK>@>@7KH VSLNHV WKDW ZH REVHUYH DQG LQYHVWLJDWH WRGD\ FRXOG EH VHHQ D V D UHIOHFWLRQ RI FKDUJHV WKDWDUHFDUULHGE\WKHLRQL]HGSDUWVRIWKHPROHFXODULQIRUPDWLRQPHVVDJHV 7KLV PROHFXODU GHVFULSWLRQ K\SRWKHVLV ILWV YHU\ ZHOO DOVR RXU QHZ EUDLQ PHPRU\ RUJDQL]DWLRQ WKHRU\ ZKLFK SUHWW\ ZHOO UHVHPEOHV WKH SDUDGLJP RI FRPSXWHU PHPRU\ XVH 'HQGULWH VSLQHV FDQ EH VHHQ DV D SURSHU DFFRPPRGDWLRQ IRU WKH PROHFXODU GHVFULSWRUV SURYLGLQJ D NLQG RI D ELRORJLFDO KDUGZDUH D ELRORJLFDO PHPRU\ EXIIHU ZKLFK LV DEOH WR KROG UHDGZULWHDEOH LQIRUPDWLRQ PHVVDJHV &RPSXWHU LQVSLUHG K\SRWKHVHV DERXW ³REMHFWILOHV´ >@ DQG ³HYHQW ILOHV´ >@  DUH UHSHDWHGO\ HPHUJLQJ LQ ELRORJLFDO YLVLRQ OLWHUDWXUH RYHU WKH ODVW GHFDGHV ,W ZRXOG EH LQWHUHVWLQJ WR QRWLFH WKDW WKH FRQFHSW RI D ELRORJLFDO HYHQW ILOH ILWV YHU\ ZHOO DOVR WKH QDUUDWLYH NQRZOHGJH UHSUHVHQWDWLRQK\SRWKHVLVSURSRVHGHDUOLHULQWKH6HFWLRQ )DUWKHU VXSSRUW IRU WKH LGHD WKDW D  FRPSOH[ LQIRUPDWLRQ GHVFULSWLRQ FDQ EH VWRUHG LQ DVLQJOH QHXURQ PHPRU\ FHOO FDQEH VHHQ LQ >@  ,Q WKLV FDVH DV ZHOOUHDFWLYDWLRQ DQG UHWULHYDO RI D PHPRUL]HG GHVFULSWLRQ UHVHPEOHV ZHOO WKH SDUDGLJP RI D FRPSXWHU PHPRU\ EDQN VWRUHIHWFK WUDQVDFWLRQ D VLQJOHBZULWHPXOWLSOHBUHDG PHPRU\ DFFHVV RSHUDWLRQ ,D PGHILQLWHO\ H[FLWHG E\ WKH RSWLRQV WKDW EUDLQ YLVLRQ UHVHDUFK FDQ JDLQ IURP VXFK D EDFN SURMHFWLRQ RI D FRPSXWHU YLVLRQ WKHRU\ DERXW WKH HVVHQFH RI LQIRUPDWLRQ RQ WKHLVVXHVRIPRGHOLQJYLVXDOLQIRUPDWLRQSURFHVVLQJLQKXPDQEUDLQ 5 Some concluding remarks ,QWKLVSDSHU ZHSURSRVHD QHZGHILQLWLRQ RILQIRUPDWLRQ LQSDUWLFXODUD GHILQLWLRQRI YLVXDO LQIRUPDWLRQ ZKLFK LV WKH SULPH SRLQW RI RXU FRQFHUQ 5HO\LQJ RQ WKLV GHILQLWLRQ D VXEVWDQWLDO SURJUHVV KDV EHHQ DFKLHYHG LQ PRGHOLQJ KXPDQOLNH LQWHOOLJHQWLPDJHSURFHVVLQJ 7KH DSSURDFK RXWOLQHG LQ WKLV SDSHU DSSHDUV WR FRQIOLFW ZLWK WKH PDLQVWUHDP RI UHVHDUFK DQG GHYHORSPHQW HQWHUSULVHV XQGHUWDNHQ LQ WKH IUDPH RI (XURSHDQ ,67 DQG 86$ 75(&9,' LQLWLDWLYHV >@ >@ 7KH PDLQ SRLQWV RI GLYHUJHQFH DUH DV IROORZV 7KH ERWWRPXS ZD\ RI LPDJH SURFHVVLQJ IURP ORFDO GHWDLOV W R PRUH JHQHUDO IRUPV RI UHSUHVHQWDWLRQ FRPPRQO\ DFFHSWHG WRGD\ DV WKH SUHIHUUHG SURFHVVLQJ DOWHUQDWLYH LV DSSOLFDEOH RQO\ LI WKH VLPLODULW\ PHWULFV FDQ EH VRPHKRZ GHILQHG D SULRU\ *HQHUDOO\ WKDW LV QRW WKH FDVH 7KH ULJKW ZD\ RI YLVXDO LQIRUPDWLRQ SURFHVVLQJ LV D WRSGRZQ IURPFRDUVHWRILQHSURFHVVLQJDOWHUQDWLYHDVLWLVSURSRVHGLQWKLVSDSHU 5HO\LQJ RQ WKH ERWWRPXS SURFHVVLQJ WKH ULJKW VWUXFWXUH RI WKH LQIRUPDWLRQ KLHUDUFK\ FDQ QHYHU EH FDXJKW SURSHUO\ 7KDW LV WKH VRXUFH RI PDQ\ GHDGIDOOV WKDW WKH PDLQVWUHDP D IILOLDWHV H[SHULHQFH RYHU DQG RYHU DJDLQ )RU H[DPSOH WKH XQOXFN\ DWWHPSWV WR VROYH WKH VHPDQWLF JDS SUREOHP VWHP IURP DQ LPSURSHU SODFHPHQW RI SHUFHSWXDO DQG FRJQLWLYH YLVLRQ IHDWXUHV RQ WKH VDPH KLHUDUFKLFDO OHYHO 7KH VDPH ERWWRPXS SUHIHUHQFHV SHUSHWXDOO\ GHUDLO WKH PDFKLQHOHDUQLQJEDVHG DSSURDFKHV IRU NQRZOHGJHLQIRUPDWLRQ DFTXLVLWLRQ DQG KDQGOLQJ )URP D WRSGRZQ SURFHVVLQJ SHUVSHFWLYH D ³PDFKLQH WHDFKLQJ´ DSSURDFK ZKHQ NQRZOHGJH LV EURXJKW LQWR IURP WKHRXWVLGHORRNVDVDIDUPRUHDSSURSULDWHVROXWLRQ 7KH H[DPSOHV PHQWLRQHG DERYH GR QRW H[KDXVW WKH OLVW RI FKDQJHV WKDW PXVW EH LPSRVHGRQ WKH PDLQVWUHDP SURMHFWV LIWKH QHZ LQIRUPDWLRQ SURFHVVLQJ UXOHVDUH WDNHQ LQWRWKHFRQVLGHUDWLRQ ,WLVREYLRXVW KDWWKHVHUXOHVDUH LQFRPSOHWHDQGWHQWDWLYHVLQFH WKLVLV MXVW D ILUVWVWHS DQG IXUWKHUUHVHDUFK UHPDLQV WR EHGRQH 7KH HQWHUSULVH WKDWZH DUH DLPHG DW LV QRW D WDVN IRU D VLQJOH SHUVRQ RU D VPDOO JURXS RI GHYHORSHUV ,W UHTXLUHV FRQVROLGDWHG HIIRUWV RI PDQ\ LQWHUHVWLQJ SDUWLHV :H KRSH WKDW WKH WLPH IRU WKLVFROODERUDWLRQLVQRWIDUDZD\ 5HIHUHQFHV  0/ .KHIUL ' =LRX $ %HUQDUGL ³,PDJH 5HWULHYDO )URP WKH :RUOG :LGH :HE ,VVXHV 7HFKQLTXHV DQG 6\VWHPV´ $&0 &RPSXWLQJ 6XUYH\V  YRO  QR  SS  0DUFK   '0LOQHU DQG0 *RRGDOH³7KH 9LVXDO%UDLQ LQ$FWLRQ´ 2[IRUG3V\FKRORJ\ 6HULHV 1 R 2[IRUG8QLYHUVLW\3UHVV   ' 0DUU ³9LVLRQ $ &RPSXWDWLRQDO ,QYHVWLJDWLRQ LQWR WKH +XPDQ 5HSUHVHQWDWLRQ DQG 3URFHVVLQJRI9LVXDO,QIRUPDWLRQ´)UHHPDQ6DQ)UDQFLVFR   $ 7UHLVPDQ DQG * *HODGH ³$ IHDWXUHLQ WHJUDWLRQ WKHRU\ RI DWWHQWLRQ´ &RJQLWLYH 3V\FKRORJ\ YROSS-DQ  ,%LHGHUPDQ³5HFRJQLWLRQE\&RPSRQHQWV$7KHRU\RI+XPDQ,PDJH8QGHUVWDQGLQJ´ 3V\FKRORJLFDO5HYLHZ YROQRSS  / : %DUVDORX ³3HUFHSWXDO V\PERO V\VWHPV´ %HKDYLRUDO DQG %UDLQ 6FLHQFHV  YRO  SS  7 3DOPHUL DQG , *DXWKLHU ³9LVXDO 2EMHFW 8QGHUVWDQGLQJ´ 1 DWXUH 5HYLHZV 1HXURVFLHQFHYRO SS$SULO  $ 7UHLVPDQ ³7KH ELQGLQJ SUREOHP´ &XUUHQW 2SLQLRQ LQ 1HXURELRORJ\  YRO  SS  6) &KDQJ :< 0D $ 6PHXOGHUV ³5HFHQW $GYDQFHV D QG &KDOOHQJHV RI 6HPDQWLF ,PDJH9LGHR6HDUFK´,Q 3URFHHGLQJVRIWKH ,(((,QWHUQDWLRQDO&RQIHUHQFH RQ$FRXVWLFV 6SHHFKDQG6LJQDO3URFHVVLQJ,&$663 KWWSVWDIIVFLHQFHXYDQO aVPHXOGHU!   06 /HZ 1 6HEH & 'MHUDED 5 -DLQ ³&RQWHQWEDVHG 0XOWLPHGLD ,QIRUPDWLRQ 5HWULHYDO 6WDWH RI WKH $UW DQG &KDOOHQJHV´ ,Q $&0 7UDQVDFWLRQV RQ 0XOWLPHGLD &RPSXWLQJ&RPPXQLFDWLRQVDQG$SSOLFDWLRQV )HEUXDU\  $ 0RMVLORYLF DQG% 5RJRZLW] ³&DSWXULQJ LPDJH VHPDQWLFVZLWK ORZOHYHO GHVFULSWRUV´ ,Q 3URFHHGLQJV RI WKH ,QWHUQDWLRQDO &RQIHUHQFH RQ ,PDJH 3URFHVVLQJ ,&,3  SS 7KHVVDORQLNL*UHHFH2FWREHU  & =KDQJ DQG 7 &KHQ ³)URP /RZ /HYHO )HDWXUHV WR +LJK /HYHO 6HPDQWLFV´ ,Q +DQGERRN RI 9LGHR 'DWDEDVHV 'HVLJQ DQG $SSOLFDWLRQV  E\ )XUKW %RUNR 0DUTXHV 2JH 3XEOLVKHU&5&3UHVV2FWREHU  . 0F5DH ³6HPDQWLF 0HPRU\ 6RPH LQVLJKWV IURP )HDWXUHEDVHG &RQQHFWLRQLVW $WWUDFWRU1HWZRUNV´(G%+ 5RVV 7KH3V\FKRORJ\ RI/HDUQLQJDQG 0RWLYDWLRQ YRO $YDLODEOHKWWSDPGUDHVVFXZRFD  & -RKDQVVRQ DQG $ /DQVQHU³$WWUDFWRU 0HPRU\ ZLWK 6HOIRUJDQL]LQJ ,QSXW´ :RUNVKRS RQ %LRORJLFDOO\ ,QVSLUHG $SSURDFKHV WR $GYDQFHG ,QIRUPDWLRQ 7HFKQRORJ\ %LR$',7  /1&6YROSS6SULQJHU9HUODJ  6 7UHXH ³9LVXDODWWHQWLRQ WKH ZKHUHZKDW KRZ DQG ZK\ RIVDOLHQF\´ &XUUHQW 2SLQLRQ LQ1HXURELRORJ\ YROSS  /, WWL³0RGHOVRI%RWWRP8S$WWHQWLRQDQG 6DOLHQF\´,Q 1HXURELRORJ\RI $WWHQWLRQ / ,WWL*5HHV-7VRWVRV(GVSS6DQ'LHJR&$(OVHYLHU  - +DUH 3 /HZLV 3 (QVHU & 6DQGRP ³0LQG WKH *DS $QRWKHU ORRN DW WKH SUREOHP RI WKH VHPDQWLF JDS LQ LPDJH UHWULYDO´ 3URFHHGLQJV RI 0XOWLPHGLD &RQWHQW $QDO\VLV 0DQDJHPHQW DQG 5HWULHYDO &RQIHUHQFH  63,( YRO   $YDLODEOH KWWSZZZHFVVRWRQDFXNSHRSOH  5 - 6RORPRQRII ³7KH 'LVFRYHU\ RI $OJRULWKPLF 3UREDELOLW\´  -RXUQDO RI &RPSXWHU DQG 6\VWHP6FLHQFH YRO1RSS  * - &KDLWLQ ³$OJRULWKPLF ,QIRUPDWLRQ 7KHRU\´ ,%0 -RXUQDO RI 5HVHDUFK DQG 'HYHORSPHQW YROSS  $ .ROPRJRURY ³7KUHH DSSURDFKHV WR WKH TXDQWLWDWLYH GHILQLWLRQ RI LQIRUPDWLRQ´ 3UREOHPVRI,QIRUPDWLRQDQG7UDQVPLVVLRQ YRO1RSS  / )ORULGL ³7UHQGV LQ WKH 3KLORVRSK\ RI ,QIRUPDWLRQ´ ,Q 3 $GULDDQV - YDQ %HQWKHP (GV ³+DQGERRN RI 3KLORVRSK\ RI ,QIRUPDWLRQ´  (OVHYLHU IRUWKFRPLQJ $YDLODEOH KWWSZZZSKLORVRSK\RILQIRUPDWLRQQHW  ( 'LDPDQW ³,PDJH LQIRUPDWLRQ FRQWHQW HVWLPDWLRQ DQG HOLFLWDWLRQ´ :6($6 7UDQVDFWLRQ RQ&RPSXWHUV YROLVVSS$SULOKWWSZZZZRUOGVHVRUJMRXUQDOV  ( 'LDPDQW³7RS'RZQ 8QVXSHUYLVHG ,PDJH6HJPHQWDWLRQLW VRXQGV OLNHDQ R[\PRURQ EXW DFWXDOO\ LW LVQ¶W´  3URFHHGLQJV RI WKH UG 3DWWHUQ 5HFRJQLWLRQ LQ 5HPRWH 6HQVLQJ :RUNVKRS3556¶ .LQJVWRQ8QLYHUVLW\8.$XJXVW  ( 'LDPDQW ³6HDUFKLQJ IRU LPDJH LQIRUPDWLRQ FRQWHQW LWV GLVFRYHU\ H[WUDFWLRQ DQG UHSUHVHQWDWLRQ´ -RXUQDORI(OHFWURQLF,PDJLQJ YROLVVXH-DQXDU\0DUFK  ('LDPDQW³'RHVDSODQHLPLWDWHDELUG"'RHVFRPSXWHUYLVLRQKDYHWRIROORZELRORJLFDO SDUDGLJPV"´ ,Q 'H *UHJRULR 0 HW DO (GV %UDLQ 9LVLRQ DQG $UWLILFLDO ,QWHOOLJHQFH )LUVW ,QWHUQDWLRQDO 6\PSRVLXP 3URFHHGLQJV /1&6 YRO  6SULQJHU9HUODJ SS $YDLODEOHKWWSZZZYLGLDPDQWLQIR  3 9LWDQ\L ³0HDQLQJIXO ,QIRUPDWLRQ´ ,((( 7UDQVDFWLRQV RQ ,QIRUPDWLRQ 7KHRU\  YRO 1RSS2FWREHU$YDLODEOHKWWSZZZFZLQOaSDXOYSDSHUV  0 1DSKDGH DQG 7 6 +XDQJ ³([WUDFWLQJ 6HPDQWLFV )URP $XGLRYLVXDO &RQWHQW 7KH )LQDO )URQWLHU LQ 0XOWLPHGLD 5HWULHYDO´ ,((( 7UDQVDFWLRQV RQ 1HXUDO 1HWZRUNV  YRO  1RSS-XO\  - -LWHQ % 0HULDOGR % +XHW ³6HPDQWLF )HDWXUH ([WUDFWLRQ ZLWK 0XOWLGLPHQVLRQDO +LGGHQ 0DUNRY 0RGHO´ 63,( &RQIHUHQFH RQ 0XOWLPHGLD &RQWHQW $QDO\VLV 0DQDJHPHQW DQG5HWULHYDO -DQXDU\6DQ-RVH86$63,(YROSS  ;LDQJ 6HDQ =KRX 76 +XDQJ ³&%,5 )URP ORZ/HYHO )HDWXUHV WR +LJK/HYHO 6HPDQWLFV 3URFHHGLQJV 63,(  YRO  SS  6DQ -RVH &$ -DQXDU\  $YDLODEOHKWWSZZZLISXLXFHGXa[]KRX  . 3HWULGLV , .RPSDWVLDULV 0 6WULQW]LV 6 %ORHKGRUQ 6 +DQGVFKXK 6 6WDDE 1 6LPRX 9 7]RXYDUV < $YULWKLV ³.QRZOHGJH 5HSUHVHQWDWLRQ IRU 6HPDQWLF 0XOWLPHGLD &RQWHQW $QDO\VLV DQG 5HDVRQLQJ´ ,((( 7UDQVDFWLRQV RQ &697  YRO  1R  SS 2FWREHU$YDLODEOHKWWSZZZLWLJUGESKSSXEOLFDWLRQV  ( 'LDPDQW ³,Q 4XHVW RI ,PDJH 6HPDQWLFV $UH :H /RRNLQJ IRU ,W 8QGHU WKH 5LJKW /DPSSRVW"´$YDLODEOHKWWSDU[LYRUJDEVFV&9  0 7XIILHOG 1 6KDGEROW ' 0LOODUG ³1DUUDWLYHV DV D )RUP RI .QRZOHGJH 7UDQVIHU 1DUUDWLYH 7KHRU\ DQG 6HPDQWLFV´ 3URFHHGLQJV RI WKH VW $.7 $GYDQFH .QRZOHGJH 7HFKQRORJLHV6\PSRVLXP0LOWRQ.H\QHV8.-XQH  1 )UDQNV 7 5LFKDUGVRQ ³7HDFKLQJ LQ WDQGHPUXQQLQJ DQWV´ 1DWXUH   S  -DQXDU\  7 6HUUH0 .RXK &&DGLHX 8 .QREOLFK* .UHLPDQ7 3RJJLR ³$7KHRU\ RI2EMHFW 5HFRJQLWLRQ &RPSXWDWLRQV DQG &LUFXLWV LQ WKH )HHGIRUZDUG 3DWK RI WKH 9HQWUDO 6WUHDP LQ 3ULPDWH 9LVXDO &RUWH[´ $, 0HPR   &%&/ 0HPR  0,7 &DPEULGJH 1RYHPEHU$YDLODEOHKWWSZHEPLWHGXVHUUHSXEOLFDWLRQV  ' 1DYRQ ³)RUHVW %HIRUH 7UHHV 7KH 3UHFHGHQFH RI *OREDO )HDWXUHV LQ 9LVXDO 3HUFHSWLRQ´ &RJQLWLYH3V\FKRORJ\   SS  /&KHQ³7RSRORJLFDOVWUXFWXUHLQYLVXDOSHUFHSWLRQ´ 6FLHQ FH SS  ' 1DYRQ ³:KDW GRHV D FRPSRXQG OHWWHU WHOO WKH SV\FKR ORJLVW¶V PLQG"´ $FWD 3V\FKRORJLFD YROSS  / &KHQ ³7KH WRSRORJLFDO DSSURDFK WR SHUFHSWXDO RUJDQL]DWLRQ´ 9LVXDO &RJQLWLRQ  YRO QRSS  0 $KLVVDU 6 +RFKVWHLQ ³ 7KH UHYHUVH KLHUDUFK\ WKHRU\ RI YLVXDO SHUFHSWXDO OHDUQLQJ´ 7UHQGVLQ&RJQLWLYH6FLHQFH YROQRSS    &+ -XDQ * &DPSDQD 9 :DOVK ³&RUWLFDO LQWHUDFWLRQV LQ YLVLRQ DQG DZDUHQHVV KLHUDUFKLHVLQUHYHUVH´ 3URJUHVVLQ%UDLQ5HVHDUFK YROSS  7 +DQVHQ 0 2ONNRQHQ 6 :DOWHU  . *HJHQIXUWQHU ³0HPRU\ PRGXODWHV FRORU DSSHDUDQFH´ 1DWXUH1HXURVFLHQFH YROQRSS 1RYHPEHU  - /DZUHQFH + +HQGULFNVRQ ³/DWHUDO JHQH WUDQVIHU ZKHQ ZLOO DGROHVFHQFH HQG"´ 0ROHFXODU0LFURELRORJ\ YROQRSS  . 'LED & .RFK , 6HJHY ³6SLNH SURSDJDWLRQ LQ GHQGULWHV ZLWK VWRFKDVWLF LRQ FKDQQHOV´ -RXUQDORI&RPSXWDWLRQDO1HXURVFLHQFH YROSS  ( .DQGHO³7KH 0ROHFXODU %LRORJ\RI 0HPRU\ 6WRUDJH $'LDORJXH %HWZHHQ *HQHVDQG 6\QDSVHV´ 6FLHQFH YROSS1RYHPEHU  $ 5RXWWHQEHUJ - 5HNDUW ³3RVWWUDQVODWLRQDO SURWHLQ PRGLILFDWLRQ DV WKH VXEVWUDWH IRU ORQJODVWLQJPHPRU\´ 75(1'6LQ1HXURVFLHQFHV YROQRSS-DQXDU\  ' .DKQHPDQ $ 7UHLVPDQ % *LEEV ³7KH UHYLHZLQJ RI REMHFW ILOHV 2EMHFWVSHFLILF LQWHJUDWLRQRILQIRUPDWLRQ´ &RJQLWLYH3V\FKRORJ\ YROSS  % +RPPHO ³(YHQW ILOHV )HDWXUH ELQGLQJLQ DQG DFURVV SHUFHSWLRQ DQG DFWLRQ´ 75(1'6 LQ&RJQLWLYH6FLHQFHV YROQRSS  6 :D\GR $ .UDVNRY 5 4XLURJD , )UHLG DQG & .RFK ³6SDUVH 5HSUHVHQWDWLRQ LQ WKH +XPDQ0HGLDO7HPSRUDO/REH´ 7KH-RXUQDO RI1HXURVFLHQFH YRO QR SS 2FWREHU  (XURSHDQ ,67 5HVHDUFK  %XLOGLQJ RQ $VVHWV 6HL]LQJ 2SSRUWXQLWLHV $YDLODEOHKWWSHXURSDHXLQWLQIRUPDWLRQBVRFLHW\  32YHU7,DQHYD:.UDDLM$6PHDWRQ³75(&9,'±$Q2YHUYLHZ´$YDLODEOH KWWSZZZXYHVaW]YHWD