www.redpel.com +917620593389
*HVWXUH5HFRJQLWLRQ6\VWHPIRU:KHHOFKDLU&RQWURO 8VLQJD'HSWK6HQVRU 1RUL\XNL.DZDUD]DNL
$OHMDQGUR,VUDHO%DUUDJDQ'LD] 'HSWRI5RERWLFVDQG0HFKDWURQLFV .DQDJDZD,QVWLWXWHRI7HFKQRORJ\ .DQDJDZD-DSDQ
'HSWRI5RERWLFVDQG0HFKDWURQLFV .DQDJDZD,QVWLWXWHRI7HFKQRORJ\ .DQDJDZD-DSDQ NDZDUD#UPNDQDJDZDLWDFMS
$QDVWDVLRX'SRLQWVRXWWKHVHYHUDOGLIILFXOWLHVWKDWSK\VLFDOO\ FKDOOHQJHG SHRSOH PLJKW HQFRXQWHU GXULQJ WKHLU GDLO\ WDVNV VXFKDVUHDFKLQJDFXSERDUGRSHQLQJDGRRURUFKDQJLQJ79 FKDQQHOV >@>@ 7KLV UHVHDUFK SXUVXLWV WKH REMHFWLYH RI SURYLGLQJ D V\VWHP ZKLFK DOORZV WKH SK\VLFDOO\ FKDOOHQJHG SHRSOHWRPDNHXVHRIWKHLUERWKXSSHUOLPEVZKLOHVWLOODEOHWR FRQWURO WKH ZKHHOFKDLU DW WKH VDPH WLPH 6R IDU GLIIHUHQW DSSURDFKHVWRLPSURYHWKHXVHULQWHUIDFHRQ(3:VKDYHEHHQ VWXGLHGVXFKDV7$2SURMHFWV>@DQGWKH5ROODQGSURMHFW>@ 7KH 5RERWLF :KHHOFKDLU EDVHG RQ WKH ,QWHJUDWLRQ RI KXPDQ HQYLURQPHQWDOREVHUYDWLRQVLVSURSRVHG>@7KHIDFHWUDFNLQJ DQG WKH YRLFH UHFRJQLWLRQ DUH XVHG IRU WKH LQWHUIDFH RI FRQWUROOLQJ WKH HOHFWULFSRZHUHG ZKHHOFKDLU >@ 7KH PDLQ EDUULHUV WR WKH UHVHDUFKHV XWLOL]LQJ LPDJH SURFHVVLQJ IRU JHVWXUH UHFRJQLWLRQ VXFK DV PLVXQGHUVWDQGLQJ RI WKH XVHU LQLWLDO LQWHQWLRQV G\QDPLFDOO\ FKDQJLQJ DQG FOXWWHUHG EDFNJURXQG YDULDWLRQV RI WKH LOOXPLQDWLRQ FRQGLWLRQV DQG XQH[SHFWHG PRYHPHQWV IURP WKH XVHU DUH KLJKOLJKWHG LQ UHIHUHQFH >@ ,Q UHFHQW \HDUV WKH .LQHFW VHQVRU LV XVHG IRU UHFRJQLWLRQ RI WKH KXPDQ PRWLRQ RU HQYLURQPHQW LQ RUGHU WR FRQWURO WKH ZKHHO FKDLU > @>@ 7KH UHYHUVLQJ VDIHW\ DVVLVWDQFHV\VWHPIRUHOHFWULFZKHHOFKDLUVLVGHYHORSHG>@ 7KLV UHVHDUFK SURSRVHV D V\VWHP WR DLG WKH SK\VLFDOO\ FKDOOHQJHG SHRSOH ZKR DUH XVHUV RI (3:V E\ HQKDQFLQJ WKH FRQWURO LQWHUIDFH WKURXJK KDQG JHVWXUHV UHFRJQLWLRQ DQG LPSOHPHQWLQJDGHSWK VHQVRUDQGDQDWXUDOLQWHUDFWLRQOLEUDU\ WR IXOILOO LWV FRPPLW 7KH SURSRVHG V\VWHP RIIHUV D ³KDQGV IUHHGRP´VHQVHWRWKHXVHUVLPSOLI\LQJWKHLUGDLO\DFWLYLWLHVE\ XVLQJWKHKDQGVPRYHPHQWVDVWKHGLUHFWLRQFRQWUROLQSXW,WLV D YLUWXH RI WKLV SURMHFW WR EH DEOH WR UHFRJQL]H RQH SUHGHWHUPLQHGJHVWXUHWRLQLWLDOL]HWKH KDQGWUDFNLQJ IXQFWLRQ DQG WKHQ VWRS WKH WUDFNLQJ DW ZLOO 7KHUHIRUH WKH XVHU FDQ SHUIRUPDQ\RWKHUDFWLYLWLHVZLWKERWKKDQGVZKLOHEHLQJDEOH WRPDQLSXODWHWKH(3:VDWWKHVDPHWLPH 7KLVSDSHULVODLGRXWDVIROORZV LQVHFWLRQ,,WKHSURSRVHG V\VWHP DQG LWV FRPSRQHQWV DUH SUHVHQWHG 6HFWLRQ ,,, GHWDLOV WKHJHVWXUHUHFRJQLWLRQV\VWHPDQGWKH6HFWLRQ,9FRQWDLQVWKH H[SHULPHQWV DQG UHVXOWV 7KH FRQFOXVLRQ DQG IXWXUH ZRUN DUH VKRZQLQVHFWLRQ9
$EVWUDFW±,QXVXDOZKHHOFKDLUXVHUFRQWUROWKHZKHHOFKDLUXVLQJ WKH MR\VWLFN +RZHYHU WKH XVHU FDQ¶W FRQWURO WKH MR\VWLFN ZKHQ WKH XVHU KROGV DQ REMHFW E\ ERWK KDQGV :H KDYH GHYHORSHG D JHVWXUHFRQWUROV\VWHPRIWKHZKHHOFKDLU7KLVV\VWHPFRQVLVWVRI DQHOHFWULFSRZHUHGZKHHOFKDLUZLWKDQH[SHULPHQWDOVWUXFWXUHD GHSWK VHQVRU DQG D 3& ,Q RXU V\VWHP WKH ZKHHOFKDLU PRYHV DFFRUGLQJ WR WKH SRVLWLRQ RI WKH KDQG :H XVH D GHSWK VHQVRU LQ RUGHUWRUHFRJQL]HWKHKDQGJHVWXUHTXLFNO\7KHSURSRVHGV\VWHP RIIHUVD³KDQGVIUHHGRP´VHQVHWRWKHXVHUVLPSOLI\LQJWKHLUGDLO\ DFWLYLWLHVE\XVLQJWKHKDQGV PRYHPHQWVDVWKHGLUHFWLRQFRQWURO LQSXW 7KH HIIHFWLYHQHVV RI RXU V\VWHP LV FODULILHG E\ VHYHUDO H[SHULPHQWDOUHVXOWV .H\ZRUGV ± :KHHOFKDLU LQWHUIDFH *HVWXUH UHFRJQLWLRQ 'HSWK LPDJHVHQVRU1DWXUDOLQWHUDFWLRQOLEUDU\
,,1752'8&7,21 7KH GHYHORSPHQW RI V\VWHPV WKDW UHFRJQL]H KXPDQ SHUIRUPHGJHVWXUHVKDYHJURZQLQLQWHUHVWIRUWKHUHVHDUFKHUV LQ WKH UHFHQW \HDUV ,Q SDUWLFXODU IRU LQYHVWLJDWLRQV LQYROYLQJ DVVLVWLYH V\VWHPV WR DLG SHRSOH ZKR KDYH ORVW SV\FKRPRWRU FDSDELOLWLHV GXH WR WUDJLF LQFLGHQWV RU WKHLU ERG\ PRYHPHQWV DUH UHVWULFWHG E\ VHYHUDO SK\VLFDO FRQGLWLRQV 7KLV LV WKH FDVH RI PRVW RI ZKHHOFKDLU XVHUV 'HVSLWH RI DOO WKH JUHDW HIIRUWV PDGH VR IDU E\ HQJLQHHUV DQG GHYHORSHUV WR SURYLGH D XVHU IULHQGO\ LQWHUIDFH WR FRQWURO HOHFWULFSRZHUHG ZKHHOFKDLUV (3:V OLNHWKHMR\VWLFNWKHXVHUVILQGWKHPVHOYHVLQGLIIHUHQW VLWXDWLRQV ZKLFK GHPDQG QHZ DQG PRUH LQWXLWLYH ZD\V WR RSHUDWH WKH (3:V )RU H[DPSOH D KRXVHZLIH ZKR LV D ZKHHOFKDLU XVHU PLJKW H[SHULHQFH VRPH JOLWFKHV ZKHQ FRRNLQJ LQ WKH NLWFKHQ FDUU\LQJ KRW SRWV FRQWDLQLQJ WKH UHVLGXHVRIERLOLQJRLOIURPWKHVWRYHWRWKHWDEOH,WUHVWUDLQV WKHXVHUIURPLQWHUDFWLQJZLWKWKHMR\VWLFN 7KH LPSOHPHQWDWLRQ DQG UHVHDUFK RI KDQG JHVWXUH WHFKQLTXHV KDYH EHHQ VWXGLHG IRU PRUH WKDQ WZR GHFDGHV >@ 1HYHUWKHOHVV WKH GLIIHUHQW FRQGLWLRQV RI WKH (3:V XVHUV OLNH HQYLURQPHQW FXOWXUDO UHVWULFWLRQV OLIHVW\OH DQG SK\VLFDO OLPLWDWLRQV WR PHQWLRQ VRPH GLIIHUV VLJQLILFDQWO\ IURP RQH LQGLYLGXDO WR DQRWKHU )RU LQVWDQFH D ODUJH QXPEHU RI KRXVHKROGHTXLSPHQWDUHVWUXFWXUHGLQDWUDGLWLRQDOPDQQHULQ -DSDQ VR WKH WDWDPL LV VHWWOHG GRZQ DOO RYHU WKH IORRU 7KLV UHVWULFWV WKH XVDJH RI WKH (3:V LQVLGH WKH KRXVH 7KHVH YDULDWLRQV KDYH DV D UHVXOW QXPHURXV VLWXDWLRQV DIIHFWLQJ WKH XVHUV WKDW KDYH QRW EHHQ DSSURDFKHG \HW LQ D SURSHU PDQQHU
c 978-1-4673-5907-8/13/$31.00 2013 IEEE
,,7+(6<67(0$1',76&20321(176 )LJXUH VKRZV WKH SLFWXUH RI WKH ZKHHOFKDLU ZLWK WKH PRXQWHG FRPSRQHQWV RI WKH V\VWHP )LJXUH VKRZV WKH IROORZLQJHOHPHQWV
48
www.redpel.com +9176205933891
x x x x x x
$686;WLRQ352'HSWK,PDJH6HQVRU 6LOLFRQ/DEV&3[86%WR8$57%ULGJH 726+,%$ '\QDERRN ,QWHO L±0 *+] SURFHVVRUZLWK2SHQ1,DQG1,7( <$0$+$-:;$FWLYHZKHHOFKDLU :KHHOFKDLUFRQWUROPRGXOH ([SHULPHQWDOVWUXFWXUH
7KH:KHHOFKDLUPRXQWVWKHH[SHULPHQWDOVWUXFWXUHVRDVWR GHWHUPLQHWKHVXLWDEOHSRVLWLRQDQGDQJOHRIWKHGHSWKVHQVRU ,Q )LJXUH WKH V\VWHP IORZ FKDUW VKRZV WKH LQWHUDFWLRQ RI HDFK RQH RI WKH HOHPHQWV 7KH ZKHHOFKDLU -:; IURP
)LJXUH6\VWHPIORZFKDUW $7KH:KHHOFKDLU 0DQXDOPRGH 7KH-:; LV GHVLJQHG LQ VXFK D PDQQHU WKDW WKH PRWRUV DUHORFDWHGLQWKHFHQWHURIWKHPDLQZKHHOV7KLVIHDWXUHDQG WKH PHFKDQLFDO FRQILJXUDWLRQ SURYLGHV WR WKH XVHU ZLWK WKH SRVVLELOLW\RIGULYLQJWKHZKHHOFKDLUZLWKRXWWKHHQHUJ\VRXUFH 2QWKHULJKWVLGHWKHZKHHOFKDLUKDVDEXLOWLQOHYHUWRFKRRVH IURPWZRSRVVLEOHRSWLRQV ዘ&RQYHQWLRQDOQRQHOHFWULFZKHHOFKDLU ዘ(OHFWULF:KHHOFKDLU -R\VWLFN0RGH 2QFH WKH :KHHOFKDLU LV FRQILJXUHG WR EH GULYHQ ZLWK WKH SRZHU VRXUFH DQG WKH HQHUJ\ VZLWFK LV ³21´ HDFK PRWRU EORFNVWKHIUHHPRYHPHQWRIWKHZKHHOVDQGWKHXQLWLVUHDG\ WREHFRQWUROOHGE\WKH-R\VWLFN *HVWXUH0RGH ,QILJXUHWKHGLIIHUHQWSRVVLEOHPRGHVWRGULYHWKH-:; DUH GHWDLOHG 7R PDNH XVH RI WKH *HVWXUH 0RGH WKH V\VWHP KDVWRPHHWWZRFRQGLWLRQV ࣭(QHUJ\VZLWFK21 ࣭-R\VWLFN0RGH21
)LJXUH6\VWHPRYHUYLHZ
)LJXUH7UDQVLWLRQRIWKHV\VWHPVWDWXV
)LJXUH7KH6\VWHPHOHPHQWV
2QFHWKHVHFRQGLWLRQVDUHPHWWKHFRPSXWHUPXVWEHUHDG\ WR VHQG WKH ILUVW FRPPDQG WR WKH FRQWUROOHU WKURXJK VHULDO FRPPXQLFDWLRQ 7KLV ILUVW FRPPDQG LQLWLDOL]HV WKH FRQWUROOHU DQG LQWHUUXSWV WKH -R\VWLFN VLJQDOV IURP PDQLSXODWLQJ WKH
2013 IEEE Symposium on Computational Intelligence in Rehabilitation and Assistive Technologies (CIRAT)
www.redpel.com +9176205933892
49
PRWRUV ,QVWHDG WKH FRQWUROOHU RSHUDWHV WKH ZKHHOV DFFRUGLQJ WRWKHGDWDUHFHLYHG IURPWKHFRPSXWHU7RUHWXUQWR-R\VWLFN 0RGH WKH V\VWHP QHHGV WR EH UHERRWHG 7KH SURFHVV IRU JHVWXUHUHFRJQLWLRQDQGDGGLWLRQDOGHWDLOVDERXW*HVWXUH0RGH DUHGLVFXVVHGLQVHFWLRQ,,, %'HSWK,PDJH6HQVRU 7KH GHSWK LPDJH VHQVRU LV PDLQ VRXUFH RI GDWD UHJDUGLQJ WKH XVHU PRYHPHQWV DQG LQVWUXFWLRQV %DVLFDOO\ WKLV FRPSRQHQWDFWVDVWKHLQWHUIDFLQJHOHPHQWEHWZHHQWKHV\VWHP DQGWKHXVHU3URGXFHGE\$VXVWKH;WLRQ352/LYHKDVWKUHH EXLOWLQVHQVRUV x 5*%6HQVRU±7KLVFDPHUDDLGVLQIDFLDOUHFRJQLWLRQDQG RWKHU IHDWXUHV E\ GHWHFWLQJ WKUHH FRORU FRPSRQHQWV UHG JUHHQDQGEOXH x 'HSWK6HQVRU±$QLQIUDUHGSURMHFWRUDQGDPRQRFKURPH &026 FRPSOHPHQWDU\ PHWDOR[LGH VHPLFRQGXFWRU VHQVRU ZRUNWRJHWKHUWRDQDO\]HWKHHQYLURQPHQWLQ' UHJDUGOHVVRIWKHOLJKWHQLQJ x 0LFURSKRQHV ± 7ZR EXLOW LQ PLFURSKRQHV DUH WKH DXGLR LQSXWRIWKLVXQLW
GLVWDQFHUHTXLUHGEHWZHHQWKHVHQVRUDQGWKH³WUDFNLQJVSDFH´ WR DVVXUH DQ RSWLPDO RSHUDWLRQ :H PDQXIDFWXUHG WKH H[SHULPHQWDO VWUXFWXUH LQ RUGHU WR GHWHUPLQH WKH VXLWDEOH SRVLWLRQ DQG WKH DQJOH RI WKH VHQVRU 7KH DOXPLQXP FUDIWHG VWUXFWXUHLVDVROLGIUDPHZKLFKFDQFKDQJHLWVSRVLWLRQIURP WR GHJUHHV7KLVIUDPHLVQRWLFHDEOHDWJODQFHDVDQDWWULEXWH RIWKHV\VWHPEXWLWVRQO\IXQFWLRQLVWRSURYLGHDULJLGVXSSRUW IRUWKHVHQVRUDQGRIIHUDZLGHUDQJHRISRVLWLRQVWRSODFHWKH VHQVRU IRU H[SHULPHQWDO SXUSRVHV ,Q WKH IXWXUH WKLV VWUXFWXUH PLJKW EH UHSODFHG E\ D FRPSDFWVL]HG RQH VR WKH XQLW FDQ PRYHLQQDUURZHUVSDFHV ,,,*(6785(5(&2*1,7,216<67(0 $7KH1DWXUDO,QWHUIDFHOLEUDU\ 7KLVV\VWHPXVHGWKH1DWXUDO,QWHUDFWLRQOLEUDU\ 2SHQ1, WRGHYHORSWKHVRIWZDUHDQGPLGGOHZDUHFRPSRQHQWV2SHQ1, LV DQ RSHQ VRXUFH OLEUDU\ GLVWULEXWHG IUHHO\ DQG DYDLODEOH WR WKH JHQHUDO SXEOLF XQGHU WKH /*3/ OLFHQVH >@ 7KLV OLEUDU\ ZDV FUHDWHG WR SURPRWH GHYHORSPHQW RI VRIWZDUH FDSDEOH RI LQWHUDFW ZLWK KXPDQV WKURXJK VSHHFK FRPPDQG UHFRJQLWLRQ KDQG JHVWXUHV DQG ERG\ PRWLRQ LQ D QDWXUDO ZD\ 1DWXUDO ,QWHUDFWLRQ ,W RIIHUV D ODUJH YDULHW\ RI WRROV WR FRQWURO DQG PDQDJH WKH KDUGZDUH WKH PLGGOHZDUH FRPSRQHQWV DQG WKH ILQDODSSOLFDWLRQ
)LJXUH7KH;WLRQ352/LYHXQLW
7KH)LJXUHVKRZVDQRYHUYLHZRIWKHVHQVRU XQLWDQGLWV FRPSRQHQWV WKH VHQVRU VSHFLILFDWLRQV FDQ EH UHIHUUHG LQ WKH 7DEOH 7DEOH7KH;WLRQ352/LYHVHQVRUVSHF
Effective Distance (using OpenNI) Effective Angle Interface/Power Sensor Audio Development Platform Middleware Programming Language Supported OS Dimensions
Between 0.5 meters and 3.5 meters 58º horizontal, 45º vertical, 70º diagonal USB 2.0 RGB & Depth 2 x built-in microphones Visual Studio .NET 2008, 2010 OpenNI/NITE C++/C# (Windows) | C/C++ (Linux) Win 32/64: XP, Vista, 7 | Linux 32/64: Ubuntu 10.10 1.5" x 7" x 1.9" | USB Cable Length: 5.5 feet
&7KH([SHULPHQWDO6WUXFWXUH 7KH V\VWHP XWLOL]HV D GHSWK LPDJH VHQVRU DV WKH PDLQ VRXUFHRILQIRUPDWLRQWRGHWHUPLQHWKHPRYLQJGLUHFWLRQRIWKH ZKHHOFKDLU 1HYHUWKHOHVV LQ RUGHU WR XVH WKLV VHQVRU FHUWDLQ UHTXLUHPHQWV QHHG WR EH PHW 7KH FORVHVW GLVWDQFH WR WKH WUDFNLQJ WDUJHW WKH KDQGV LV FP VR WKDW LV WKH PLQLPDO
50
)LJXUH2SHQ1,DEVWUDFWOD\HUHGYLHZ
$V LQ )LJXUH HYHU\ HOHPHQW LV LQWHUIDFHG YLD 2SHQ1, 7KHZKHHOFKDLULVORFDWHGLQWKHDSSOLFDWLRQOD\HU WKHJHVWXUH UHFRJQLWLRQ DOJRULWKP LV LQ WKH PLGGOHZDUH FRPSRQHQWV DQG WKHGHSWKLPDJHVHQVRULVWKH+DUGZDUHGHYLFHOD\HU %7KH*HVXUHUHFRJQLWLRQSURFHVV
,QILJXUHWKHPDLQSURFHVVIRUWKHZKHHOFKDLUFRQWUROLV GHWDLOHG 7KLV SURFHVV VWDUWV ZKHQ WKH VRIWZDUH LV LQLWLDOL]HG DQG WKH *HVWXUH 0RGH FRPPDQG LV VHQW $W WKLV SRLQW WKH ZKHHOFKDLULVXQGHUWKHVRIWZDUHFRQWURODQGWKHMR\VWLFNLVQR ORQJHU DYDLODEOH 7KH V\VWHP LV FRQWLQXRXVO\ ORRNLQJ IRU WKH ³FOLFN´ JHVWXUH ZKLFK LV SUHGHILQHG LQ WKH 2SHQ1, OLEUDU\ 7KLV JHVWXUH LV LGHQWLILHG E\ WKH *HVWXUH *HQHUDWRU IXQFWLRQ ZKLFK LV FRQVWDQWO\ DQDO\]LQJ WKH GHSWK GDWD IURP WKH VHQVRU DQGVHDUFKLQJIRUVRPHWKLQJWKDWORRNVOLNHDKDQG
2013 IEEE Symposium on Computational Intelligence in Rehabilitation and Assistive Technologies (CIRAT)
www.redpel.com +9176205933893
JHVWXUHLVQRWUHFRJQL]HGWKHZKHHOFKDLUZLOOQRWPRYH7KLV IHDWXUHDVVXUHVDVDIHGULYLQJH[SHULHQFH2QO\ZKHQWKHXVHU SHUIRUPV WKH SUHGHILQHG JHVWXUH WKH V\VWHP ZLOO DQDO\]H WKH FKDQJHV LQ WKH KDQG SRVLWLRQ WKHUHIRUH WKH XVHU FDQ GHFLGH ZKHWKHU WR VWDUW RU VWRS WKH*HVWXUH 0RGH DW ZLOO :KHQ WKLV PRGH LV HQJDJHG WKH XVHU¶V KDQG SRVLWLRQ LV VKRZQ RQ WKH VFUHHQVRWKHXVHUFDQXQGHUVWDQGLQDQLQWXLWLYHPDQQHUKRZ WR GULYH WKH ZKHHOFKDLU 7KLV GLUHFWLRQ SDQHO LV GHSLFWHG LQ )LJXUH
)LJXUH*HVWXUHUHFRJQLWLRQDQGKDQGVWUDFNLQJSURFHVV
)LJXUH2SHQ1,JHVWXUHUHFRJQLWLRQSURFHVV
$W WKH WLPH WKLV REMHFW LV IRXQG LW WUDFNV LW DV D KDQG FDQGLGDWHIRUGHVLJQDWLRQDVDJHVWXUH:KHQDKDQGFDQGLGDWH LVGHWHFWHGLWUDLVHVWKHILUVWWUDFNLQJHYHQWDQGWKHFKDQJHVLQ GHSWK RI WKLV REMHFW DUH HYDOXDWHG 7KH ³FOLFN´ JHVWXUH LV UHFRJQL]HG DIWHU WKH FRPSOHWLRQ RI LQWHUPHGLDWH VWDJHV WKDW LQWHJUDWH WKH JHVWXUH LWVHOI (YHU\ VWHS RI WKLV SURFHGXUH LV LOOXVWUDWHGLQ)LJXUH $IWHU WKH FRPSOHWLRQ RI HYHU\ ,QWHUPHGLDWH VWDJH WKH ³FOLFN´ JHVWXUH LV UHFRJQL]HG DQG WKH JHVWXUH JHQHUDWRU VHQGV WKH ODVW FRRUGLQDWHV RI WKH REMHFW ³KDQG´ VR WKH WUDFNLQJ SURFHGXUHFDQEHLQLWLDOL]HG$VVKRZQLQILJXUH WKH*HVWXUH JHQHUDWRU PRGXOHQRWLILHVWKHDSSOLFDWLRQWKHFRPSOHWLRQRID JHVWXUH DW FHUWDLQ [ \ DQG ] SRVLWLRQ VR WKH DSSOLFDWLRQ LQGLFDWHVWRWKH+DQGJHQHUDWRUPRGXOHWRFUHDWHDQHZREMHFW FDOO ³KDQG´ DQG WR VWDUW WUDFNLQJ LW IURP WKH ODVW REWDLQHG FRRUGLQDWH &RQVHTXHQWO\ WKH +DQG JHQHUDWRU PRGXOH FUHDWHV WKHQHZREMHFWDQGQRWLILHVWKHDSSOLFDWLRQHYHU\FKDQJHRQLWV SRVLWLRQWKURXJKXSGDWHV,IWKHDSSOLFDWLRQFRQVLGHUVWKDWWKH WUDFNLQJSURFHVVQHHGVWREHVWRSSHGLWUHTXHVWWKHGHVWUXFWLRQ RI WKH REMHFW ³KDQG´ WR WKH +DQG JHQHUDWRU PRGXOH DQG WKH JHVWXUH UHFRJQLWLRQ SURFHVV LV UHDG\ WR VWDUW DJDLQ ,Q RWKHU ZRUGV LI WKH V\VWHP ORVHV WKH XVHU¶V KDQG RU WKH ³FOLFN´
)LJXUH 2SHQ1,+DQGWUDFNLQJSURFHVV
)LJXUH7KHGLUHFWLRQSDQHO
&7KH&RQWURO6WUDWHJ\ $IWHUWKHJHVWXUHUHFRJQLWLRQWKHKDQGSRVLWLRQLVORFDWHG LQWKHPLGGOHRIWKHVFUHHQ RQWKHVWRSEXWWRQ7KHGLUHFWLRQ SDQHO OD\RXW LV GHVLJQHG LQ D VLPSOH EXW HIILFLHQW ZD\ ,W LV HDV\IRUWKHXVHUWRXQGHUVWDQGWKHUHODWLRQEHWZHHQWKHKDQG PRYHPHQWV DQG WKH UHVXOWLQJ GLUHFWLRQ 6R WKH GLUHFWLRQ FRQWURO LV VROYHG ZLWK ILYH YLUWXDO EXWWRQV 6WRS 5LJKW /HIW
2013 IEEE Symposium on Computational Intelligence in Rehabilitation and Assistive Technologies (CIRAT)
www.redpel.com +9176205933894
51
)RUZDUGDQG5HYHUVH 7KHFRQWUROPRGXOHLVLQWHUIDFHGWRWKHFRPSXWHUWKURXJK D77/6HULDOFRQYHUWHUDQGLWVPDLQIXQFWLRQLVWRRSHUDWHWKH ZKHHOFKDLU PRWRUV DFFRUGLQJ WR WKH GDWD UHFHLYHG IURP WKH VRIWZDUH7KLVPRGXOHUHFHLYHVDSUHGHILQHGGLUHFWLYHZKLFKLV LQWHUSUHWHGLQSRVLWLYHRUQHJDWLYHURWDWLRQIRUHDFKRQHRIWKH ZKHHOV$VVHHQLQ)LJXUHWKHFKDQJHLQGLUHFWLRQLVVROYHG E\ PHDQV RI FKDQJLQJ WKH IRUZDUGUHYHUVH DQG WKH OHIWULJKW FRPSRQHQWV 7KHVH FRPSRQHQWV DUH WZR VSHFLDO GLUHFWLYHV LQGLFDWLQJ ZKDWSHUFHQWDJHRIWKH PRWRU¶VFDSDFLW\VKRXOGEH HPSOR\HG WR URWDWH DQG LI WKH URWDWLRQ LV FORFNZLVH RU FRXQWHUFORFNZLVH)RULQVWDQFHLIWKHZKHHOFKDLULVUXQQLQJLQ D VWUDLJKW OLQH DQG WKH XVHU WXUQV OHIW WKH IRUZDUG GLUHFWLYH UHPDLQVSRVLWLYHDQGWKHULJKWOHIWFKDQJHVWRQHJDWLYHYDOXHV LQWKHGLUHFWLYH
)LJXUH([DPSOHRIWKHGHSWKLPDJH
%([SHULPHQWVRI+DQG7UDFNLQJ 7KH H[SHULPHQWV DLPHG WR PHDVXUH WKH V\VWHP SHUIRUPDQFH LQ WHUPV RI DFFXUDWH KDQG WUDFNLQJ VDIHW\ GULYH FRQGLWLRQVDQGFRUUHFWGLUHFWLRQDOFRQWURO7KHSRVLWLRQZKHUH WKH GHSWK VHQVRU LV ORFDWHG SURYHG WR EH D NH\ SRLQW WR UHFRJQL]HWKHXVHU¶VJHVWXUHZLWKSUHFLVLRQ7KHLGHDO]RQHWR SHUIRUP WKH JHVWXUHV ZDV UHSRUWHG WR VWDUW IURP FP IURP WKH VHQVRU ZKLFK VKRXOG EH ORFDWHG GHJUHHV DERYH WKH XVHU¶V SODQH 7KH )LJXUH $ VKRZV D KDQG EHHQ WUDFNHG ZLWKRXWKROGLQJDQ\REMHFW7KH)LJXUH % VKRZVWKHVDPH SURFHVVWKDWWKHXVHULVKROGLQJDFRRNLQJERZO7KHV\VWHPLV DEOH WR WUDFN WKH KDQG ZLWKRXW GLVWLQFWLRQ RI WKH KROGLQJ REMHFWV )LJXUH7KHGLUHFWLRQFRQWURO
,97+((;3(5,0(176$1',765(68/76 $([SHULPHQWVRI*HVWXUH5HFRJQLWLRQ :HFRQGXFWHGWKHH[SHULPHQWVWRFODULI\WKHHIIHFWLYHQHVV RIWKHJHVWXUH ³FOLFN´ UHFRJQLWLRQ6XEMHFWVQXPEHUILYH$OO VXEMHFWV LQ H[SHULPHQWV ZHUH \RXQJ SHRSOH ZLWKRXW SK\VLFDO GLVDELOLWLHV -DSDQHVH ²\HDUVRIDJHWKUHHIRUPHQDQG WZR IRU ZRPHQ (DFK VXEMHFW ZDV WHVWHG IRU WKH ³FOLFN´ PRWLRQWLPHV:HGHILQHWKUHHFDVHVRIWKHSRVLWLRQRIWKH VHQVRU >GHJ@>GHJ@>GHJ@ RQ WKH H[SHULPHQWDO VWUXFWXUH 7KH UHVXOWV RI WKH UHFRJQLWLRQ UDWHV DUH VKRZQ LQ 7DEOH 7KH DYHUDJH UHFRJQLWLRQ UDWH RI WKH DQJOH >GHJ@ ZDV 7KH H[DPSOH RI WKH GHSWK LPDJH RI WKH ³FOLFN´ PRWLRQLVVKRZQLQ)LJ
7DEOH5HFRJQLWLRQUDWHVRIWKH³FOLFN´PRWLRQ
DQJOHRI VHQVRU
6XEMHFW$ 6XEMHFW% 6XEMHFW& 6XEMHFW' 6XEMHFW(
52
>GHJ@
>GHJ@
>GHJ@
$ +DQGRQO\ % +DQGZKLOHKROGLQJDQREMHFW )LJXUH5HVXOWLQJWUDFNLQJH[SHULPHQWV
&3HUIRUPDQFHWHVWV
:H FRQGXFWHG SHUIRUPDQFH WHVWV WR GHWHUPLQH WKH HIILFLHQF\ LQ WHUPV RI DFFXUDF\ UHJDUGLQJ WKH XVHU GHVLUHG GLUHFWLRQ DQG UHDO UHVXOWLQJ GLUHFWLRQ 6XEMHFWV QXPEHU ILYH 7KHVXEMHFWZDVWHVWHGWLPHVLQHDFKFDVH,QDOOFDVHVWKH VXEMHFWUHDFKHGDWWKHJRDOSRVLWLRQ7KH)LJXUHVKRZVWKH
2013 IEEE Symposium on Computational Intelligence in Rehabilitation and Assistive Technologies (CIRAT)
www.redpel.com +9176205933895
LPDJHZKLOHWHVWLQJWKHUHVXOWLQJGLUHFWLRQDJDLQVWWKHXVHUUHDO SXUSRVH )LJXUH5HVXOWLQJRISHUIRUPDQFHWHVW
7KH UHVXOWLQJ GLUHFWLRQ SURYHG WR PHHW WKH XVHU LQWHQWLRQ GXULQJ WKH H[SHULPHQWV UHSRUWLQJ VDWLVI\LQJ SHUIRUPDQFH 1HYHUWKHOHVV LV QHFHVVDU\ WR FRQVLGHU WKH YDULDWLRQV LQ WKH FRRUGLQDWHVLIDQ\FKDQJHWRWKHSRVLWLRQRIWKHFDPHUDLVGRQH WRDVVXUHWKHEHVWRSHUDWLRQ 9&21&/86,216 :H KDYH GHYHORSHG D JHVWXUH FRQWURO V\VWHP RI WKH ZKHHOFKDLU 7KLV V\VWHP FRQVLVWV RI DQ HOHFWULFSRZHUHG ZKHHOFKDLUZLWKDQH[SHULPHQWDOVWUXFWXUHDGHSWKVHQVRUDQG D3&7KHV\VWHPUHFRJQL]HVWKHXVHU¶V ³FOLFN´ PRWLRQEDVHG RQ WKH GHSWK LPDJH $IWHU WKH UHFRJQLWLRQ RI WKH ³FOLFN´ PRWLRQWKHZKHHOFKDLUPRYHVDFFRUGLQJWRWKHPRWLRQRIWKH XVHU¶VKDQGSRVLWLRQ:HGHILQHILYHPRWLRQFRPPDQGVRIWKH ZKHHOFKDLU EDVHG RQ WKH KDQG SRVLWLRQV 7KH GLUHFWLRQ SDQHO VFUHHQ LV GHVLJQHG IRU GULYLQJ WKH ZKHHOFKDLU DQG VR IDU LW ZRUNV 1HYHUWKHOHVV WKDW LV MXVW DQ H[DPSOH RI ZKDW FDQ EH GRQH ZLWK WKH KDQGV WUDFNLQJ DQG WKH JHVWXUH UHFRJQLWLRQ FDSDELOLWLHV 7KH DYHUDJH UHFRJQLWLRQ UDWH RI WKH ³FOLFN´ JHVWXUH ZDV 7KH HIIHFWLYHQHVV RI RXU JHVWXUH UHFRJQLWLRQV\VWHPLVFODULILHGE\VHYHUDOSHUIRUPDQFHWHVWV ,Q IXWXUH ZRUN ZH PXVW GHILQH PDQ\ NLQGV RI JHVWXUH FRPPDQGVIRUWKHSUDFWLFDODSSOLFDWLRQRIRXUV\VWHP $FNQRZOHGJHPHQWV 7KH VXSSRUW DQG JXLGDQFH E\ 'U 'LPLWDU 6WHIDQRY &RYHQWU\ 8QLYHUVLW\ DORQJ WKLV UHVHDUFK DUH ZLGHO\ DSSUHFLDWHG$OVRVSHFLDOWKDQNVKDYHWREHDFNQRZOHGJHGDOO WKH SHRSOH WKDW WRRN SDUW RI WKLV SURMHFW IRU WKHLU JUHDW FRQWULEXWLRQ
/LYLQJ ODE 3URF RI WKH VW :RUNVKRS RQ 6SHHFK DQG 0XOWLPHGLDO,QWHUDFWLRQLQ$VVLVWLYH(QYLURQPHQWVSS >@ *RPL 7 DQG *ULIILWK $ 'HYHORSLQJ ,QWHOOLJHQW :KHHOFKDLUV IRU WKH +DQGLFDSSHG $VVLVWLYH 7HFKQRORJ\ DQG $UWLILFLDO ,QWHOOLJHQFH $SSOLFDWLRQV LQ 5RERWLFV 8VHU ,QWHIDFHV DQG 1DWXUDO /DQJXDJH 3URFHVVLQJ /HFWXUH 1RWHV LQ&RPSXWHU6FLHQFH9ROSS%HUOLQ >@5|IHUDQG/DQNHQDX$7 $UFKLWHFWXUHDQGDSSOLFDWLRQV RI WKH EUHPHQ DXWRQRPRXV FKDLU :KHHOFKDLU 3URFHHGLQJV RIWKHWK-RLQW&RQIHUHQFHRQ,QIRUPDWLRQ6\VWHPV9RO $VVRFLDWLRQIRU,QWHOOLJHQW0DFKLQHU\SS >@@ $UWXUR (VFREHGR -RUJH 5LRV0DUWLQH] $QQH 6SDODQ]DQL DQG&KULVWLDQ/DXJLHU &RQWH[W%DVHG)DFH &RQWURORID 5RERWLF :KHHOFKDLU ZRUNVKRS RQ QDYLJDWLRQ DQG PDQLSXODWLRQ DVVLVWDQFH IRU URERWLF ZKHHOFKDLUV LQ ,526 >@ 3HL-LD+ +X7DR /X .XL @ 0RKG 5D]DOL 0G 7RPDUL @7KHRGRURV 7KHRGRULGLV +XRVKHQJ +X .ODXV 0F'RQDOG0DLHU'RQJELQJ*X .LQHFW(QDEOHG0RQWH &DUOR /RFDOLVDWLRQ IRU D 5RERWLF :KHHOFKDLU $GYDQFHV LQ ,QWHOOLJHQW 6\VWHPV DQG &RPSXWLQJ 9ROXPH SS >@ :HQ)X 3DQ 0HL@KWWS ZZZJQXRUJOLFHQVHV
5()(5(1&(6 >@ . 0RKDQ .XPDU 'LQHVK 0DVDQL +DQG *HVWXUH 5HFRJQLWLRQ IRU :KHHOFKDLU &RQWURO E\ 'LJLWDO ,PDJH 3URFHVVLQJ 7HFKQLTXH ,QWHUQDWLRQDO -RXUQDO RI &RPPXQLFDWLRQV DQG (QJLQHHULQJ 9RO 1R SS >@ 'LPLWUD $QDVWDVLRX $ 6SHHFK DQG *HVWXUH 6SDWLDO &RUSXV LQ $VVLVWHG /LYLQJ 3URFHHGLQJV RI WKH HLJKWK LQWHUQDWLRQDO FRQIHUHQFH RQ /DQJXDJH 5HVRXUFHV DQG (YDOXDWLRQ /5(& >@ 'LPLWUD $QDVWDVLRX &XL -LDQ 'HVLVODYD =KHNRYD 6SHHFK DQG *HVWXUH ,QWHUDFWLRQ LQ DQ $PELHQW $VVLVWHG
2013 IEEE Symposium on Computational Intelligence in Rehabilitation and Assistive Technologies (CIRAT)
www.redpel.com +9176205933896
53
