BMI 研究はなぜ同じ失敗を繰り返すのか（日本BMI研究会, 2021.11.5）

2021年の日本BMI研究会で発表したスライドの一部を公開します

Transcript

1. BMI ݚڀ͸ͳͥಉࣦ͡ഊΛ܁Γฦ͢ͷ͔ ژ౎େֶ ৘ใֶݚڀՊ ATR೴৘ใݚڀॴ ਆ୩೭߁ http://kamitani-lab.ist.i.kyoto-u.ac.jp @ykamit
2. NHK͓͸Α͏೔ຊ, 2006.5.25 ͡ΌΜ͚ΜσϞʢ2006ʣ
3. Kamitani and Tong (2005)
4. σίʔσΟϯάͷʮ௒ղ૾ʯ (Boynton, 2005; Rojer and Schwartz, 1990) Information from subvoxel representation via random bias of voxel sampling due to irregular columnar and/or vasculature structure (Kamitani and Tong, 2005) (See also: Op de Beeck, 2009; Kamitani & Sawahata, 2009; Gardner, 2009; Shmuel et al. 2009; Kriegeskorte et al 2009; Mannion et al., 2009; Swisher et al. 2010; Freeman et al. 2011; Clifford et al., 2011; Chaimow et al 2011)
5. 2003: CRESTʮߴྸ೴ͷֶशೳྗͱՄ઼ੑͷBMI๏ʹΑΔղ໌ʯʢᓎҪ๕༤ʣ 2003-2004:ʢਆ୩ʣϓϦϯετϯ଺ࡏதɺ೴σίʔσΟϯά։ൃ 2004.10.1: ʢਆ୩ʣATRೖॴ 2005:ɹKamitani and Tong (2005ʣग़൛ 2006: ɹɹɹ • NICT, Symposium on Brain Communication Technology (Wolpaw, ࡕେ೴֎Պ) • ͡ΌΜ͚ΜσϞʢATR, Honda HRIʣ • CREST γϯϙδ΢Ϝʮ೴ͱػցΛͭͳ͙ʔϒϨΠϯ-ϚγϯɾΠϯλʔϑΣʔ εͷՄೳੑʯʢNicolelis, Fetzʣ • ೴Λ׆͔͢ݚڀձ 2007: G-TeCใࠂॻɹʮϒϨΠϯɾϚγϯɾΠϯλϑΣʔεʯʢถࠃʣ 2008: จ෦Պֶলɾ೴ՊֶݚڀઓུਪਐϓϩάϥϜʢ೴ϓϩʣ՝୊AʮϒϨΠϯɾϚ γϯɾΠϯλʔϑΣʔεʢBMIʣͷ։ൃʯ 2010: ͖͕͚͞ʮ೴৘ใͷղಡͱ੍ޚʯ(ݚڀ૯ׅɿ ઒ਓ ޫஉ) ͦͷޙͷࠃϓϩɿ೴ϓϩୈೋظɺ૯຿লɺImPactɺNEDOɺ Ϝʔϯγϣοτ… ೔ຊͷBMIݚڀͷ͋ΏΈ
6. χϡʔϩΠϝʔδϯάɿ • GLM/SPMʢܹࢗ→൓Ԡਤࣜɺ৺ཧ౷ܭɺِཅੑɺूஂฏۉ…ʣ͔Βͷ։์ • ࣗ༝ͳϞσϦϯάɺ਺ཧՊֶɾAI΁ͷ઀ଓ • આ໌͔Β༧ଌ΁ • BMIͷςετϕου ਆܦίʔυɿ • αϧ͔Βώτ΁ • ػցֶशʢ≠ ౷ܭʣͰେن໛࣮σʔλΛղੳ • ʮχϡʔϩϯʢεύΠΫʣυΫτϦϯʯΛ௒͑ͯʢϙϐϡϨʔγϣϯɺηϯ αʔۭؒʣ • ʮݸମʢ೴ʣʹͱͬͯͷίʔυʯ͔Βʮୈࡾऀʹͱͬͯͷίʔυʯ΁ K & T (2005) /͡ΌΜ͚ΜσϞͷޭࡑ
7. χϡʔϩΠϝʔδϯάɿ • GLM/SPMʢܹࢗ→൓Ԡਤࣜɺ৺ཧ౷ܭɺِཅੑɺूஂฏۉ…ʣ͔Βͷ։์ • ࣗ༝ͳϞσϦϯάɺ਺ཧՊֶɾAI΁ͷ઀ଓ • આ໌͔Β༧ଌ΁ • BMIͷςετϕου ਆܦίʔυɿ • αϧ͔Βώτ΁ • ػցֶशʢ≠ ౷ܭʣͰେن໛࣮σʔλΛղੳ • ʮχϡʔϩϯʢεύΠΫʣυΫτϦϯʯΛ௒͑ͯʢϙϐϡϨʔγϣϯɺηϯ αʔۭؒʣ • ʮݸମʢ೴ʣʹͱͬͯͷίʔυʯ͔Βʮୈࡾऀʹͱͬͯͷίʔυʯ΁ K & T (2005) /͡ΌΜ͚ΜσϞͷޭࡑ ࡑ
   ಈ෺࣮ݧෆཁ࿦
   ඇ৵ऻ೴ܭଌ΁ͷա౓ͳظ଴
   ࠃϓϩʹ޲͖ͷςʔϚͱͯ͠ཞ༻
   ૉਓड͚Λૂͬͨূڌͷ๡͍͠ݚڀ
   େຊӦൃදతϓϨεϦϦʔε
   ݚڀऀͷηʔϧεϚϯԽ
   ʮԠ༻೴ՊֶϏδωεʯ͕೿ੜ
8. ࡕେ೴֎ՊͱͷECoG-BMIͷڞಉݚڀ (Yanagisawa, Kamitani, et al., Neuroimage 2009, Annals of Neurology 2011, Nature Communications 2016, among others)
10. https://www.gofundme.com/f/visitingjapanbraincomputerinterface ʮBMI͸ͳͯ͘΋ੜ׆ʹࠔΒͳ͍ʯ
11. BMIΛ࠶ఆٛ͢Δ • BMI=৵ऻܕɺBCI=ඇ৵ऻ ← ੲͷۀք੗Έ෼͚࿦ཧ • Neuroprosthetics (Schwartz, Shenoy) ← ࢒ଘػೳΛ௒͑ΒΕΔ͔ • ೴–೴௨৴ (Rao, Nicolelis) ← ݱঢ়ɺத਎͸ۃΊͯ͠ΐ΅͍… ͦ΋ͦ΋ɺ • ʮػցʯʮܭଌɾܹࢗ๏ʯʮػೳ୅ସʯ͸ຊ࣭ʁ ʮBMIʹ೴ͱػցͷΠϯλʔϑΣʔεʯͰ͸ ೴ςΫϊϩδʔͷՄೳੑΛे෼ଊ͑ΒΕͳ͍ͷͰ͸?
12. ೴͸ԿͷͨΊʹ͋Δʁ
13. ʮϗϠ͸ؠ৔ʹఆணͯ͠ӭ͙ඞཁ͕ͳ͘ͳΔͱࣗ෼ͷ೴ΛফԽ͠ ͯ͠·͏ɻςχϡΞΛͱͬͨେֶڭतͱಉ͡Α͏ʹʯ ʮࢥߟ΍ײ৘ͷͨΊͰ͸ͳ͘ӡಈ੍ޚͷͨΊʹ೴͕ਐԽͨ͠ʯ
14. (Brooks, 1986) (Pfeifer and Sheier, 2001) ೴͸਎ମͷ͓·͚ʁ
15. ਎ମ ʢӡಈɾײ֮ث׭ʣ ೴ ࢹࡉ๔ɿ~150ສ ࠎ֨ےɿ~600 χϡʔϩϯɿ860ԯ ʢେ೴ɺ160ԯʣ ൽ࣭੸਷࿏ɿ~100ສ ࢹਆܦɿ~100ສ ਎ମͷ͓·͚ͱݴ͏ʹ͸೴͸େ͖͗͢Δ
16. Jang et al., Retino-Cortical Mapping Ratio Predicts Columnar and Salt-and-Pepper Organization in Mammalian Visual Cortex. Cell Reports 30, 3270-3279.e3 (2020).
17. ੈք ೴ ਎ମ ಺ଁ ਎ମ͸ʮϘτϧωοΫʯ 3Dγʔϯ →̎D໢ບ૾ → 3DΠϝʔδ ׽ࣈ ← ͔ͳ ← ࢦӡಈʢϩʔϚࣈʣ ← ͔ͳ ← ׽ࣈ ɹɹɹɹݴޠ ← ൃ੠ӡಈ ← ࢥߟɾΠϝʔδ
18. ੈք ೴ ਎ମ ೴σίʔσΟϯά = ਎ମΛհͣ͞೴ͷݴ༿Λੈքͷݴ༿ʹ຋༁
19. ੈք ೴ ਎ମ BMI = ೴ͱੈքΛϦΞϧλΠϜʹͭͳ͙ɺ਎ମҎ֎ͷ νϟϯωϧΛ։͘ BMI
20. ਂ૚Πϝʔδ࠶ߏ੒ ʢShen, Horikawa, Majima, Kamitani, bioRxiv 2017ʣ
21. 3FDPO1SPDFTT@QBJS@HPE$PM@T(%("/SFMVHFO@BMM@GQT
22. Imagined Reconstruction Imagery
23. (Horikawa, Kamitani, CCN 2019) Attention
24. Patient A Patient B Image: Ryohei Fukuma, Osaka University Lateral view, right hemisphere Lateral view, left hemisphere ECoG͔Βͷࢹ֮૾࠶ߏ੒ ʢ༄୔CRESTʣ
25. Subject 1 ʮ೴ίʔυม׵ثʯ Subject 2 Train inter-subject prediction model (Yamada, Miyawaki, Kamitani, PRNI 2011, Neuroimage 2015)
26. (Ho, Horikawa, Majima, Kamitani, in preparation) ݸਓؒਂ૚Πϝʔδ࠶ߏ੒
27. (Ho, Horikawa, Majima, Kamitani, in preparation)
28. ੈք ೴ ݪࢠ΍෼ࢠ ࣗવͷ֊૚ߏ଄ ۙ઀࡞༻ χϡʔϩϯͱεύΠΫ ωοτϫʔΫ ہॴɾԕִίωΫγϣϯ ೴͸ಠಛͳ࢓ํͰੈքΛίʔυ͍ͯ͠Δ ೴಺ੈքϞσϧΛ֎ࡏԽɾڞ༗͢ΔςΫϊϩδʔͱͯ͠ ʮBMIʯΛ࠶ఆٛɿʮχϡʔϩόʔεʯ
29. ࠷ޙʹ • ࣦഊ͔ΒֶΜͰ৽͍͠ΞϓϩʔνΛ໛ࡧ͠Α͏ • ʮૉਓड͚͢Δݚڀʯ΄Ͳݻ͍ΤϏσϯε͕ඞཁ • ೴ςΫϊϩδʔͷՄೳੑΛݟۃΊΑ͏ʢݚڀऀͷએ఻จ۟Λਅ ʹड͚ͯ͸μϝʣ