第11回 全日本コンピュータビジョン勉強会 CVPR2022 "A Self-Supervised Descriptor for Image Copy Detection"

第11回 全日本コンピュータビジョン勉強会
https://kantocv.connpass.com/event/253626/

紹介論文：A Self-Supervised Descriptor for Image Copy Detection
https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html

Transcript

1. ୈճ
   શ೔ຊίϯϐϡʔλϏδϣϯษڧձ
   $713ಡΈձ ޙฤ
   "
   4FMG4VQFSWJTFE
   %FTDSJQUPS
   GPS
   *NBHF
   $PQZ
   %FUFDUJPO
   2022/08/21 Yamato OKAMOTO
2. Ԭຊେ࿨
   ʢ:BNBUP
   0,".050ʣ
   w ژେʢඒೱݚʣˠ
   ΦϜϩϯ
   ˠ
   -*/&
   w ݚڀ։ൃ͔Βࣄۀ૑଄·Ͱखֻ͚ͯ·ͨ͠
   w $PNQVUFS
   7JTJPO
   -BC
   ͷ্ཱͪ͛ਓͱͯ͠-*/&ʹస৬
   w ͓͔͛͞·Ͱ$7-͸प೥Λܴ͑·ͨ͠ʙ🎉🎉🎉
   w ಌΕΒΕΔݚڀڌ఺Λ࡞Δ΂͘ɺژ౎͔Βຖ೔ָ͘͠ฃಆͯ͠·͢ʂʂ
3. ຊ೔ͷτϐοΫ Image Copy Detection
4. ಥવͰ͕͢ɺ͜Μͳܦݧ͋Γ·ͤΜ͔ʁʁ 4/4ʹ౤ߘͨࣸ͠ਅ͕ແஅͰ࢖ΘΕ͍ͯͨʂʂ
   Αͬ͠Όɺࣸਅࡱͬͯ΋Ζͨ͠ɺ
   4/4ʹ౤ߘͨ͠Ζͬʂ Μʜʁ͋ͷը૾ɺΘ͠ͷͪΌ͏͔ʂʁ
   ແஅͰ޿ࠂૉࡐͱͯ͠࢖ΘΕͯΔ΍Μʂʂ
   ˞ϑΟΫγϣϯͰ͢ >∩( ^ ω ^)∩< 📲 Σ ƅЧƅ|||) ઌண໊ʹ
   ͚ͩڭ͑·͢ ͍·͙͢ສԁՔ͙ํ๏ ͙͢ΫϦοΫ ޙ೔ ͜͜·Ͱώυ͍ྫͰ͸ͳ͘ͱ΋ɺࢲ͸෦׆ಈͰࡱӨͨ͠ϥάϏʔͷࢼ߹ࣸਅΛɺ
   νϥγͷഎܠը૾ͱͯ͠ແஅར༻͞Εͨܦݧ͕͋Γ·͢😱
5. .PUJWBUJPOɿίϐʔը૾Λݟ͚ͭग़͍ͨ͠ ແஅͷը૾ར༻͸͝๏౓ʹ΋͔͔ΘΒͣɺͦͷΑ͏ͳ໰୊͸ઈ͑ͳ͍ɻ
   ྫ͑͹ԼਤͷΑ͏ʹɺ৽ن౤ߘ͞Εͨը૾͕ίϐʔը૾ͳͷ͔Ͳ͏͔ϞχλϦϯά͢Δػೳ͕ٻΊΒΕΔɻ ৽ن౤ߘʢ2VFSZʣ DB ίϐʔݩͱࢥΘ͖͠ը૾͕ଘࡏ ݕࡧ DB ෆਖ਼ར༻͞Ε͔ͨ΋ ໰୊ͳ͍ͱ൑அ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html ৽ن౤ߘʢ2VFSZʣ )JUͳ͠ ݕࡧ
6. Ͳ͏΍ͬͯίϐʔը૾ݕग़Λ࣮ݱ͢Δ͔ʁʁ ίϐʔը૾ͱίϐʔݩը૾͔Β͸ɺྨࣅͨ͠ಛ௃ྔΛநग़Մೳͳ͸ͣʂʂ
   ΠέͯΔಛ௃ྔදݱΛֶश͢Ε͹ɺಛ௃ྔۭؒͰίϐʔݩͷը૾͕ۙ๣ͱͳΓݕग़Ͱ͖ΔʂʂʢԾઆʣ https://github.com/google-research/simclr https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html 45&1ɿΠέͯΔಛ௃ྔදݱΛֶश͢Δ 45&1ɿը૾Λಛ௃ྔۭؒʹࣹӨ͢Δ
   45&1ɿۙ๣ʹσʔλ͕ଘࡏ͢Ε͹2VFSZΛίϐʔͩͱ൑ఆ͢Δ ྫ͑͹ɺ4JN$-3ͰେྔͷࣗݾڭࢣֶशΛ͢Δ DMPTF
7. ݁ՌɿͦΕ͚ͩͰ͸μϝͰͨ͠ʢɾТɾʆʣ • ͳͥίϐʔը૾ͱݩը૾͕࠷ۙ๪ʹͳΒͳ͔͔ͬͨʁ
   - ॻ͖ࠐΈจࣈɺ഑৭ɺղ૾౓ͳͲͷཁૉ͕ྨࣅ͢Δ ଞͷը૾͕࠷ۙ๣ʹͳͬͯ͠·ͬͨ
   • *NBHF
   $PQZ
   %FUFDUJPOͷ೉͠͞
   - Ճ޻͞Εͯ΋ݩը૾͕ಉ͡ͳΒಛ௃ྔ͕ྨࣅ͢ΔΑ ͏ʹ͍ͨ͠
   - ͍͔ʹɺͦͷΑ͏ͳಛ௃ྔදݱΛֶश͢Δ͔ʁ ࣮ࡍʹ4JN$-3Ͱಛ௃ྔදݱΛֶशͯ͠ɺίαΠϯྨࣅ౓Ͱۙ๣ը૾Λநग़ͨ݁͠Ռ͕ӈԼɻ
   ը૾Ճ޻Ͱಛ௃ྔ͕एׯԕ͔ͬͨ͟෼ɺଞͷը૾͕࠷ۙ๣ʹͳͬͯ͠·ͬͨͱਪ࡯͞ΕΔɻ ͜ΕΛݕग़͔ͨͬͨ͠ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
8. ͦ͜Ͱɺ4JN$-3Λϕʔεʹ%FTDSJQUPSͷֶशख๏ΛఏҊʂʂ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
9. ิ଍ɿࠓ೔ͷൃදͰ͸%FTDSJQUPSΛGFBUVSF
   WFDUPSͷҰछͱͯ͠ղऍ͠·͢ɻ ʢwebliࣙॻΑΓҾ༻ʣ هड़ࢠʢಡΈํɿ͖͡Ύͭ͠ʣ ʲӳʳdescriptor هड़ࢠͱ͸ɺϓϩηε͕OSΛ௨ͯ͡ೖग़ྗૢ࡞Λ ߦ͏ࡍʹࢀর͞ΕΔɺϑΝΠϧͷߏ଄΍಺༰ͷཁ ໿ɺϑΝΠϧଐੑͳͲ͕ه͞Εͨ੔਺ͷ͜ͱͰ͋ ΔɻϓϩάϥϜͷߏ଄͕ه͞ΕΔ৔߹΋͋Δɻ ༗ࣝऀίϝϯτʢ˞ҹ৅ͷ࿩Ͱ͢ʣ ࿦จͷΞϒετ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
10. ิ଍ɿ4JN$-3ͱ͸ಛ௃ྔදݱΛ֫ಘ͢ΔͨΊͷରরֶशͷ̍ͭ https://github.com/google-research/simclr 4JN$-3Ͱ͸ɺಉ͡ը૾ʹҟͳΔม׵Λࢪͯ͠΋ྨࣅͨ͠ಛ௃ྔ͕நग़Ͱ͖ΔΑ͏ʹֶश͢Δɻ
    ͦΕͱಉ࣌ʹɺҟͳΔը૾͔Β͸ҟͳΔಛ௃ྔ͕நग़Ͱ͖ΔΑ͏ʹֶश͢Δɻ
    ͳ͓ɺม׵ʹ͸$301΍৭ม׵΍#MVS͕Α͘࢖ΘΕΔɻ ಉ͡ը૾͔Β͸ಉ͡ಛ௃ྔΛ֫ಘ͍ͨ͠ ҟͳΔը૾͔Β͸ҟͳΔಛ௃ྔΛ֫ಘ͍ͨ͠ 4JN$-3ͷଛࣦؔ਺͸*OGP/$&
    ɾT͸ίαΠϯྨࣅ౓
    ɾ1͸1PTJUJWF1BSFͷू߹ QPTJUJWF
    QBSF OFHBUJWF
    QBSF
11. ఏҊख๏ͷશମ૾ "Self Supervised Copy Detection (SSCD) "
12. "Self Supervised Copy Detection (SSCD)"ͷશମ૾ 4JN$-3Λϕʔεʹෳ਺ͷվྑΛࢪͯ͠ɺ$PQZ
    %FUFDUJPOʹಛԽͨ͠ಛ௃ྔදݱΛֶशͨ͠ɻ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html &OUSPQZ
    -PTTΛ௥Ճͨ͠ 4JNJMBSJUZ
    /PSNBMJ[BUJPOΛ௥Ճͨ͠ "WFSBHF
    1PPMJOHͰ͸ͳ͘
    (F.
    1PPMJOHΛ࠾༻ $//ޙͷ.-1Λઢܗม׵ʹஔ͖׵͑ͨ ന৭ԽΛಋೖ ը૾ม׵ͷύλʔϯΛ௥Ճͨ͠
13. ޻෉͕ͯΜ͜੝ΓͳͷͰɺ ʮ͕͜͜ϙΠϯτͩʂʯͱࢥͬͨՕॴͷΈൈਮ͠·͢
14. &OUSPQZ
    -PTTʹΑΓෛྫΛԕ͚͟Δ੍໿ΛڧΊͨ &OUSPQZ
    -PTTʹΑͬͯɺ࠷΋ۙ͘ʹ͋ΔෛྫαϯϓϧΛԕ͚͟ΔΑ͏ʹֶशͤ͞Δɻ
    ͜ΕʹΑΓɺਖ਼ྫಉ࢜ͷڑ཭෼෍͸ͦͷ··ʹɺෛྫͱͷڑ཭෼෍Λԕ͚͟Δ͜ͱʹ੒ޭͨ͠ɻ ɾ[͸ಛ௃ྔ
    ɾ1͸ਖ਼ྫϖΞͷू߹ ੨͕ਖ਼ྫͱͷڑ཭෼෍ɺ੺͕ෛྫͱͷڑ཭෼෍
    &OUSPQZ-PTTಋೖલʢ্ʣʹൺ΂ͯɺಋೖޙʢԼʣ͸ෛྫ͕ԕ͔͍ͬͯ͟Δ *OGP/$&ͱ߹Θͤͯ࢖༻͢Δͱɺ
    ͓ؾ࣋ͪతʹ͸USJQMFUMPTTʹ͍͔ۙ΋ʁ🤔 https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
15. ิ଍ɿ&OUSPQZ
    -PTTͱλεΫͷ૬ੑ &OUSPQZ
    -PTTʹΑͬͯෛྫͱͷڑ཭෼෍Λԕ͚͟Δͱɺ$PQZ
    %FUFDUJPOͰ͸͝རӹ͕͋ͬͨɻ
    ͔͠͠ɺྫ͑͹$MBTTJGJDBUJPOͰ͸ٯޮՌͩͬͨͱใࠂ͞Ε͍ͯΔɻ ԣ࣠Е͸&OUSPQZ-PTTΛͲΕ͚ͩڧ͘͢Δ͔ɻ
    ੨͸*NBHF/FUͷ$MBTTJGJDBUJPOͷਫ਼౓
    ˠ
    Լ͕͍ͬͯΔ
    ྘ͱԫ͸$PQZ%FUFDUJPOͷਫ਼౓
    ˠ
    ্͕͍ͬͯΔ
    &OUSPQZ-PTT͸$PQZ%FUFDUJPOʹ͸༗ޮ͕ͩɺ
    $MBTTJGJDBUJPOʹ͸ٯޮՌͱͳͬͨɻ
    (FOFSBMͳಛ௃ྔΛ֫ಘͨ͠ͱ͍͏ΑΓɺ
    ಉҰੜ൑ఆʹಛԽͨ͠ͷ͔΋ʁ🤔 https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
16. $//ޙͷ.-1Λઢܗม׵ʹஔ͖׵͑ͨ .-1Λઢܗม׵ʹஔ͖׵͑Δͱɺ
    ҟͳΔը૾ม׵Λͯ͠΋ݩը૾͕ಉ͡ͳΒ͹ɺ$//͕ಉ͡ಛ௃ྔΛநग़͠Α͏ͱͯ͘͠ΕΔɻ w .-1Ͱ͸USBOTGPSNBUJPODPWBSJBOU
    GFBUVSFͷ֫ಘ͕ظ଴͞ΕΔɻ
    w ͜ΕʹΑΓɺಉ͡ը૾ʹҟͳΔը૾ม׵Λͨ͠ͱ͖ɺԾʹ$//͕ҟͳΔಛ௃ྔΛந ग़ͯ͠΋ɺ.-1ͷ͓͔͛Ͱ࠷ऴతʹಉ͡Α͏ͳಛ௃ྔ͕நग़Ͱ͖Δɻ
    w ݴ͍׵͑Δͱɺ.-1͕Χόʔͯ͘͠ΕΔͷͰɺಉ͡ը૾ʹҟͳΔը૾ม׵Λͨ͠ͱ ͖ɺ$//͸ҟͳΔಛ௃ྔΛநग़͍ͯ͠ΔՄೳੑ͕͋Δɻ
    w ීஈͳΒͦΕͰ΋͍͍͕ɺࠓճͷλεΫͰ͸JOWBSJBOU͕๬·͍͠ɻ
    w ಉ͡ը૾ʹҟͳΔը૾ม׵Λͯ͠΋ಉ͡ಛ௃ྔΛநग़͍ͨ͠ɻ
    w ͦ͜ͰɺࠓճͷλεΫͰ͸.-1Λઢܗม׵ʹஔ͖׵͑Δɻ
    w ಉ͡ը૾ʹҟͳΔը૾ม׵Λͯ͠΋ɺಉ͡ಛ௃ྔΛநग़ͤ͞Δૂ͍ɻ
    w $//͸ը૾ม׵͕͞Εͯ΋ɺݩ͕ಉ͡ը૾ͳΒಉ͡ಛ௃ྔΛநग़͠ͳ͍ͱ͍͚ͳ͘ ͳΔɻʢ.-1͸$//Λ؁΍͔͔ͨ͠΋͠Εͳ͍͕ɺઢܗม׵͸༰ࣻͤΜŕʂʣ
    w ࠷ऴతʹར༻͢Δಛ௃ྔʹ͸ީิ͕͋ΓɺఏҊख๏44$%Ͱ͸ᶄΛར༻ͨ͠ɻ
    w ᶃ$//ग़ྗʢUSVOL
    GFBUVSFʣ
    w ᶄઢܗม׵ͨ͠΋ͷʢQSPKFDUJPO
    GFBUVSFʣ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
17. ิ଍ɿDPWBSJBOU
    ͱ
    JOWBSJBOU 5XJUFSͰरͬͨਤ͕Θ͔Γ΍͔ͬͨ͢ͷͰܝࡌ͓͖ͯ͠·͢
    IUUQTUXJUUFSDPN"LJP5PNJZBTUBUVT TUI00);8,1HH4KD"$BC@Y2 https://twitter.com/AkioTomiya/status/1404844708099198982?s=20&t=hOOHZWK7Pg8gSjcACab_xQ
18. 4DPSF
    4JNJMBSJUZ
    /PSNBMJ[BUJPOΛಋೖͨ͠ ಛ௃ྔۭؒʹࣹӨͨ͠ͱ͖ɺͲΕ͘Β͍ͷڑ཭ͳΒ͹ʮ͍ۙʯͱݴ͑Δͷ͔ʁ
    ͜ͷई౓͕σʔλʹґଘͤͣɺҰ؏ੑΛ࣋ͭΑ͏ʹਖ਼نԽͯ͠΍Δɻ w Ͳ͏΍ͬͯਖ਼نԽ͢Δͷ͔ʁʁ 
 ɹˠ
    ैདྷͷίαΠϯྨࣅ౓ʹόΠΞεΛ଍͢
    w όΠΞε͸ۙ๣αϯϓϧͱͷڑ཭ฏۉʹΑͬͯࢉग़͢Δ
    w ࠓճ͸όΠΞεࢉग़ઐ༻ͷCBDLHSPVOEEBUBTFUΛ༻ҙͨ͠ʢόΠΞεࢉग़ʹSFGFSFODFը૾͸࢖Θͳ͍ʣ w R͸ΫΤϦʢྫ͑͹৽ن౤ߘ͞Εͨը૾ʣ
    w S͸ϦϑΝϨϯεʢྫ͑͹౤ߘࡁΈͷը૾ʣ
    w T͸ίαΠϯྨࣅ౓
    w ࠷ۙ๪ͷOdOFOE൪໨·ͰͷαϯϓϧΛར༻
    w ЌͰOPNBMJ[BUJPOͷ͔͔Γ۩߹Λௐ੔ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
19. ը૾ม׵ͷύλʔϯΛ௥Ճͨ͠ 4JN$-3Ͱѻ͍ͬͯͨύλʔϯʹɺ͞Βʹ4USPOH
    #MVSɺ3PUBUJPOͳͲͷύλʔϯΛ௥Ճͨ͠ɻ
    UFYUॲཧͷ௥Ճ͸ɺσʔληοτ%*4$ʹ
    ߹Θͤʹߦ͍ͬͯΔΑ͏ͳؾ΋͢Δ͕ɺɺɺ🤔 https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
20. ࣮ݧͱ݁Ռ
21. ࣮ݧͷ֓ཁ σʔληοτɿ%*4$
    w ֶश༻ʹສຕɺධՁ༻ʹສຕʢRVFSZʣʴສຕʢSFGFSFODFʣ
    w RVFSZը૾ͷ͏ͪສຕ͸SFGFSFODFը૾Λฤूͯ͠࡞੒ͨ͠DPQZͰ͋Δɻ
    λεΫ
    w SFGFSFODFը૾Λࢀরͯ͠ɺRVFSZը૾͕DPQZ͔൱͔Λ൑ఆ͢ΔλεΫɻ
    ධՁࢦඪɿNJDSP
    BWFSBHF
    QSFDJTJPO
    Ÿ"1
    w αϯϓϧ୯ҐͰ"WFSBHF
    1SFDJTJPOͷฏۉΛࢉग़ͨ͠΋ͷɻ RVFSZ SFGFSFODF https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
22. ࣮ݧ݁Ռɿ·ͣ͸4P5" https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
23. ߟ࡯ɿ&OUSPQZ
    -PTTͱ4DPSF
    /PSNBMJ[BUJPO͕ಛʹޮ͍͍ͯΔ༷ࢠ w4JN$-3͕ϕʔεϥΠϯ
    wUSVOL͸$//ͷग़ྗΛར༻
    wQSPK͸ઢܗม׵ͨ͠΋ͷΛར༻ wϕʔεϥΠϯͱఏҊख๏ͷதؒతଘࡏͱͯ͠ 4JN$-3$%΋ධՁ
    w͜Ε͸ɺ&OUSPQZ
    -PTTҎ֎ͷఏҊख๏Λ 
 ద༻ͨ͠΋ͷʢ˞.-1ஔ͖׵͑΍(F.
    1PPMʣ w4JN$-3$%ˠ44$%΁ͷมԽɺ 
 ͭ·Γ&OUSPQZ
    -PTTಋೖ͚ͩͰ 
 Ж"1͕໿޲্ʢˠʣ wЖ"14/͸4DPSF
    /PNBSJ[BUJPOΛ 
 ಋೖͨ͠৔߹ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html
24. "CMBUJPOT (F.
    1PPMJOH΍4USPOH
    #MVSͳͲɺ͍ͣΕͷ޻෉΋ޮՌ͕͋ͬͨ͜ͱΛ֬ೝͰ͖͍ͯΔɻ
    ಛච͢΂͖͸ɺQSPKFDUJPO
    GFBUVSF͸&OUSPQZ
    -PTTͱηοτͰಛʹ༗ޮͱͳΔ఺ɻ https://openaccess.thecvf.com/content/CVPR2022/html/Pizzi_A_Self-Supervised_Descriptor_for_Image_Copy_Detection_CVPR_2022_paper.html DPWBSJBOUͱJOWBSJBOUͷٞ࿦Λ౿·͑Δͱɺ 4JN$-3ͰUSVOLͷํ͕ߴੑೳͳͷ͸Կނʁ🤔
25. ·ͱΊ
    w RVFSZը૾͕༩͑ΒΕͨͱ͖ɺSFGFSFODFը૾Λࢀরͯ͠ίϐʔ͔൱͔൑ఆ͢Δ *NBHF
    $PQZ
    %FUFDUJPOʹ௅ઓ
    w 4JN$-3Λϕʔεʹɺ&OUSPQZ
    -PTTͱ͍ͬͨ޻෉Λಋೖͯ͠ੑೳվળͨ͠
    ߟ࡯
    w ఏҊख๏͸ޮՌత͕ͩͬͨʮͦΕ͸Կނʁʯͱ͍͏ղ໌͕΋ͬͱਐΉͱخ͍͠