Lighthouse: A User-friendly Library for Reproducible Video Moment Retrieval and Highlight Detection (Technical seminar on acoustic scene and event analysis)

2024/10/17に同志社大学にて開催されたTechnical seminar on acoustic scene and event analysisでのLINEヤフーの発表資料です。

Transcript

1. ˜
   -:
   $PSQPSBUJPO -JHIUIPVTF
   "
   6TFSGSJFOEMZ
   -JCSBSZ
   GPS 3FQSPEVDJCMF
   7JEFP
   .PNFOU
   3FUSJFWBM
   BOE
   )JHIMJHIU
   %FUFDUJPO </JTIJNVSB
   &./-1> 7JEFP
   BOBMZTJT
   UFBN
   .VMUJNPEBM
   "*
   %FQU
   -:
   $PSQPSBUJPO Taichi Nishimura, Ph.D.
2. ˜
   -:
   $PSQPSBUJPO .PNFOU
   SFUSJFWBM
   BOE
   IJHIMJHIU
   EFUFDUJPO
   .3)% 7JEFP
   NPNFOU
   SFUSJFWBM
   .3 *OQVU
   WJEFP
   RVFSZ
   0VUQVU
   NPNFOUT
   TUBSU
   BOE
   FOE
   UJNFTUBNQT )JHIMJHIU
   EFUFDUJPO
   )% *OQVU
   WJEFP
   RVFSZ
   0VUQVU
   TBMJFODZ
   TDPSFT
   DPOUJOVPVT
   WBMVFT -FJ
   FU
   BM
   </FVS*14 >
   VOJGJFE
   .3
   BOE
   )%
   BOE
   QSPQPTFE
   .3)%
   XJUI
   BO
   BOOPUBUFE
   EBUBTFU 
3. ˜
   -:
   $PSQPSBUJPO 27)JHIMJHIUT <-FJ
   FU
   BM
   /FVS*14> L
   WJEFPT
   
   RVFSJFT
   XJUI
   NPNFOUT
   BOE
   
   TBMJFODZ
   TDPSFT
   WFSZ
   CBE
   UP
   WFSZ
   HPPE 
4. ˜
   -:
   $PSQPSBUJPO 5XP
   JTTVFT 
   3FQSPEVDJCJMJUZ
   "
   MBDL
   PG
   SFQSPEVDJCMF
   FYQFSJNFOUT
   BDSPTT
   NFUIPET
   EBUBTFUT
   BOE
   GFBUVSFT 😢
   /P
   VOJGJFE
   USBJOJOHFWBMVBUJPO
   DPEFCBTF
   DPWFSJOH
   NVMUJQMF
   TFUUJOHT 😢
   3FTFBSDIFST
   VTF
   EJGGFSFOU
   .3
   BOE
   )%
   EBUBTFUT
   FYDFQU
   GPS
   27)JHIMJHIUT 
   6TFSVOGSJFOEMZ
   EFTJHO 😢
   3FTFBSDIFST
   VTF
   EJGGFSFOU
   MJCSBSJFT
   UIVT
   XF
   OFFE
   UP
   TFU
   VQ
   JOEJWJEVBM
   FOWJSPONFOUT 😢
   /P
   JOGFSFODF
   "1*
   BOE
   XFC
   EFNP 
5. ˜
   -:
   $PSQPSBUJPO *TTVF
    
   3FQSPEVDJCJMJUZ 
   3FQSPEVDJCJMJUZ
   "
   MBDL
   PG
   SFQSPEVDJCMF
   FYQFSJNFOUT
   BDSPTT
   NFUIPET
   EBUBTFUT
   BOE
   GFBUVSFT 😢
   /P
   VOJGJFE
   USBJOJOHFWBMVBUJPO
   DPEFCBTF
   DPWFSJOH
   NVMUJQMF
   TFUUJOHT 😢
   3FTFBSDIFST
   VTF
   EJGGFSFOU
   .3
   BOE
   )%
   EBUBTFUT
   FYDFQU
   GPS
   27)JHIMJHIUT 
   6TFSVOGSJFOEMZ
   EFTJHO 😢
   3FTFBSDIFST
   VTF
   EJGGFSFOU
   MJCSBSJFT
   UIVT
   XF
   OFFE
   UP
   TFU
   VQ
   JOEJWJEVBM
   FOWJSPONFOUT 😢
   /P
   JOGFSFODF
   "1*
   BOE
   XFC
   EFNP 
6. ˜
   -:
   $PSQPSBUJPO *TTVF
    
   6TFSVOGSJFOEMZ
   EFTJHO 
   3FQSPEVDJCJMJUZ
   "
   MBDL
   PG
   SFQSPEVDJCMF
   FYQFSJNFOUT
   BDSPTT
   NFUIPET
   EBUBTFUT
   BOE
   GFBUVSFT 😢
   /P
   VOJGJFE
   USBJOJOHFWBMVBUJPO
   DPEFCBTF
   DPWFSJOH
   NVMUJQMF
   TFUUJOHT 😢
   3FTFBSDIFST
   VTF
   EJGGFSFOU
   .3
   BOE
   )%
   EBUBTFUT
   FYDFQU
   GPS
   27)JHIMJHIUT 
   6TFSVOGSJFOEMZ
   EFTJHO 😢
   3FTFBSDIFST
   VTF
   EJGGFSFOU
   MJCSBSJFT
   UIVT
   XF
   OFFE
   UP
   TFU
   VQ
   JOEJWJEVBM
   FOWJSPONFOUT 😢
   /P
   JOGFSFODF
   "1*
   BOE
   XFC
   EFNP 
7. ˜
   -:
   $PSQPSBUJPO 5IF
   -JHIUIPVTF
   MJCSBSZ 
8. ˜
   -:
   $PSQPSBUJPO -JCSBSZ
   BSDIJUFDUVSF
   PWFSWJFX 
9. ˜
   -:
   $PSQPSBUJPO #BTFMJOF
   .PNFOU
   %&53
   <-FJ
   FU
   BM
   /FVS*14> 5IF
   BQQSPBDI
   JT
   CBTFE
   PO
   %&53
   USBOGPSNFSCBTFE
   PCKFDU
   EFUFDUPS
   <$BSJPO FU
   BM
   &$$7> 
10. ˜
    -:
    $PSQPSBUJPO 6TFSGSJFOEMZ
    EFTJHO
    JOGFSFODF
    "1* 5ISFF
    TUFQT 
    .PEFM
    JOJUJBMJ[BUJPO
    $16(16
    GFBUVSF
    
    FODPEF
    B
    WJEFP
    BOE
    
    QSFEJDU
    .3)% 
11. ˜
    -:
    $PSQPSBUJPO 'VUVSF
    XPSL
    )PX
    UP
    VUJMJ[F
    BVEJP
    JOGPSNBUJPO 'FBUVSF
    DPODBUFOBUJPO
    $-*1 4MPXGBTU WJTJPO
    WT
    $-*1 4MPXGBTU 1"//T <,POH
    5"4-1> 😄
    1"//T
    DPOUSJCVUFT
    UP
    UIF
    QFSGPSNBODF
    HBJO 'VUVSF
    XPSL
    JO
    BVEJP
    EPNBJO )PX
    UP
    GVTF
    WJTJPO
    BVEJP
    TQFFDI
    BOE
    UFYU
    GFBUVSFT 8F
    USJFE
    UP
    GVTF
    UIFN
    XJUI
    DSPTTBUUFOUJPO
    DPODBUFOBUJPO
    HBUFE
    GVTJPO
    CVU
    DPVME
    OPU
    BDIJFWF B
    CJH
    JNQSPWFNFOU
    GSPN
    UIF
    WJTVBMPOMZ
    NPEFMT
    *OUFSO
    XPSL  .PEFM
    
    2%%&53 3FDBMM!*P6 3FDBMM!*P6 $-*1 4MPXGBTU   $-*1 4MPXGBTU 1"//T  
12. ˜
    -:
    $PSQPSBUJPO 5IBOL
    :PV