Upgrade to Pro — share decks privately, control downloads, hide ads and more …

DETECLAP: Enhancing Audio-Visual Representation...

DETECLAP: Enhancing Audio-Visual Representation Learning with Object Information (Technical seminar on acoustic scene and event analysis)

2024/10/17に同志社大学にて開催されたTechnical seminar on acoustic scene and event analysisでのLINEヤフーの発表資料です。

More Decks by LINEヤフーTech (LY Corporation Tech)

Other Decks in Technology

Transcript

  1. ˜-:$PSQPSBUJPO $POUSBTUJWF"VEJP7JTVBM.BTLFE"VUP&ODPEFS $"7."& • $POUSBTUJWFMFBSOJOH ."&GPSBVEJPWJTVBMQSFUSBJOJOH $"7."&<(POH *$-3`> BVEJP WJTVBM

    $POUSBTUJWF-PTT BVEJPBOEWJTVBM FNCFEEJOHTDMPTFSUPHFUIFS 3FDPOTUSVDUJPO-PTT EFWFMPQVTFGVM SFQSFTFOUBUJPOTGPS EPXOTUSFBNUBTLT 
  2. ˜-:$PSQPSBUJPO $"7."&<(POH *$-3`> BVEJP RVFSZ SFUSJFWFE WJTVBM BVEJP WJTVBM JOQVU

    QMBZJOHQJBOP DBUFHPSZ "VEJPWJTVBMSFUSJFWBM "VEJPWJTVBMDMBTTJGJDBUJPO %# SFUSJFWFE BVEJP WJTVBMRVFSZ %# QSFEJDU $POUSBTUJWF"VEJP7JTVBM.BTLFE"VUP&ODPEFS $"7."& • $POUSBTUJWFMFBSOJOH ."&GPSBVEJPWJTVBMQSFUSBJOJOH • "QQMJFEUPBVEJPWJTVBMSFUSJFWBMBOEDMBTTJGJDBUJPO 
  3. ˜-:$PSQPSBUJPO *TTVFPG$"7."& RVFSZ JODPSSFDUSFTVMUT 'BJMVSFDBTFTPG$"7."& EPHT PCPF MJPO CJSE GMVUF

    IPSO  "MBDLPGBCJMJUZUPSFDPHOJ[FGJOFHSBJOFEEFUBJMT • $"7."&DBQUVSFTSPVHIDBUFHPSZ lBOJNBMTzBOElXJOEJOTUSVNFOUTz • #VUJUMBDLTGJOFHSBJOFEPCKFDUJOGPSNBUJPO lEPHTzBOElPCPFz
  4. ˜-:$PSQPSBUJPO • 7((4PVOE • -BSHFTDBMFWJEFPEBUBTFU •  WJEFPT • DBUFHPSZ

    • "VEJP4FU, • 4VCTFUPG"VEJP4FU •  WJEFPT • DBUFHPSZ &YQFSJNFOU%BUBTFU 
  5. ˜-:$PSQPSBUJPO • "VEJPWJTVBMSFUSJFWBM • 3FUSJFWFDPSSFTQPOEJOHBVEJPWJEFPGPSBHJWFOWJTVBMBVEJPJOQVU • "VEJPWJTVBMDMBTTJGJDBUJPO • 1SFEJDUDBUFHPSJFTVTJOHWJEFPBOEBVEJPBTJOQVUT &YQFSJNFOU5BTLT

    BVEJP RVFSZ SFUSJFWFE WJTVBM BVEJP WJTVBM JOQVU QMBZJOHQJBOP DBUFHPSZ "VEJPWJTVBMSFUSJFWBM "VEJPWJTVBMDMBTTJGJDBUJPO %# SFUSJFWFE BVEJP WJTVBMRVFSZ %# QSFEJDU