Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Another Diversity-Promoting Objective Function ...

Ryobot
January 27, 2019

Another Diversity-Promoting Objective Function for Neural Dialogue Generation

My oral presentation slide at AAAI 2019 Workshop on Reasoning and Learning for Human-Machine Dialogues (DEEP-DIAL 2019).
paper: https://arxiv.org/abs/1811.08100
workshop site: https://sites.google.com/view/deep-dial-2019/program

Ryobot

January 27, 2019
Tweet

More Decks by Ryobot

Other Decks in Technology

Transcript

  1. IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPO GPS/FVSBM%JBMPHVF(FOFSBUJPO 3ZP/BLBNVSB ,BUTVIJUP4VEPI ,PJDIJSP:PTIJOP 4BUPTIJ/BLBNVSB

    (SBEVBUF4DIPPMPG*OGPSNBUJPO4DJFODF /BSB*OTUJUVUFPG4DJFODFBOE5FDIPOPMPHZ +BQBO 3*,&/ $FOUFSGPS"EWBODFE*OUFMMJHFODF1SPKFDU"*1 +BQBO \OBLBNVSBSZPON TVEPI LPJDIJSP TOBLBNVSB^!JTOBJTUKQ !1
  2. IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ w"OPQFOEPNBJOEJBMPHVFTZTUFNUIBUHFOFSBUFTBSFTQPOTFXPSE CZXPSEVTJOHBUSBJOFEOFVSBMOFUXPSL FH TFRTFR  w(FOFSBUJPOCBTFJTNPSFqFYJCMFUIBOSFUSJFWBMCBTF

    CVUqVFODZ  DPOTJTUFODZBSFOPUHPPE /FVSBM%JBMPHVF(FOFSBUJPO (P /PUIJOH NVDI 8IBU`T /PUIJOH NVDI  VQ !2 w*OQBSUJDVMBS UIFHFOFSBUFESFTQPOTFIBTMPXEJWFSTJUZBOE UFOETUPCFBHFOFSJDSFTQPOTFMJLF*EPO`ULOPXz8IZ
  3. IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ )FZ XIBU`TVQ  )PXBSFZPV  )FZ

    &SJO8IBU`TVQ )J 4FBO)PXBSFZPVEPJOH  /PUNVDI %PZPVIBWFBOZQMBOTUPOJHIU EBUBUSBOTEVDUJPO FOPSNPVTDBOEJEBUFTJOSFBMEJBMPHVF ."1QSFEJDUJPOBGUFS.-&USBJOJOH w%JBMPHVFHFOFSBUJPOJTBNBOZUPNBOZUSBOTEVDUJPOUBTLJO XIJDIDPOUFOUTWBSZEFQFOEJOHPOUIFDPOUFYU w'SFRVFOUXPSETBSFBQQMJDBCMFJOBOZDPOUFYU TPUIFZUFOEUPCF DBOEJEBUFTGPSHFOFSBUJPO w"TBSFTVMU POMZUIFNPTUMJLFMZSFTQPOTFJTHFOFSBUFE %VSJOHFWBMVBUJPO !4
  4. IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ w%VFUPMBDLPGEBUBBOEEBUBJNCBMBODF 4FSCBOFUBM  w4PGUNBY$SPTT&OUSPQZ 4$& MPTTJTOPUHPPECFDBVTFBMMXPSET

    BSFIBOEMFEFRVBMMZSFHBSEMFTTPGMBDLBOEJNCBMBODF #SFBLEPXOMPXEJWFSTJUZQSPCMFN .FBTVSFTBMSFBEZTVHHFTUFE /PTVHHFTUJPO8FDIBMMFOHFEJU !5 w'SFRVFOUXPSETTVQQMZNPSFQFOBMUJFTUIBOSBSFXPSET %VSJOHUSBJOJOH %VSJOHFWBMVBUJPO w.BYJNVN"1PTUFSJPSJ ."1 QSFEJDUTUIFNPTUMJLFMZ SFTQPOTFPOMZ w"XBZUPHFOFSBUFVOMJLFMZSFTQPOTFVTJOH.BYJNVN.VUVBM *OGPSNBUJPO ..* JTSFQPSUFEJO -JFUBM
  5. IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ w4$&MPTTUSFBUTFBDIUPLFO ɹDMBTTFRVBMMZ :PV EP OPU UBML

    BCPVU 'JHIU $MVC  :PV EP OPU UBML BCPVU 'JHIU $MVC  !7 1SPQPTFENFUIPE w *5'MPTTTDBMFTTNBMMFSMPTT ɹGPSGSFRVFOUUPLFODMBTTFT 4PGUNBY$SPTT&OUSPQZMPTT *OWFSTF5PLFO'SFRVFODZMPTT
  6. IUUQTBSYJWPSHBCT "OPUIFS%JWFSTJUZ1SPNPUJOH0CKFDUJWF'VODUJPOGPS/FVSBM%JBMPHVF(FOFSBUJPO /BLBNVSBFUBM """*%&&1%*"-XPSLTIPQ #BTFMJOFT w4FR4FRMBZFST#J-45.XSFTJEVBMDPOOFDUJPOT w4FR4FR "UUFOUJPO w4FR4FR ..*

    w.FN//DPOTJEFSJOHEJBMPHVFIJTUPSZVTJOHNFNPSZ &WBMVBUJPONFUSJDT w#-&6OHSBNTNBUDIJOHCFUXFFOBMMIZQPBOEBMMSFG w%*45EJTUJODUOHSBNTJOBMMHFOFSBUFESFTQPOTFT &YQFSJNFOUTFUVQT !10 %BUBTFUT w0QFO4VCUJUMFT &O .UVSOTBOE.FQJTPEFT w5XJUUFS &O+B ..UVSOTBOE..FQJTPEFT