Learning Cross-modal Embeddings for Cooking Recipes and Food Images

Review and presentation of the Image to Recipe paper and model

Transcript

1. -FBSOJOH
   
 $SPTTNPEBM
   &NCFEEJOHT
 GPS
   $PPLJOH
   3FDJQFT
   
 BOE
   'PPE
   *NBHFT 2017.08.06 KantoCV #41
2. w -FT[FL
   ϨγΣοΫ
   w ϙʔϥϯυग़਎
   w ΫοΫύουͷݚڀ։ൃ෦
   w ը૾ղੳ
   w ϙʔϥϯυͷΫοΫύου Ͱˌ̍ͷϨγϐɿ
 ๻ͷϐΤϩΪ ࣗݾ঺հ
3. 2VJ[
4. A D G J B E H K C I F
5. A D G J B E H K C I F
6. C B A 1 2 3
7. C B A 1 2 3
8. C B A 1 2 3
9. C B A 1 2 3
10. A B C D E F G
11. A B C D E F G
12. w $MBTTJpDBUJPO
    PG
    SFDJQFT
    JT
    )"3%
    w *NBHF
    SFDPHOJUJPO
    PO
    GPPE
    JT
    )"3%
    w JOUSBDMBTT
    WBSJFUZ
    w JOUFSDMBTT
    TJNJMBSJUZ
    w 5IF
    FYJTUJOH
    EBUBTFUT
    BSF
    4."--
    w 5PP
    NBOZ
    JOHSFEJFOUT
    w $VMUVSBM
    CJBTFT
    w &YJTUJOH
    TPMVUJPOT
    IBWF
    MPX
    BDDVSBDZ http://www.robotshop.com/
13. July 20, 2017
14. July 20, 2017
15. July 20, 2017
16. July 20, 2017
17. July 20, 2017
18. July 20, 2017
19. 3FDJQF.
    %BUBTFU
22. https://cookpad.com/recipe/1758645
23. %BUBTFU w 
    EJ⒎FSFOU
    TJUFT
    BT
    TPVSDF
    JODM
    $PPLQBE
    w N
    SFDJQFT
    BOE
    L
    JNBHFT
    
    w 
    PG
    SFDJQF
    UJUMFT
    BSF
    OPU
    VOJRVF
    w BWFSBHF
    SFDJQF
    IBT
    
    JOHSFEJFOUT
    w PG
    
    JOHSFEJFOUT
    
    JO
    
    SFDJQFT
    w TPNF
    SFDJQFT
    BSF
    POF
    TUFQ
    
 TPNF
    DPOUBJO
    TVCSFDJQFT
    w TPNF
    GPPE
    UZQFT
    BSF
    WFSZ
    QPQVMBS
    
 DIPDPMBUF
    DIJQ
    DPPLJFT
24. &NCFEEJOH
25. TGEKRGURCEG KOCIGURCEG LQKPVGODGFFKPIURCEG UOQQVJKGU ITCVKPU UWUJK JCODWTIGTU */56*5*0/
26. .PEFM
    0WFSWJFX
27. w XPSEWFD
    PO
    JOHSFEJFOUT
    w 
    UCTQ
    PG
    PMJWF
    PJM
    
    w PMJWF@PJM
    CFMM@QFQQFS
    CMBDL@QFQQFS
    w CJEJSFDUJPOBM
    -45.
28. w TLJQJOTUSVDUJPOT
    -45.
    PO
    -45.
    w SFDJQF
    TUBSU
    BOE
    FOE
    NBSLFST
    w DPODBUFOBUF
    pOBM
    FODPEJOH
    XJUI
    UIF
    JOHSFEJFOU
    FODPEJOH
29. w UFTUFE
    7((
    BOE
    3FT/FU
    w DMBTTJpDBUJPO
    ˠ
    FNCFEEJOH
    MBZFS
    w *NBHF/FU
    QSFUSBJOFE
    pOFUVOFE
    w USBJOFE
    TFQBSBUFMZ
    GSPN
    UFYU
30. w 
    NBUDIJOH
    QBJST
    
    
    NJYFE
    QBJST
    w
    
    
31. w 'PPE
    DBUFHPSJFT
    HVFTTFE
    GSPN
    SFDJQF
    UJUMF
    w FNCFEEJOH
    ˠ
    DBUFHPSZ
    DMBTTJpFS
    w JG
    TBNF
    DBUFHPSZ
    Lreg
    
    
    w λ 
    
32. 5PUBM
    MPTT
    GVODUJPO
33. &YQFSJNFOUT
34. JNBHF
    ˠ
    SFDJQF
35. SFDJQF
    ˠ
    JNBHF
37. #FUUFS
    UIBO
    )VNBO
38. %&.0 http://wednesday.csail.mit.edu: 4242/
39. 6OJU
    "DUJWBUJPOT
40. XPSEWFD
    NBUI http://www.samyzaf.com/ML/nlp/nlp.html
41. XPSEWFD
    NBUI man - king + woman = queen cats - cat + dog = dogs France - Paris + England = London London - England + Italy = Rome Italy - Rome + Paris = France
42. .BUI
    PO
    3FDJQFT
43. .BUI
    PO
    *NBHFT
44. $SPTTNPEBM
45. w 3FDJQF.
    EBUBTFU
    w JNBHF
    ˠ
    SFDJQF
    w SFDJQF
    ˠ
    JNBHF
    w CFUUFS
    UIBO
    IVNBO
    w JOHSFEJFOU
    EFUFDUJPO
    w SFDJQF
    BSJUINFUJD http://www.robotshop.com/ ·ͱΊ
46. Ҏ্