Upgrade to Pro — share decks privately, control downloads, hide ads and more …

論文紹介:Speeding up Automatic Hyperparameter Optim...

S.Shota
May 12, 2017

論文紹介:Speeding up Automatic Hyperparameter Optimization of Deep Neural Networks by Extrapolation of Learning Curves

2017/05/12の論文紹介ゼミで使用したスライドです.
論文:T. Domhan, J. T. Springenberg, and F. Hutter,
“Speeding up Automatic Hyperparameter Optimization of Deep Neural Networks by Extrapolation of Learning Curves,”
Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015) (2015)

http://ml.informatik.uni-freiburg.de/papers/15-IJCAI-Extrapolation_of_Learning_Curves.pdf

S.Shota

May 12, 2017
Tweet

More Decks by S.Shota

Other Decks in Technology

Transcript

  1. 5%PNIBO +54QSJOHFOCFSH BOE')VUUFS l4QFFEJOHVQ"VUPNBUJD )ZQFSQBSBNFUFS 0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG -FBSOJOH$VSWFT z 1SPDFFEJOHTPGUIF5XFOUZ'PVSUI*OUFSOBUJPOBM+PJOU

    $POGFSFODFPO"SUJGJDJBM*OUFMMJHFODF *+$"*  ೥݄೔ ؀ڥ৘ใֶ෎ ৘ใϝσΟΞ؀ڥֶઐ߈ ৘ใϝσΟΞֶίʔε ന઒ݚڀࣨ೥ ੪౻ ᠳଡ
  2.  • 5%PNIBO +54QSJOHFOCFSH BOE' )VUUFS l4QFFEJOHVQ"VUPNBUJD )ZQFSQBSBNFUFS 0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG

    -FBSOJOH$VSWFT z1SPDFFEJOHTPGUIF 5XFOUZ'PVSUI*OUFSOBUJPOBM+PJOU $POGFSFODFPO"SUJGJDJBM*OUFMMJHFODF *+$"*   ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT จݙ৘ใ
  3.  •$."&4ʹΑΔ%//ͷϋΠύʔ ύϥϝʔλ࠷దԽ ͷࢀߟจݙʹ ڍ͛ΒΕ͍ͯͨͨΊ • *-PTIDIJMPW BOE')VUUFS l$."&4GPS )ZQFSQBSBNFUFS

    0QUJNJ[BUJPOPG%FFQ/FVSBM /FUXPSLT z1SPDFFEJOHPG*OUFSOBUJPOBM$POGFSFODFPO -FBSOJOH3FQSFTFOUBUJPOT  •֬཰Ϟσϧʹجͮ͘%//ͷϋΠύʔ ύϥϝʔλ࠷దԽͷख๏ͷͭͰ͋Δ ͨΊ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS 0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT ͜ͷ࿦จΛબΜͩཧ༝
  4.  •ϋΠύʔύϥϝʔλ࠷దԽΛߴ଎Խ͢Δ ख๏ΛఏҊ •܇࿅தͷ࠷ॳͷ਺εςοϓͷ৘ใ͔Βɼ ੑೳΛ༧ଌ • ѱͦ͏ͩͬͨΒऴྃͯ࣍͠ͷ୳ࡧ΁ • ֶशۂઢͷ֬཰తͳϞσϧΛఆ࣮ٛͯ͠ݱ •%//Ͱ࣮ݧͨ͠ͱ͜Ζɼ໿ഒͷ଎౓Ͱ

    ϋΠύʔύϥϝʔλͷ࠷దԽΛ࣮ݱ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT ֓ཁ
  5.  • ػցֶशΞϧΰϦζϜɿ • ͷ࣋ͭϋΠύʔύϥϝʔλɿ • ͷఆٛҬɿ • ϋΠύʔύϥϝʔλશମ͕ͳۭؒ͢ɿ •

    ϋΠύʔύϥϝʔλͷ૊ɿ • Λ࢖ͬͨ৔߹ͷΞϧΰϦζϜɿ • ܇࿅σʔλɿ • ςετσʔλɿ • Ͱ܇࿅ͨ͠ ͷ ʹର͢Δଛࣦɿ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS 0QUJNJ[BUJPOPG%FFQ/FVSBM /FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT )ZQFSQBSBNFUFS0QUJNJ[BUJPO.FUIPE A A i (i = 1, 2, . . . , n) i ⇤i (i = 1, 2, . . . , n) ⇤ = ⇤1 ⇥ · · · ⇥ ⇤n 2 ⇤ A Dtrain Dvalid Dtrain Dvalid A l( )
  6.  •୅දతͳख๏ • HSJETFBSDI • SBDJOHBMHPSJUIN • HSBEJFOUTFBSDI • SBOEPNTFBSDI

    • #BZFTJBOPQUJNJ[BUJPO #0  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT )ZQFSQBSBNFUFS0QUJNJ[BUJPO.FUIPE ϋΠύʔύϥϝʔλ࠷దԽ໰୊ arg min 2⇤ l( ) Ծఆͨ͠ࣄલ෼෍͔Βͷ αϯϓϧΛ༻͍ͯ ໨తؔ਺ͷ֬཰ϞσϧΛ ߋ৽͢Δख๏
  7.  •4QFBSNJOUɿ#BZFTJBO0QUJNJ[BUJPOͷ ୅දతͳ࣮૷ • ࣄલ෼෍ʹ(BVTTJBO1SPDFTT (1 Λ࢖༻ • ࿈ଓతͳ஋Λ࣋ͭϋΠύʔύϥϝʔλͷ ࠷దԽʹదͨ͠ख๏

    •4."$ɼ51&ɿ໦ߏ଄ϕʔεͷ࠷దԽ ख๏ • %//ͷΑ͏ʹߴ࣍ݩɼ཭ࢄతͳϋΠύʔ ύϥϝʔλΛ͍࣋ͬͯΔ৔߹ʹ༗ޮ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT )ZQFSQBSBNFUFS0QUJNJ[BUJPO.FUIPE ͪ͜ΒΛ࠾༻
  8.  •5ZQFͷֶशۂઢ͸ɼҰൠతʹ͸ աֶशͷߟ͑ΛՄࢹԽ • աֶश͢Δલʹ܇࿅Λऴྃͤ͞Δ͜ͱΛ ໨తͱͯ͠ݚڀ •ֶशۂઢϞσϧΛؚΉ(1ϕʔεͷ#0΋ طʹߟҊ͞Ε͍ͯΔ • ߦྻ෼ղɼϩδεςΟοΫճؼɼ-BUFOU

    %JSJDIMFU "MMPDBUJPO -%" ʹద༻ • %//Ͱ͸͏·͘ػೳ͠ͳ͍  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT .PEFMJOH-FBSOJOH$VSWFT
  9.  •؍ଌֶͨ͠शۂઢΛ,ݸͷؔ਺ ͰϞσϧԽ •ؔ਺ ͷ࣋ͭύϥϝʔλɿ •Ψ΢γΞϯϊΠζɿ •ؔ਺ ͷ΋ͱͰɼ࣌ؒ Ͱͷੑೳɿ •ؔ਺

    ͷ΋ͱͰɼੑೳ ΛऔΔ֬཰ɿ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT 1BSBNFUSJD-FBSOJOH$VSWF.PEFMT {f1, . . . , fK} fk ✓k ✏ ⇠ N ⇣ 0, 2 ⌘ fk t fk yt p ⇣ yt | ✓k, 2 ⌘ = N ⇣ yt | fk (t | ✓k ), 2 ⌘ yt = fk (t | ✓k ) + ✏
  10.  •,ݸͷؔ਺ΛॏΈ෇͖ઢܗ࿨Ͱ݁߹ɿ • ͷύϥϝʔλϕΫτϧɿ •ෆ࣮֬ੑΛద੾ʹϞσϧԽ͢ΔͨΊʹ ϕΠζతͳਪఆΛ࢖༻ • ͷਪఆʹ͸.$.$Λ࢖༻  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ

    /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT "8FJHIUFE1SPCBCJMJTUJD-FBSOJOH$VSWF.PEFMT f comb ( t | ⇠ ) = K X k= 1 wk fk ( t | ✓k ) f comb ⇠ = ⇣ w1, . . . , wK, ✓1, . . . , ✓K, 2 ⌘ ym
  11.  •ͨͩ͠ɼॏΈ͸ਖ਼ʹ੍ݶ • ݮগ͢ΔۂઢΛಘΔͨΊ • ͢΂ͯͷϞσϧΛฏۉԽ͢Δͱ༧ଌͨ͠ۂ ઢ͸ฏୱʹͳΔͱ͍͏ޮՌ΋ •্ͷ੍໿ͷ΋ͱͰࣄલ෼෍Λ࣍ࣜͰఆٛ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ

    /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT "8FJHIUFE1SPCBCJMJTUJD-FBSOJOH$VSWF.PEFMT p ( ⇠ ) / 0 B B B B B @ K Y k= 1 p ( wk ) p ( ✓k ) 1 C C C C C A p ( 2 ) I ( f comb(1 | ⇠ ) < f comb( m | ⇠ )) 8k, p ( wk ) / 8 > > < > > : 1 if wk > 0 0 otherwise
  12.  •4ݸͷαϯϓϧ ͸࣍ͷࣄޙ෼෍ ͔ΒαϯϓϦϯά •ͨͩ͠ɼ ͸࣍ࣜͰఆٛ •Ϟσϧύϥϝʔλ ͷॳظ஋͸ɼϞσϧ ͝ͱͷ࠷໬ਪఆ஋ʹઃఆ 

    ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT "8FJHIUFE1SPCBCJMJTUJD-FBSOJOH$VSWF.PEFMT ⇠1, . . . , ⇠S P(⇠ | y1:n ) / P(y1:n | ⇠)P(⇠) P(y1:n | ⇠) P ( y 1: n | ⇠ ) = n Y t= 1 N ⇣ yt | f comb( t | ✓k ) , 2 ⌘ ✓k
  13.  • ͕༩͑ΒΕͨͱ͖ɼ ͕ Λ௒͑Δ ֬཰ɿ • ͸ਖ਼ن෼෍ͷྦྷੵີ౓ؔ਺  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ

    /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT "8FJHIUFE1SPCBCJMJTUJD-FBSOJOH$VSWF.PEFMT y1:n ym ˆ y P ( ym ˆ y | y 1: n ) = Z P ( ⇠ | y 1: n ) P ( ym > ˆ y | ⇠ )d ⇠ ⇡ 1 S S X s= 1 P ( ym > ˆ y | ⇠S ) = 1 S S X s= 1 ⇣ 1 ⇣ ˆ y | f comb( m | ⇠S ) , 2 S ⌘⌘ (· | µ, 2)
  14.   ࠷ߴਫ਼౓ ͱ͢Δʢ ͷॳظ஋͸ ʣ  ͋ΔϋΠύʔύϥϝʔλ Λ࢖ͬͯ%//Λ ܇࿅͠ɼΠςϨʔγϣϯ͝ͱʹ

    ςετσʔλʹର͢ΔධՁ஋ Λอଘ  ΤϙοΫ͝ͱʹɼ֬཰ Λܭࢉ  ֬཰ ͕͖͍͠஋ Λ ௒͍͑ͯͨΒ܇࿅Λଓߦɽͦ͏Ͱͳ͍৔߹͸ தஅ͠ɼධՁ஋ͷظ଴஋ Λ ϋΠύʔύϥϝʔλͷ࠷దԽثʹ౉͢  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT 4QFFEJOHVQ)ZQFSQBSBNFUFS 0QUJNJ[BUJPO ΞϧΰϦζϜ ˆ y ˆ y 1 i yi P(ym ˆ y | y1:n ) p P(ym ˆ y | y1:n ) 1 E[ym | y1:n ] QSFEJDUJWFUFSNJOBUJPODSJUFSJPO
  15.  •࢖༻͢Δσʔληοτ • $*'"3 • $*'"3 • ./*45 •%//ͷ࣮૷͸$BGGFΛ࢖༻ •

    (16ͭͷΈ࢖༻ •ϋΠύʔύϥϝʔλ࠷దԽͷ࣮૷͸ )10-*#Λ࢖༻ •.$.$ͷ࣮૷͸&.$&&Λ࢖༻  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT &YQFSJNFOUBM4FUVQ Ұൠը૾ೝࣝͷσʔληοτ खॻ͖਺ࣈͷσʔληοτ
  16.  •શͯͷ࣮ݧͰ͖͍͠஋ ͸ʹઃఆ •QSFEJDUJWFUFSNJOBUJPODSJUFSJPO͸ɼ ΤϙοΫ͝ͱʹ࣮ߦ •ςετσʔλʹΑΔධՁ͸Ϟσϧ͝ͱʹ ઃఆ • શ݁߹ωοτϫʔΫɿ •

    ৞ΈࠐΈωοτϫʔΫɿ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT &YQFSJNFOUBM4FUVQ k = 10 k = 2
  17.  •$*'"3Ͱ͸લॲཧΛ࣮ߦ • Yͷখ͞ͳը૾ΛϥϯμϜͰऔΓग़͠ɼ ॏ৺ݸͷLNFBOTΛ࣮ߦ • $*'"3ͷ֤ը૾Λ֤ॏ৺Ͱ৞ΈࠐΈɼ ը૾ͷԠ౴ΛฏۉԽ • ͜ͷ݁ՌΛωοτϫʔΫʹೖྗ

    •ϋΠύʔύϥϝʔλͷ୳ࡧճ਺͸ճ •࠷େΤϙοΫ਺͸ΤϙοΫ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT 'VMMZ$POOFDUFE/FUXPSLT
  18.  •֬཰తޯ഑߱Լ๏͸.PNFOUVN4(% Λ࢖༻ •ֶश཰͸࣍ࣜͰεέδϡʔϦϯά • ͱ൒ݮظ͔Β ͕ܾఆ • ൒ݮظΛϋΠύʔύϥϝʔλͱͯ͠࠾༻ •׆ੑԽؔ਺͸3F-6ʢதؒ૚ʣͱ

    4PGUNBYʢग़ྗ૚ʣΛ࢖༻  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT %//)ZQFSQBSBNFUFST ↵t = ↵0 (1 + t) p p
  19.  •֤ύϥϝʔλͷ ఆٛҬͱॳظ஋ •ܾఆ໦ϕʔεͷ ࠷దԽ๏ͳΒ͹ ੍໿͖ͭͷ ࠷దԽ΋Մೳ • Ϣχοτ਺ͳͲ ͸ϨΠϠʔ਺ʹ

    ґଘ͢Δ ύϥϝʔλ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT %//)ZQFSQBSBNFUFST
  20.  •ϋΠύʔύϥϝʔλ࠷దԽث͝ͱʹ ϥϯμϜͳγʔυͰճ࣮ݧ •ճͷςετΤϥʔͷฏۉͱඪ४ภࠩΛ ՄࢹԽ •4."$ɼ51&ͷͲͪΒΛ࢖ͬͯ΋ɼ ఏҊख๏ͳ͠ʹൺ΂ͯ໿ഒͷߴ଎Խ • ఏҊख๏ͳ͠Ͱ࣌ؒޙͷੑೳͱ ఏҊख๏͋ΓͰ࣌ؒޙͷੑೳ͕ಉ͡

    •࠷ऴతͳςετΤϥʔ͸4."$͕࠷খ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT 3FTVMUTGPSQSFQSPDFTTFE$*'"3
  21.  •৞ΈࠐΈ૚ͷ͋ͱʹશ݁߹૚ΛೖΕͳ͍ ϞσϧΛ࢖༻ • ৞ΈࠐΈ૚ͷΧʔωϧαΠζ͸Y •৞ΈࠐΈ૚ͷޙʹ͸ϓʔϦϯά૚Λૠೖ • NBYQPPMJOHΛ࣮ߦ • ϓʔϦϯά૚ͷ૚਺͸࠷దԽͷର৅

    •Ұճͷ܇࿅͸෼Ͱऴྃ͢Δখ͞ͳ Ϟσϧ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT 4NBMM$//)ZQFSQBSBNFUFST
  22.  •4."$ɼ51&ͰͦΕͧΕճ࣮ͣͭݧ •ϋΠύʔύϥϝʔλͷ୳ࡧճ਺͸ճ •࠷େΤϙοΫ਺͸ΤϙοΫ •ςετΤϥʔͷฏۉΛൺֱ͢Δͱɼ 4."$͕51&ΑΓ΋एׯྑ͍݁Ռ • 4."$ɿœ  •

    51&ɿœ ˋ  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT 3FTVMUTGPS4NBMM$//TPO$*'"3
  23.  •$*'"3Ͱͷ݁ՌΛ౿·͑ɼ 4."$ͷΈΛ࢖༻ •࣮ݧճ਺͸ճ •ϋΠύʔύϥϝʔλͷ୳ࡧճ਺͸ճ ·Ͱ •ఏҊख๏ͳ͠ͱൺֱͯ͠ɼ ಉ͡ςετΤϥʔʹୡ͢Δ଎͕͞໿ഒ •ςετσʔλʹର͢Δਪఆਫ਼౓΋޲্ 

    ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT 3FTVMUTGPS4NBMM$//TPO$*'"3
  24.  •ଟ͘ͷϋΠύʔύϥϝʔλͷఆٛҬ͸ 5BCMFʹै͏ •࢖༻͢ΔϞσϧ͸"MM$//ϕʔε • ͨͩ͠ϓʔϦϯά૚͸௥Ճͷ৞ΈࠐΈ૚ʹ มߋ • ௥Ճͷ৞ΈࠐΈ૚ͷετϥΠυ͸ •৞ΈࠐΈ૚ͷΧʔωϧαΠζ͸Yʹ

    มߋ •ग़ྗ૚ͷલʹ΋৞ΈࠐΈ૚  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT -BSHF$//)ZQFSQBSBNFUFST
  25.  •4."$ͷΈΛ࢖༻ •࣮ݧ͸ճ •࠷େΤϙοΫ਺͸ΤϙοΫ •ϋΠύʔύϥϝʔλͷ୳ࡧճ਺͸ճ •σʔλ֦ுͳ͠Ͱൺֱͨ͠ͱ͜Ζ ࠷ઌ୺ͷωοτϫʔΫͱಉ౳Ҏ্ͷੑೳ •ఏҊख๏͋Γˠ(16 5JUBO Ͱ೔ؒ

    ͳ͠ˠ(16Ͱ೔ؒҎ্  ࿦จ঺հɿ4QFFEJOHVQ"VUPNBUJD)ZQFSQBSBNFUFS0QUJNJ[BUJPOPG%FFQ /FVSBM/FUXPSLTCZ&YUSBQPMBUJPOPG-FBSOJOH$VSWFT 3FTVMUTGPS-BSHF$//TPO$*'"3