Share
Embed
不確実性下における目的と手段の統合的探索に向けた連続腕バンディットの応用 / iot70_gp_rff_mab
2025.07.28 第70回インターネットと運用技術研究発表会(IOT70)
https://www.iot.ipsj.or.jp/meeting/70-program/
monochromegane
July 28, 2025
Transcript
45 slides
-
ࡾ༔հ / Pepabo R&D Institute, GMO Pepabo, Inc. 2025.07.28 ୈ70ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձʢIOT70ʣ
ෆ࣮֬ੑԼʹ͓͚Δ తͱखஈͷ౷߹త୳ࡧʹ͚ͨ ࿈ଓόϯσΟοτͷԠ༻ -
• ࣮ӡ༻͞ΕΔใγεςϜͰੜ͡Δ՝ • ࣮ࡍʹɺʮ͜ͷλʔήοτʹ͜ͷखஈͰ͜ͷࢦඪΛվળʯͱతΛݻఆ ্ͨ͠ͰࢪࡦΛࢼ͢ͷ͕Ұൠత • → Ռ͕ग़Δ͔Ͳ͏͔ͬͯΈͳ͍ͱΘ͔Βͳ͍ • ࢼߦʹίετɾϦεΫ͕͏ʢදࣔมߋʹΑΔɺӡ༻ෛՙͳͲʣ
• ͞Βʹɺࢪࡦͷ݁Ռͱͯ͠తͦͷͷ͕ݟ͞ΕΔ͜ͱ͋Δ • ྫɿఆ͍ͯͨ͠ᅂͷϢʔβʔΑΓɺผͷᅂΛ࣋ͭͷํ͕ࢪࡦͷޮՌ͕ߴ͔ͬͨ  5 ݚڀͷഎܠʢ2/2ʣ -
• ࣮ӡ༻͞ΕΔใγεςϜʹର͢Δཁٻ • తʢࢦඪɾλʔήοτʣखஈݻఆͤͣʹ୳ࡧ͍ͨ͠ • ࢼߦ݁ՌΛͱʹɺޮՌͷ͋Γͦ͏ͳ߹ͤΛࣗతʹݟग़͍ͨ͠ • ຊݚڀͷఏڙ͢ΔΈ • తͱखஈΛڞ௨ͷಛۭؒʹຒΊࠐΈ
• ߹ͤʢλʔήοτ × ࢦඪ × खஈʣΛஞ࣍తʹ୳ࡧ͢ΔΈ • → ࣗతAIΤʔδΣϯτͷڥదԠΛࢧ͑Δҙࢥܾఆج൫  6 ݚڀͷత -
• ʮʯͱݺΕΔෳͷީิ͔ΒಘΒΕΔใुΛ࠷େԽ͢Δ • ϓϨΠϠʔҰͷࢼߦͰ1ͭͷΛબ͠ɺใुΛಘΔ • ͦΕͧΕͷ͋Δใुʹै͍ใुΛੜ • ͨͩ͠ɺϓϨΠϠʔ͜ͷใुΛࢼߦͷ݁Ռ͔Βਪଌ͢Δඞཁ͕͋Δ  12
ଟόϯσΟοτ ʜ બ ใु ਪଌ ʮʯεϩοτϚγʔϯͷʮΞʔϜʢArmʣʯʹ༝དྷ IUUQTJDPOTDPN -
• ʮʯͱݺΕΔෳͷީิ͔ΒಘΒΕΔใुΛ࠷େԽ͢Δ • ϓϨΠϠʔҰͷࢼߦͰ1ͭͷΛબ͠ɺใुΛಘΔ • ͦΕͧΕͷ͋Δใुʹै͍ใुΛੜ • ͨͩ͠ɺϓϨΠϠʔ͜ͷใुΛࢼߦͷ݁Ռ͔Βਪଌ͢Δඞཁ͕͋Δ  13
ଟόϯσΟοτ • ϓϨΠϠʔ͋Δ࣌ͷͷධՁʹج͖ͮʮ׆༻ʯͱʮ୳ࡧʯΛฒߦͯ͠ߦ͏ • ͜ͷτϨʔυΦϑΛղফ͢ΔͨΊʹ༷ʑͳํࡦ͕ఏҊ͞Ε͍ͯΔ -
 15 తͱखஈͷ౷߹త୳ࡧ తू߹ खஈू߹ Encoder Encoder ౷߹ۭؒ ༧ଌͷ ༧ଌͷෆ࣮֬ੑ
બ ใु ༧ଌͱෆ࣮֬ੑɺ ػձଛࣦΛ ߟྀͨ͠ީิͷબఆ ʢ࿈ଓόϯσΟοτʣ -
• ΨεաఔʢGaussian Process, GPʣɺσʔλ͔Βɺ͋ΔؔͷΛ֬ աఔͱͯ͠ٻΊΔ • ଟͷجఈؔ  ʹΑΔߴ͍දݱྗ •
Χʔωϧ๏ʹΑͬͯجఈؔͷ໌͕ࣔෆཁ ϕ: ℝD → ℝ  16 ΨεաఔϞσϧͱ࿈ଓόϯσΟοτ k(p, q) ≜ (p 𝖳 q + c)m, m = 2, p, q ∈ ℝ2 ͜ͷଟ߲ࣜΧʔωϧؔͭͷجఈؔʹΑΔมͱੵΛऔͬͨ݁ՌͱҰக -
• ΨεաఔʢGaussian Process, GPʣɺσʔλ͔Βɺ͋ΔؔͷΛ֬ աఔͱͯ͠ٻΊΔ • ଟͷجఈؔ  ʹΑΔߴ͍දݱྗ •
Χʔωϧ๏ʹΑͬͯجఈؔͷ໌͕ࣔෆཁ • ඇઢܗੑͱෆ࣮֬ੑΛѻ͑ΔͨΊଟόϯσΟοτͷੑ͕ߴ͍ • → ΧʔωϧߦྻͱͦͷٯߦྻͷܭࢉΛؚΉͨΊɺ ɹ ֶशσʔλʹରֶͯ͠श͕࣌ؒࢦؔతʹ૿Ճ ϕ: ℝD → ℝ  17 ΨεաఔϞσϧͱ࿈ଓόϯσΟοτ  K−1  K ∈ ℝN×N  K−1 →  k(xi , xj ) -
• ࿈ଓ バ ϯ デ Οοτʹ͓͚ΔThompson Sampling で ɺީิू߹ 
ʹରͯ͠GPͷ༧ଌ͔ΒٻΊͨؔͷ͏ͪɺ࠷େΛ༩͑ Δ  Λ࣍ͷબͱ͢Δ • → ߴ࣍ݩۭؒʹ͓͍ͯɺਫ਼ͷ֬อͷͨΊʹީิू߹  Λଟ͘औΔ ɹ ඞཁ͕͋Γɺܭࢉෛՙ͕૿େ͢Δ {x(1) * , …, x(M) * } ˜ x = arg max x(m) * ˜ f(x(m) * ) M  18 ΨεաఔϞσϧͱ࿈ଓόϯσΟοτ -
• ᶃ ߴ࣍ݩͳಛۭؒʹ͓͚ΔϞσϧͷֶशɾਪίετͷ૿େ • ᶄ ީิू߹ͷߏஙʹґଘ͠ͳ͍ޮతͳ࠷దԽͷࠔ͞ • ᶅ ߴ࣍ݩੑʹΑΔ༧ଌੑೳͷྼԽͱ൚ԽೳྗͷԼ •
ᶆ ϋΠύʔύϥϝʔλਪఆʹ͓͚Δஞ࣍ߋ৽࣌ͷܭࢉෛՙ  19 ຊݚڀͷओͳٕज़՝ -
• ཚԽϑʔϦΤಛʢRandom Fourier Features, RFFʣ[5] ɺ͋Δ֬ ͔Βͷ  ݸͷαϯϓϧΛ༻͍ͯΧʔωϧؔ 
Λ  ͱۙࣅ͢Δख๏ • ͳ͓ɺ  • ֬  ΧʔωϧؔͷछྨʹΑܾͬͯ·Δ p(ω) R′  = R/2 k(xi , xj ) ̂ k(xi , xj ) = z(xi )⊤z(xj ) z(xi ) = 1/R′  (cos(ω⊤ 1 xi ), sin(ω⊤ 1 xi ), …, cos(ω⊤ R′  xi ), sin(ω⊤ R′  xi )) p(ω)  21 ରࡦᶃɿΧʔωϧߦྻͷܭࢉෛՙͷରॲ [5] Miguel L ́azaro-Gredilla, Joaquin Quinonero-Candela, Carl Edward Rasmussen, and An ́ıbal R Figueiras-Vidal. Sparse spectrum gaussian process regression. The Journal of Machine Learning Research, Vol. 11, pp. 1865– 1881, 2010.  K  K ∈ ℝN×N  k(xi , xj )  K  ZZ⊤  ≃  K ∈ ℝN×N  Z ∈ ℝN×R  Z⊤Z  Z⊤Z ∈ ℝR×R  ⋙ k(xi , xj ) ≃ z(xi )⊤z(xj ) ݸผͷΧʔωϧؔʹରͯ͠ܭࢉίετ͕ ૿Ճ͢Δ͕ɺجఈؔͷద༻ͱੵͷࠞ߹ૢ ࡞ͷ݁ՌΛղͨ͠ͱݟΔ͜ͱ͕Ͱ͖Δ → ύϥϝʔλͷ࣍ݩΛ  ࣍ݩʹݻఆͰ͖Δ R ϕ(x) = (ϕ1 (x), …, ϕ∞ (x))⊤ ∈ ℝ∞ ϕ(xi )⊤ϕ(xj ) = k(xi , xj ) ≈ z(xi )⊤z(xj ) -
 22 ରࡦᶃɿΧʔωϧߦྻͷܭࢉෛՙͷରॲ  K′   K′  
K′  … z z z … ⋮ x1 x2 xN x1 x1 xN−1 GP learning GP with RFF learning  K′  −1 Inv  K′  −1 Inv  K′  −1 Inv  Z⊤Z + Λ  Z⊤Z + Λ  Z⊤Z + Λ … z z z … ⋮ x1 x2 xN x1 x1 xN−1  (Z⊤Z + Λ)−1 Inv  (Z⊤Z + Λ)−1 Inv  (Z⊤Z + Λ)−1 Inv  K′  ∈ ℝN×N  Z⊤Z ∈ ℝR×R -
• ީิू߹ͷߏஙΛհ͞ ず ʹؔαϯ プ ϧΛධՁ͢Δख๏ [10] • ରࡦᶃͷ݁ՌɺGPͷؔαϯϓϧ 
ͱͯۙ͠ࣅ͞ΕΔ •  Ͱ͋Γɺύϥϝʔλ  ީิू߹ʹґଘ͠ͳ͍ • ޯ  ͕ղੳతʹܭࢉͰ͖Δ • → ࿈ଓ্ۭؒͰͷ࠷దԽʹΑΓީิू߹Λ ɹΘͣ࣍ͷબΛܾఆՄೳ ɹ ʢ࠷దԽ͋ͨΓͷ  ͷαϯϓϦϯάҰͷΈʣ ˜ f(x) = z(x)⊤ ˜ w ˜ w ∼ 𝒩 (μw , Σw ) μw , Σw ∇x ˜ f(x) ˜ w  23 ରࡦᶄɿީิू߹ߏஙͷճආ [10] Sattar Vakili, Henry Moss, Artem Artemev, Vincent Dutordoir, and Victor Picheny. Scalable thompson sampling using sparse gaussian process models. Advances in neural information processing systems, Vol. 34, pp. 5631– 5643, 2021. -
• εέʔϧ パ ϥϝʔλ  ʹରͯ͠ରਖ਼نΛࣄલͱͯ͠Ծఆ͠ɺ࣍ݩ ͷ૿Ճʹ͏൚ԽੑೳͷԼΛ੍͢Δਖ਼ଇԽख๏ [11] σ2 k
D  24 ରࡦᶅɿ༧ଌੑೳͱ൚Խੑೳͷҡ࣋ [11] Carl Hvarfner, Erik Orm Hellsten, and Luigi Nardi. Vanilla bayesian optimization performs great in high dimensions. arXiv preprint arXiv:2402.02229, 2024.  log p(σ2 k ) = − log σ2 k − 1 2σ2 k0 (log σ2 k − μk0 − 1 2 log D) 2 + DPOTU  ͕աʹେ͖ͳΛऔΔ͜ͱΛ੍ → ϞσϧͷաֶशΛׂ͙ σ2 k  ͕ɺ  ʹۙͮ͘Α͏ଅ͢ޮՌ → ࣍ݩ  ʹԠͨ͡దͳ  ͷબΛ༠ಋ log σ2 k μk0 + 1 2 log D D σ2 k  ͷࣄલͷର σ2 k  ͝ͱͷෛͷରͷ  ͷ࠷খ D log σ2 k -
• ΨεաఔϞσϧͰɺϋΠύʔύϥϝʔλͷਪఆ͕ੑೳʹେ͖͘Өڹ͢Δ • ͜ͷਪఆରͷ࠷దԽͱͯ͠ߦΘΕɺͦͷ܁Γฦ͠ܭࢉʹ͓͍ͯͱ ޯͷߴͳධՁ͕ٻΊΒΕΔ • ಛʹɺஞ࣍తͳߋ৽͕ٻΊΒΕΔόϯσΟοτͷઃఆͰॏཁ • ैདྷख๏Ͱ 
Χʔωϧߦྻͷٯߦྻߦྻࣜͷܭࢉ͕ϘτϧωοΫ • ຊใࠂͰɺͱޯܭࢉRFFϕʔεͰՄೳͱͳΔߏΛಋೖ͠ɺϋΠ ύʔύϥϝʔλͷߴͳ࠷దԽΛ࣮ݱ N × N  25 ରࡦᶆɿϋΠύʔύϥϝʔλਪఆͷߴԽ -
• ؍ଌσʔλ  ʹґଘ͢ΔେنͳΧʔωϧߦྻ  ͷٯߦྻܭࢉߦ ྻࣜܭࢉΛճආ • → 
ʹґଘͨ͠খ͞ͳߦྻͷܭࢉͰΛޮతʹධՁ N K ∈ ℝN×N R  26 ରࡦᶆɿRFFΛ׆༻ͨ͠ରͷಋग़ log ℒ(θ ∣ y) ∝ − log|K| − y⊤K−1y + 2 log p(σ2 k ) = − N log σ2 ε − log|B| − 1 σ2 ε ( ∥y∥2 − 1 σ2 ε ∥Z⊤y∥2 A−1) − 2 log σ2 k − 1 σ2 k0 (log σ2 k − μk0 − 1 2 log D) 2 A = 1 σ2 w I + 1 σ2 ε Z⊤Z B = σ2 w A = I + σ2 w σ2 ε Z⊤Z -
• ֤ϋΠύʔύϥϝʔλ  ʹର͢Δରͷޯ θi ∈ θ = (σ2 k
, σ2 w , σ2 ϵ )  27 ରࡦᶆɿRFFΛ׆༻ͨ͠ޯͷಋग़ ∂ ∂θi log ℒ(θ ∣ y) ∝ − tr ( K−1 ∂K ∂θi ) + y⊤K−1 ∂K ∂θi K−1y + ∂ ∂σ2 k log p(σ2 k )  ʹґଘ K ∈ ℝN×N ʜ -
• ֤ϋΠύʔύϥϝʔλ  ʹର͢Δରͷޯ θi ∈ θ = (σ2 k
, σ2 w , σ2 ϵ )  28 ରࡦᶆɿRFFΛ׆༻ͨ͠ޯͷಋग़ʢ  ʣ σ2 ε ∂ ∂σ2 ε log ℒ(θ ∣ y) = − ( N σ2 ε − σ2 w σ2 ε Tr(B−1Z⊤Z) ) + 1 σ4 ε ( y 2 − 2σ2 w y⊤ZB−1Z⊤y + σ4 w ZB−1Z⊤y 2 ) ∂ ∂θi log ℒ(θ ∣ y) ∝ − tr ( K−1 ∂K ∂θi ) + y⊤K−1 ∂K ∂θi K−1y + ∂ ∂σ2 k log p(σ2 k ) • RFFͷߏΛద༻ͨ͠ϊΠζࢄ  ͷޯ σ2 ε  ʹґଘ K ∈ ℝN×N ʜ ∂K ∂σ2 ε = I • →  ʹґଘͨ͠খ͞ͳߦྻͷܭࢉͰޯΛޮతʹධՁ R -
• ֤ϋΠύʔύϥϝʔλ  ʹର͢Δରͷޯ θi ∈ θ = (σ2 k
, σ2 w , σ2 ϵ )  29 ରࡦᶆɿRFFΛ׆༻ͨ͠ޯͷಋग़ʢ  ʣ σ2 w ∂ ∂θi log ℒ(θ ∣ y) ∝ − tr ( K−1 ∂K ∂θi ) + y⊤K−1 ∂K ∂θi K−1y + ∂ ∂σ2 k log p(σ2 k ) • RFFͷߏΛద༻ͨ͠ॏΈࢄ  ͷޯ σ2 w  ʹґଘ K ∈ ℝN×N ʜ ∂K ∂σ2 w = K • →  ʹґଘͨ͠খ͞ͳߦྻͷܭࢉͰޯΛޮతʹධՁ R ∂ ∂σ2 w log ℒ(θ ∣ y) = − Tr ( 1 σ2 ε Z⊤Z − σ2 w σ2 ε Z⊤Z ⋅ B−1 ⋅ Z⊤Z ) + 1 σ4 ε ((Z⊤y)⊤Z⊤y − 2σ2 w (Z⊤y)⊤Z⊤ZB−1Z⊤y + σ4 w Z⊤ZB−1Z⊤y 2 ) -
• ֤ϋΠύʔύϥϝʔλ  ʹର͢Δରͷޯ θi ∈ θ = (σ2 k
, σ2 w , σ2 ϵ )  30 ରࡦᶆɿRFFΛ׆༻ͨ͠ޯͷಋग़ʢ  ʣ σ2 k ∂ ∂θi log ℒ(θ ∣ y) ∝ − tr ( K−1 ∂K ∂θi ) + y⊤K−1 ∂K ∂θi K−1y + ∂ ∂σ2 k log p(σ2 k )  ʹґଘ σ2 k ʜ k(x, x′  ) ≈ z(x)⊤z(x′  ), z(x) = 2 R cos(Ω⊤x + b) Ω:,r ∼ 𝒩 (0, σ−2 k I) ࠷దԽରͷ  ͷมߋ͝ͱʹ ࠶αϯϓϦϯά͕ඞཁ = ࠷దԽ݁Ռ͕҆ఆ͠ͳ͍ σ2 k -
• ֤ϋΠύʔύϥϝʔλ  ʹର͢Δରͷޯ θi ∈ θ = (σ2 k
, σ2 w , σ2 ϵ )  31 ରࡦᶆɿRFFΛ׆༻ͨ͠ޯͷಋग़ʢ  ʣ σ2 k ∂ ∂θi log ℒ(θ ∣ y) ∝ − tr ( K−1 ∂K ∂θi ) + y⊤K−1 ∂K ∂θi K−1y + ∂ ∂σ2 k log p(σ2 k )  ʹґଘ͠ͳ͍ σ2 k ʜ k(x, x′  ) ≈ z(x)⊤z(x′  ), z(x) = 2 R cos ( 1 σk ˜ Ωx + b ) ˜ Ω ∼ 𝒩 (0, I) ʢ࠶ύϥϝʔλԽʣ -
• ֤ϋΠύʔύϥϝʔλ  ʹର͢Δରͷޯ θi ∈ θ = (σ2 k
, σ2 w , σ2 ϵ )  32 ରࡦᶆɿRFFΛ׆༻ͨ͠ޯͷಋग़ʢ  ʣ σ2 k ∂ ∂θi log ℒ(θ ∣ y) ∝ − tr ( K−1 ∂K ∂θi ) + y⊤K−1 ∂K ∂θi K−1y + ∂ ∂σ2 k log p(σ2 k ) ∂ ∂σ2 k log ℒ(θ ∣ y) = − 2σ2 w 1 σ2 ε Tr ( Z⊤ ∂Z ∂σ2 k ) − σ2 w σ2 ε Tr ( Z⊤Z ⋅ B−1 ⋅ Z⊤ ∂Z ∂σ2 k ) + 2σ2 w (Z⊤α)⊤ ( ∂Z ∂σ2 k ) ⊤ α − 2 σ2 k ( 1 + 1 σ2 k0 (log σ2 k − μk0 − 1 2 log D)) • RFFͷߏΛద༻ͨ͠εέʔϧύϥϝʔλ  ͷޯ σ2 k α = 1 σ2 ε y − σ2 w σ2 ε ZB−1Z⊤y ∂Z ∂σ2 k = 2 R ⋅ sin ( 1 σk X˜ Ω⊤ + b ) ⊙ ( X˜ Ω⊤ 2σ3 k ) • →  ʹґଘͨ͠খ͞ͳߦྻͷܭࢉͰޯΛޮతʹධՁ R ਖ਼ଇԽ߲ ʜ -
• ఏҊख๏ͷ༗ޮੑΛ֬ೝ͢ΔͨΊɺγϛϡϨʔγϣϯ࣮ݧΛ࣮ࢪ • ߴ࣍ݩੑͷӨڹ͕ݱΕΔঢ়گͱͯ͠ɺ32࣍ݩͷ୳ࡧۭؒΛઃఆ • తؔͱͯ͠shifted sphereؔΛ༻ • ֤࣍ݩͷਅͷ࠷దͱͷڑͷೋΛͱΔߏ •
࿈ଓόϯσΟοτͷΈʹ͓͚Δ࠷େใुͷ ୳ࡧΛɺؔ࠷খԽͱͯ͠ѻ͏  34 ධՁతͱઃఆ fr (x) = D ∑ i=1 (xi − ri )2 XIFSF x = (x1 , x2 , …, xD )⊤ ∈ [−3.0,3.0]D, r = (r1 , r2 , …, rD ), ri ∼ 𝒰 (−3.0,3.0) -
• ᶃ ྦྷੵϦάϨοτɿ֤࣌Ͱ͜Ε·ͰબΕͨީิͷ͏ͪ࠷ྑͷͷͱɺਅ ͷ࠷దղͱͷࠩͷྦྷੵ • ᶄ ਪ࣌ؒɿ࣍ީิͷબఆʹཁͨ͠ܭࢉ࣌ؒ • ֤ख๏ʹ͍ͭͯ200ճͷީิબఆΛ࣮ࢪ͠ɺੑೳΛධՁ •
ॳظঢ়ଶͱͯ͠ɺϥϯμϜʹબΕͨ1600ͷ؍ଌσʔλΛࣄલ༩ • ҟͳΔཚγʔυͰ10ճͷγϛϡϨʔγϣϯΛ࣮ࢪɺ݁ՌͦͷฏۉΛ༻  35 ධՁࢦඪ -
 36 ൺֱํࡦ RFF ީิͷ࠷ద Խ ਖ਼ଇԽ ϋΠύʔύϥϝ ʔλߴਪఆ ํࡦ
✓ ✓ ✓ ✓ GP-RFF (Proposal) ✓ ✓ ✓ GP-RFF-No-Prior ✓ ✓ ✓ GP-RFF-Naive-Gradient ✓ GP - - - - TPE - - - - Random • γϛϡϨʔγϣϯʹ༻͍Δํࡦ -
• ࠷ྦྷੵϦάϨοτ͕খ͔ͬͨ͞ͷఏҊख๏ GP-RFFʢྦྷੵɿ4384.9ʣ • → ਅͷ࠷ద 0 ʹର͠ɺ࠷ྑͷؔ 18.3 ·Ͱۙ
• → ఏҊख๏͕ߴ࣍ݩۭؒͰ༗ޮͳީิબఆ͕ՄೳͰ͋Δ͜ͱΛ֬ೝ • ಋೖ֤ͨ͠ཁૉٕज़͕༗ޮʹػೳ  37 ݁ՌᶃɿϦάϨοτൺֱ -
• GP-RFF-Naive-GradientʢߴԽͳ͠ʣGP-RFFͱੑೳʹࠩݟΒΕͣ • → ͓Α び ޯͷཧతಉҰͰ͋ΔͨΊ • GP-RFF-No-Priorʢਖ਼ଇԽͳ͠ʣੑೳ͕Լ •
→ ਖ਼ଇԽʹΑΔ୳ࡧੑೳͷ্͕ࣔࠦ͞Εͨ • ඪ४తͳGPͷੑೳݦஶʹԼ • → ߴ࣍ݩۭؒʹ͓͚Δީิू߹ґଘͷਫ਼ݶք  38 ݁ՌᶃɿϦάϨοτൺֱ -
• ఏҊख๏GP-RFF-No-PriorΑΓྦྷੵϦάϨοτ͕খ͘͞ɺਖ਼ଇԽʹΑΔ୳ ࡧੑೳͷվળ͕֬ೝ͞Εͨ • Χʔωϧͷεέʔϧύϥϝʔλʢ  ʣͷաͳ্ঢ੍͕͞Εͨ • → ࣍ݩʹԠͨ͡దͳൣғʹऩ·Γɺ
ɹ ൚Խੑೳ͕ҡ࣋͞Εͨͱߟ͑ΒΕΔ σ2 k  39 ݁ՌᶄɿϋΠύʔύϥϝʔλਪҠ -
• ͨͩ͠ɺਖ਼ଇԽͷޮՌɺࣄલύϥϝʔλʢ  ʣͷઃఆʹڧ͘ґଘ •  → ࠓճͷ݁Ռ • 
→ ਖ਼ଇԽͷޮՌ͕΄΅ݟΒΕͳ͍ •  → ॳظ୳ࡧ੍͕͞Ε͗ͯ͢ੑೳ͕ѱԽ • → ϋΠύʔύϥϝʔλͷઃఆੑೳʹ ɹ େ͖͘Өڹ͢ΔͨΊɺ৻ॏͳબఆ͕ඞཁ σ2 k0 σ2 k0 = 0.005 σ2 k0 = 1.0 σ2 k0 = 0.001  40 ݁ՌᶄɿϋΠύʔύϥϝʔλਪҠ -
• ఏҊख๏GP-RFF͓ΑͼGP-RFF-No-Priorɺൺֱత͍બఆ࣌ؒΛҡ࣋ • → ਖ਼ଇԽͷ༗ແબఆ࣌ؒʹେ͖ͳӨڹΛ༩͑ͳ͍ • → બఆ࣌ؒࢼߦճͷ૿Ճʹରͯ͠΄΅ҰఆͰ͋Γɺ؍ଌσʔλͷ૿ Ճʹ҆ఆͯ͠ରԠͰ͖Δ͜ͱΛ֬ೝ •
ҰํɺGP͓ΑͼGP-RFF-Naive-Gradient ؍ଌσʔλʹൺྫͯ͠ܭࢉෛՙ͕૿େ  42 ݁Ռᶅɿਪ࣌ؒൺֱ -
• తͱखஈͷ߹ۭͤؒΛ࿈ଓόϯσΟοτͱͯ͠ఆࣜԽ͠ɺ౷߹తʹ ୳ࡧ͢ΔΈΛఏҊ • ཚԽϑʔϦΤಛʢRFFʣΛಋೖͨ͠ΨεաఔϞσϧʹΑΓɺඇઢܗੑͱ ෆ࣮֬ੑΛཱ྆ͭͭ͠ߴޮͳҙࢤܾఆΛ࣮ݱ • ϋΠύʔύϥϝʔλਪఆʹRFFΛ׆༻͠ɺͱޯͷߴͳධՁʹΑͬͯ ஞ࣍࠷దԽΛޮԽ •
ࠓޙɺߴ࣍ݩ͔ͭෳࡶͳతɾखஈۭؒͷεέʔϥϏϦςΟରԠΛݕ౼ • ࣮σʔλΛ༻͍ͨݕূʹΑΓɺఏҊख๏ͷ࣮༻ੑΛධՁ͍ͯ͘͠  44 ͓ΘΓʹ