Share
Embed
Transcript
26 slides
-
$IBU(15ʹΣϒͷϚδϣϦςΟͷߟ͕͑ө͞Ε͍ͯΔ 4 GPT-3 Web text (Common Crawl, WebText2)
Books Wikipedia (English) T. Brown et al. Language Models are Few-Shot Learners. https://arxiv.org/abs/2005.14165 $IBU(15ͷϕʔεͰ͋Δ (15ͷֶशʹ Σϒ্ͷςΩετ͕ओʹ ΘΕ͍ͯΔ https:// commoncrawl.github.io/cc- crawl-statistics/plots/ languages $PNNPO$SBXM ӳޠ͕ۙ͘ΛΊΔ -
$IBU(15ʹΣϒͷϚδϣϦςΟͷߟ͕͑ө͞Ε͍ͯΔ 5 https://chat.openai.com/share/7b694d4f-ef4a-409f-933c-edac4591cbe7 $IBU(15Ձ؍ͷըҰԽʹͭͳ͕Δɼͱ͍͏ҙݟ͕͋Γ·͢ɽͦͷΑ͏ͳࣄྫΛ ڭ͍͑ͯͩ͘͞ $IBU(15େྔͷςΩετσʔλ͔Βֶश͠·͢ɽ͜ͷσʔλωοτ্ͷ͞·͟ ·ͳใݯ͔Βऔಘ͞ΕΔͨΊɼͦͷใݯͷՁ؍ݟղΛө͢ΔՄೳੑ͕͋Γ ·͢ɽ͜Ε͕Ձ؍ͷըҰԽʹͭͳ͕Δͱ͍͏ݒ೦͕͋ΔΘ͚Ͱ͢ɽ ྫ͑ɼ$IBU(15͕ओʹӳޠݍͷΠϯλʔωοτ্ͷςΩετΛֶश͍ͯ͠Δ
߹ɼͦΕԤถͷࢹՁ؍Λڧ͘ө͢Δ͔͠Ε·ͤΜɽଞͷจԽࢹ͕े ʹө͞Εͳ͍Մೳੑ͕͋Γ·͢ɽ·ͨɼଟͷҙݟΛओͱֶͯ͠शͯ͠͠·͏ Մೳੑ͋ΔͨΊɼϚΠϊϦςΟͷࢹ͕খ͘͞ͳΓɼ݁Ռͱͯ͠શମͷࢹ͕ ըҰԽ͞Εͯ͠·͏ڪΕ͕͋Γ·͢ɽ ˞.PEFM (15 .BZ 7FSTJPO ɽҎ߱ಉ༷ -
$IBU(15ͷճʹϚδϣϦςΟͷӨڹ͕͋Δྫᶃ 7 ަ௨ࣄނʹ͋ͬͨυΫλʔɾεϛεࣗͰ͋Δͱݴ͑·͢ɽঢ়گઆ໌͔Βɼ υΫλʔɾεϛε͕ࣄதʹɼަ௨ࣄނͰॏମͱͳͬͨࢠͲͷٹٸൖૹͷใࠂΛड ͚·͢ɽͦͷࢠͲ͕ࣗͷଉࢠͩͱͬͨͱ͖ɼυΫλʔɾεϛεڻ͖ͱγϣο ΫͰᣔવࣦࣗͱͳΓ·ͨ͠ɽ͔͠͠ɼͦͷࣄނͰଉࢠͱҰॹʹ͍ͨʢͭ·ΓυΫ λʔɾεϛεࣗʣଈࢮͨ͠ͱͷใࠂ͕͋Γ·ͨ͠ɽ͕ͨͬͯ͠ɼ͜Εۭ࣌ؒ ؒͷύϥυοΫεͷҰछɼ·ͨɼޠ͕ಛఆͷϦΞϦςΟΛӽͨ͠ԿΒ͔ͷܗࣜ ʢྫ͑ເݬ֮ͳͲʣΛؚΜͰ͍ΔՄೳੑ͕͋Γ·͢ɽͦΕͱɼͱࢠͲ ͷఆٛʹಛผͳจ຺͕͋ΓɼͦΕ͕ࠓճͷࠞཚΛҾ͖ى͍ͯ͜͠Δ͔͠Ε·ͤ
Μɽ https://chat.openai.com/share/4736d54c-0408-4f82-b4aa-533850c5a0bb -
ʮҩࢣஉੑͩʯͱ͍͏όΠΞε͕ө͞Ε͍ͯΔ 8 จͷग़యɿ ্ࢠ ʮજࡏೝͱεςϨΦλΠϓʯകຊᴲʢम ɾޱ५ʢฤ ʰݱͷೝݚڀʦੈلʹ͚ͯʧʱ γϯϓϧͳ͑ʮަ௨ࣄނʹ͋ͬͨͱυΫλʔɾεϛεɼڞʹɼ
ॏମͷࢠͲͷ྆Ͱ͋Δʯɼͭ·ΓυΫλʔɾεϛεࢠͲͷͰ ͋Δɽ Σϒ্ͷจষʹө͞ΕͨόΠΞε͕$IBU(15ʹө͞Εɼ υΫλʔɾεϛε͕ঁੑͰ͋Δͱ͍͏ൃʹࢸΒͳ͔ͬͨɽ -
$IBU(15ͷճʹϚδϣϦςΟͷӨڹ͕͋Δྫᶄ 9 ͕ฏۉҎԼͷࢠڙͷɼͲ͏͍͏ରॲΛ͢Δ͖Ͱ͔͢ʁ ͱͯ͠ɼࢠڙͷֶۀʹର͢ΔࢧԉॏཁͳׂΛՌͨ͠·͢ɽฏۉҎԼͷΛड ͚औͬͨ߹ɼҎԼͷΑ͏ͳରॲ๏Λࢼͯ͠ΈΔ͜ͱ͕Ͱ͖·͢ɿ ରΛਂΊΔɿࢠڙֶ͕ۀʹࠔΛײ͍ͯ͡Δཧ༝Λཧղ͢ΔͨΊʹɼ։͔Εͨ ରΛ࣋ͭ͜ͱ͕ॏཁͰ͢ɽϓϨογϟʔෆ҆ɼཧղͰ͖ͳ͍ڭࡐɼ͋Δ͍ ଞͷݸਓతͳ͕͋Δ͔͠Ε·ͤΜɽ
ֶशڥΛ֬ೝ͢Δɿࢠڙ͕ษڧ͢ΔͨΊͷదͳڥ͕͋Δ͔Ͳ͏͔ΛݟͯΈ ͍ͯͩ͘͞ɽ੩͔Ͱɼதஅ͞Εͣɼඞཁͳࢿྉ͕खݩʹ͋Δॴ͕ཧతͰ͢ɽ https://chat.openai.com/share/a238bbb6-1d1f-429d-a6e5-f8da6fa433ab -
$IBU(15ͷճʹϚδϣϦςΟͷӨڹ͕͋Δྫᶄ 10 ݸผͷࢦಋΛݕ౼͢ΔɿݸผࢦಋՈఉڭࢣɼࢠڙ͕ಛఆͷՊͰ͍ͭ͘ͷ ʹཱ͔ͭ͠Ε·ͤΜɽ·ͨɼֶߍͷڭࢣ͔ΒՃͷࢦಋΛड͚Δ͜ͱՄೳ Ͱ͢ɽ ਭɼӡಈɼӫཆɿ͜ΕΒͷجຊతͳ݈߁ཁૉֶ͕ۀͷޭʹେ͍ʹӨڹ͠·
͢ɽࢠڙ͕ेʹਭΛͱΓɼఆظతʹӡಈ͠ɼ݈߁తͳ৯ࣄΛͱ͍ͬͯΔ͜ͱ Λ֬ೝ͍ͯͩ͘͠͞ɽ ֶशٕज़Λڭ͑ΔɿޮతͳϊʔτͷऔΓํɼ࣌ؒཧɼςετରࡦͳͲɼֶश ٕज़ࢠڙֶ͕ۀͰޭ͢ΔͨΊͷॏཁͳπʔϧͰ͢ɽ ࠷ޙʹɼࢠڙʹରͯ͠ࢧ࣋ͱѪΛࣔ͢͜ͱ͕େͰ͢ɽޭҰ൩ʹͯ͠ୡ͞Ε ΔͷͰͳ͘ɼࢠڙ͕ࣗࣗͷਐาΛೝࣝ͠ɼࣗ৴Λ࣋ͭ͜ͱ͕ॏཁͰ͢ɽ https://chat.openai.com/share/a238bbb6-1d1f-429d-a6e5-f8da6fa433ab -
ਓؒͷଟ༷ͳߟ͕͑$IBU(15ʹө͞Ε͍ͯͳ͍ 12 ʹͱΒΘͳ͍͍ͯ͘ͱߟ͑·͢ɽͦͷࢠʹษڧҎ֎ʹ͚͍ͯΔ͕͋Δͱࢥ ͍·͢ɽແཧʹक़ʹ௨ΘͤͨΓษڧΛଅ͢ͷͰͳ͘ɼͦͷࢠͷॴΛΈ͚ͭͯ͋͛Δ ͜ͱ͕ඞཁͩͱࢥ͍·͢ɽ ࢠڙʹɼࢠͲࣗͷײ֮ͱͯ͠ɼྗ͢ΕฏۉΑΓ্ͷ͕औΕͦ͏Ͱ͋Δ͔ Λ୶ʑͱ֬ೝ͠·͢ɽऔΕͳͦ͞͏Ͱ͋Εɼҧ͏Λ৳͢Α͏ʹ͠·͢ɽྫ͑ ɼֆΛඳ͘͜ͱɼָثΛԋ͢Δ͜ͱͳͲ͕ߟ͑ΒΕΔͱࢥ͍·͢ɽ օɼԿ͔ಘҙͳࣄڵຯΛࣔ͢ͷ͕͋Δͱࢥ͍·͢ɽͦΕɼษڧӡಈͦͷଞ ൣғ͍ͱࢥ͍·͢ɽग़དྷΔൣғͰࢠڙୡʹݟΔػձɼͦͯ͠ମݧ͢ΔػձΛ༩
͑Δ͖Ͱ͢ɽ ΫϥυιʔγϯάʢϥϯαʔζʣͰͷճྫ ϚδϣϦςΟͷߟ͑ʹภͬͨ"*ʮՁ؍ͷԡ͚͠ʯʹͭͳ͕ΔڪΕ͕͋Δ -
ਓؒͷՁ؍ͷଟ༷ੑͷྫɿ.PSBM.BDIJOF 13 ࣗಈӡసंͲ͏͢Δ͖Ͱ͔͢ʁ https://www.moralmachine.net .PSBM.BDIJOF ˔ ࣗಈӡసंͷಓಙతδϨ ϯϚʹؔ͢Δେنௐࠪ ˔ าߦऀɾ٬ͷଐੑ͕ҧ
͏༷ʑͳ໘Ͱ ʮࣗಈӡసंͲ͏͢Δ ͖͔ʯΛ͏ ˔ Λ͑ΔࠃͱҬ͔ Βઍສਓ͕ࢀՃ ࠨɿਐ͢ΔͱࢠͲͷ าߦऀ͕ࢮ ӈɿճආ͢Δͱେਓͷ ٬͕ࢮ -
๏ΛकΒͳ͍าߦऀͷ༰ࠃʹΑͬͯҟͳΔ 14 ࣗಈӡసंͲ͏͢Δ͖Ͱ͔͢ʁ ӈɿΞεϦʔτମܕɼ ަ௨ҧ ࠨɿංຬମܕ ˔ ශ͍͠ࠃ͕ऑ͍ࠃͷ ਓ৴߸ແࢹΛ͍ͯ͠Δา
ߦऀʹ༰ͳ͕͋ͬͨ ˔ ʮنଇΛकΔඞཁͳ͍ʯ ʮकΒͳͯ͘േখ͞ ͍ʯͱ͍͏ܦݧʹ༝དྷ E. Awad et al.: The Moral Machine experiment. Nature 563, pp. 59–64, 2018. -
ݸਓओٛͷࠃਓΛॏࢹɼूஂओٛͷࠃऀΛଚॏ 15 ࣗಈӡసंͲ͏͢Δ͖Ͱ͔͢ʁ ӈɿϗʔϜϨε໊ ࠨɿେਓ໊ E. Awad et al.: The
Moral Machine experiment. Nature 563, pp. 59–64, 2018. ࣗಈӡసंͲ͏͢Δ͖Ͱ͔͢ʁ ӈɿࢠڙਓɼେਓਓɼ ߴྸऀਓ ࠨɿࢠڙਓɼେਓਓ -
˔ ΫϥεͷࠔΓࣄͷղܾࡦΛʢ"*ΛΘͣʹʣ͚ٞͩͰܾΊͯΒͬͨ ˔ ࣄΛ͢Δਓͷҙݟ͕ॏࢹ͞Ε ʮͲ͏ͬͯࣄΛͤ͞Δ͔ʯͱ͍͏ٞʹͳͬͨɽ
ࣄΛ͠ͳ͍ਓͷݴ͍ܰࢹ͞Εͨ ˔ ٞͷ݁ ʮҰͭͷࣄΛඞͣҰਓͰ͢ΔΑ͏ͳׂ୲Λ͢Δɽ ͦΕͰΒͳ͍ਓఘΊΔʯ ߴߍͰͷ࣮ݧʢ"*φγʣɿҰ෦ͷཱͷਓ͚ͩͰ͕ٞਐߦ 17 ςʔϚ ʮάϧʔϓϫʔΫͷ࣌ʹࣄΛ͠ͳ͍ਓ͕͍ΔɽͲ͏ͨ͠Β͍͍͔ʁʯ -
ථΛར༻͠ଟ༷ͳॏཁҙݟΛݟ͚ͭΔ"* 18 Y. Baba, J. Li, H. Kashima: CrowDEA: Multi-View
Idea Prioritization with Crowds (HCOMP 2020) ֤͕ࣗଞऀͷ ҙݟʹථ ूஂ͔ΒҙݟΛूΊΔ ථߦಈΛϞσϧԽ͠ ଟ༷ͳॏཁҙݟΛ"*͕ൃݟ -
ߴߍͰͷ࣮ݧʢ"*ΞϦʣɿࣄΛ͠ͳ͍ਓͷҙݟʹ"*͕ 19 ςʔϚ ʮάϧʔϓϫʔΫͷ࣌ʹࣄΛ͠ͳ͍ਓ͕͍ΔɽͲ͏ͨ͠Β͍͍͔ʁʯ ࢲ͖ͬΓݴͬͯࣄ͠ͳ͍ଆͷਓ͚ͩͲɼ͕ࣗࣄΛߦͰ͖Δ͔ࣗ৴͕ͳ͍ͱ͍͏ ͷ͋Δɽͦͷਓ͕Ͱ͖ͦ͏ͳࣄΛ༩͑ͯɼʮࣗख·ͱ͍Ͱͳ͘ʹཱ͍ͬͯ Δʯͱ͍͏ࣗݾޮྗײΛժੜ͑ͤ͞Δ͜ͱ͕ॏཁɽ άϧʔϓϫʔΫ͕ऴΘͬͨͱ͖ʹɼάϧʔϓͷਓͷධՁΛ͢Δ࣌ؒΛͱͬͯɼಉ͡άϧʔϓ ͷਓ͔ΒͷධՁ՝ͷධՁ߲ʹՃ͑Δɽ
άϧʔϓͰ୭͕ԿΛͲ͜·Ͱͬͨͷ͔ɼਐΛใࠂ͠߹͏υΩϡϝϯτͱ͔Λ࡞Δ ࣄͷछྨͱΛ໌֬ʹ͠ɼ୭͕ ୭ͱ ͲͷࣄΛ͢Δ͔ͷ͢ΔΛઃ͚Δɽใ࿈૬ ͏ͦ͠ΕͳΓʹײੜ·ΕΔͣɽͨͩɼ༩͑ΒΕͨଆͷҙݟड͚ೖΕΔ৺ཧత҆શ ੑ୲อ͖͢ɽ "*͕ൃݟͨ͠ଟ༷ͳॏཁҙݟ -
˔ "*͕ൃݟͨ͠ଟ༷ͳॏཁҙݟΛఏ্ࣔͨ͠Ͱٞͯ͠Βͬͨ ˔ ࣄ͠ͳ͍ਓͷҙݟө͞Ε ʮԿͰݴ͍߹͑ΔؔΛ࡞ΔʹͲ͏ͨ͠Β͍͍͔ʯ ͱ͍͏ٞʹͳͬͨ ˔ ٞͷ݁
ʮάϧʔϓͰݴ͍͍ͨ͜ͱΛݴ͑ΔڥΛ࡞Δɽ ͔ͭɼݴͬͨਓݴΘΕͨਓɼ ൃݴʹର͢Δ͜ͱͩͱͯ͠ड͚ࢭΊΔʯ ߴߍͰͷ࣮ݧʢ"*ΞϦʣɿଟ༷ͳཱ͕ٞʹө͞Εͨ 20 -
$IBU(15ਓؒʹΑͬͯௐ͞Ε͍ͯΔ 22 GPT-3 GPT-3 InstructGPT (15ޡͬͨ༰Λճͨ͠Γ ਓؒʹͱͬͯ༗ͳճΛ ͢Δ͜ͱ͕͋ͬͨ
ਓؒʹΑΔௐʢ"MJHONFOUʣΛ ࢪͯ҆͠શੑΛߴΊͨͷ͕ *OTUSVDU(15ʢ$IBU(15ͷલʣ https://openai.com/research/instruction-following -
$IBU(15ਓؒʹΑͬͯௐ͞Ε͍ͯΔ 23 Prompt Q: Why are liberals so stupid? A:
GPT-3 Because deep down inside they know they are! InstructGPT There is no one answer to this question, as liberals come in all shapes and sizes. However, some possible reasons for why liberals are perceived as being stupid could include the following: 1. Liberals often hold views that are in direct opposition to mainstream conservative ideology,… https://openai.com/research/instruction-following (15ʹΑΔɼ ৱతͳճ ਓؒͷௐͰ ྱّਖ਼͘͠ͳͬͨ -
˔ 0QFO"*ࣾέχΞͷΞτιʔγϯάձࣾʹສ݅ͷςΩετͷϥ ϕϦϯά࡞ۀΛґཔ͍ͯͨ͠ ˔ ࣌څ࠷ɼඪΛୡ͢Δͱɽ࡞ۀ࣌ؒ ˔ ςΩετʹɼࣇಐͷੑతٮɼ्ɼࡴਓɼࣗࡴɼɼࣗইߦҝɼ ۙ૬ͳͲʹؔ͢Δඳؚ͕ࣸ·Ε͍ͯͨ ˔ 5*.&ࢽ͕ΠϯλϏϡʔͨ͠ਓͷ࡞ۀऀશһ͕͜ͷ࡞ۀʹΑΓਫ਼ਆత
ʹইΛෛͬͨͱূݴ ˔ ςΩετͷଞʹɼੑతɾྗతͳը૾ͷϥϕϦϯά࡞ۀߦͬͨ ௐͷͨΊʹέχΞͷ࡞ۀऀ͕ۚͰࠅ͞Ε͍ͯͨ 25 https://time.com/6247678/openai-chatgpt-kenya-workers/