Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
BERTでのテキスト分類
Search
kassy11
April 17, 2024
0
7
BERTでのテキスト分類
kassy11
April 17, 2024
Tweet
Share
More Decks by kassy11
See All by kassy11
Git入門
kassy11
0
10
『IT Text自然言語処理』第1章
kassy11
0
14
過学習と未学習について
kassy11
0
8
LLMアプリケーション開発 ~シンとくぽんTalkと論文要約くんの開発について~
kassy11
0
36
Featured
See All Featured
Building Better People: How to give real-time feedback that sticks.
wjessup
363
19k
Ruby is Unlike a Banana
tanoku
96
11k
Building Applications with DynamoDB
mza
90
6k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
46
2.1k
Adopting Sorbet at Scale
ufuk
73
9k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
27
4.1k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
31
2.6k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
41
9.2k
We Have a Design System, Now What?
morganepeng
50
7.2k
The World Runs on Bad Software
bkeepers
PRO
65
11k
Building Your Own Lightsaber
phodgson
102
6k
Transcript
.ദݪޭଠ #&35ͰͷςΩετྨ
࣍ ਂֶशʹΑΔࣗવݴޠॲཧͷجૅ τʔΫφΠζ ೖྗ·Ͱ &NCFEEJOH
5SBOTGPSNFSͱ "UUFOUJPOͱ 5SBOTGPSNFSΛͬͨϞσϧ #&35ͱ #&35ͷੜϞσϧ ԋश
ਂֶशʹΑΔࣗવݴޠॲཧͷجૅ • ैདྷͷࣗવݴޠॲཧͷྲྀΕɺ ܗଶૉղੳղੳˠߏจղੳˠҙຯղੳˠจ຺ղੳ • ਂֶशΛ༻͍ͨࣗવݴޠॲཧͷྲྀΕɺ τʔΫφΠζʢܗଶૉղੳͳͲʣ*%ԽˠਂֶशϞσϧʢ#&35ͳͲʣ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF IUUQTBJMBCMBQSBTDPNEFFQMFBSOJOHEFQFOEFODZQBSTJOH
τʔΫφΠζ • จষΛτʔΫϯͱݺΕΔ୯Ґʹׂ͢Δ͜ͱ • τʔΫϯͱͯ͠ɺ୯ޠɾจࣈɾαϒϫʔυ͕͋Γɺαϒϫʔυ͕ओྲྀ • τʔΫϯͱͯ͠୯ޠΛͬͨ߹ΛܗଶૉղੳͱݺͿ
τʔΫφΠζ͔ΒਂֶशϞσϧͷೖྗ·ͰͷྲྀΕ ೖྗςΩετΛτʔΫφΠζ͢Δ ֶशσʔλʹؚ·ΕΔτʔΫϯͷࣙॻʢτʔΫϯͱ*%ͷରԠදʣΛͭ͘Δ w ࣄલֶशࡁΈϞσϧͩͱطʹ͋Δ
ೖྗςΩετΛ*%ྻʹม͢Δ ෳςΩετΛೖྗ͢Δͱ͖͞Λଗ͑ΔʢQBEEJOHʣ w Ұ൪͍ͷʹ߹ΘͤΔPS͞ΛઌʹܾΊΔ IUUQTZPVUVCFL8;:B5O#ZD
&NCFEEJOH • ςΩετΛ*%ྻʹมͨ͠ͷΛϞσϧʹೖྗ͢Δͱɺʹ͋Δ&NCFEEJOHͰτʔΫϯ ͷϕΫτϧʹม͞ΕΔ • 8PSE7FDͷ୯ޠϕΫτϧͷΑ͏ͳͷ • ม༻ͷߦྻΛϧοΫΞοϓςʔϒϧͱݺͿ •
5SBOTGPSNFS#&35ͳͲͰɺࣄલֶशͰ&NCFEEJOHֶश͢Δ • ੲ୯ޠຒΊࠐΈͱݴޠϞσϧผʑʹֶश͍͕ͯͨ͠ɺࠓͰಉ࣌ʹʢ&OEUP&OEͰʣֶ श͢Δ͜ͱ͕ओྲྀ IUUQTZPVUVCFL8;:B5O#ZD
5SBOTGPSNFSͱ • 3//$//Λ༻͍ͣʹɺ"UUFOUJPOʢҙػߏʣͷΈͰߏ͞Εͨ&ODPEFS %FDPEFSܕͷϞσϧ • ݴޠσʔλΛ3//Ͱॲཧ͠Α͏ͱ͢Δͱɺஞ࣍ॲཧʢલͷग़ྗΛೖྗʹ͏ʣ͠ ͔Ͱ͖ͳ͍ͷͰ͕͔͔࣌ؒͬͨ • "UUFOUJPOͷΈʹ͢Δ͜ͱͰ
• ฒྻॲཧՄೳʢશ෦Ұؾʹೖྗʣ • ԕ͘ͷใΛऔΓೖΕͯɺ ΑΓྑ͍ϕΫτϧ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
"UUFOUJPOͱ • 5SBOTGPSNFSͰ༻͍ΒΕΔ"UUFOUJPOೋछྨ͋Δ • $SPTT"UUFOUJPOɿ&ODPEFSଆͷେࣄͳใʹΑΓͯ͠ɺ%FDPEFSଆ͔Β ग़ྗ • ผ໊4PVSDF5BSHFU"UUFOUJPO &ODPEFS%FDPEFS"UUFOUJPO
• 4FMG"UUFOUJPOɿࣗͷܥྻʹ͍ͭͯपΓΛݟͯɺΑΓྑ͍ϕΫτϧʹ͢Δ IUUQTTQFBLFSEFDLDPNTFJWJTJPOBOEMBOHVBHFUPGFOZFXPRVSJKVBOLVTIFODFOHYVFYJTIPVGBGBMTFTIBPKJF IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
5SBOTGPSNFSΛͬͨϞσϧ • 5SBOTGPSNFSͷ&ODPEFS%FDPEFSͷͲ͜Λ͏ʹΑͬͯϞσϧ༷ʑɺڧΈ ҟͳΔ • &ODPEFSͷΈΛ͏ʢ#&35ͳͲʣɿࣗવݴޠཧղʢྨ/&3ͳͲʣʹڧ͍ • %FDPEFSͷΈΛ͏ʢ(15ͳͲʣɿࣗવݴޠੜʢରͳͲʣʹڧ͍ •
&ODPEFS%FDPEFS྆ํΛ͏ʢ5#"35ͳͲʣɿܥྻͷม ʢػց༁ཁͳͲʣʹڧ͍ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
#&35ͱ • #JEJSFDUJPOBM&ODPEFS3FQSFTFOUBUJPOGSPN5SBOTGPSNFSTͷུ • 5SBOTGPSNFSͷ&ODPEFSͷΈͰֶशͨ͠Ϟσϧ • ͭͷํ๏Ͱࣄલֶश • .BTLFE-BOHVBHF.PEFMɿೖྗΛҰ෦ϚεΫͯ͠༧ଌ
• /FYU4FOUFODF1SFEJDUJPOɿจೖྗͯͦ͠ΕΒྡจ͔൱͔ • ˢͷํ๏ͷ͓͔͛Ͱࣗવݴޠཧղʹڧ͍ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
#&35ͷੜϞσϧ • #&35ʹ༷ʑͳΛΓࠐΜͩΓɺੑೳҡ࣋ͯ͠ϞσϧαΠζͷখܕԽͳͲͷੜϞσϧ͕ଘࡏ͢Δ • ֶशํ๏Λ • 3P#&35B • %F#&35B
• &-&$53" • 9-/FU • খܕԽ • "-#&35 • %JTUJM#&35 • ϚϧνϞʔμϧ • 7-#&35 IUUQTHJUIVCDPNUIVOMQ1-.QBQFST
༨ஊɿैདྷͷྲྀΕͱͷରԠ • ैདྷͷྲྀΕͱτʔΫφΠζʢܗଶૉղੳͳͲʣڞ௨ • ߏจղੳҎ߱ͷྲྀΕਂֶशϞσϧͷதͰ҉తʹߦΘΕ͍ͯΔʁ • "UUFOUJPOߏจղੳɾΓड͚ղੳΛߦ͍ͬͯΔΑ͏ʹݟΕΔ͠ɺ τʔΫϯͷϕΫτϧԽҙຯղੳΛߦ͍ͬͯΔΑ͏ʹݟΕΔ͠ɺ ෳจΛಛघτʔΫϯΛͬͯϞσϧʹೖྗ͢Δ͜ͱͰจ຺ղੳΛߦ͍ͬͯΔΑ
͏ʹݟΕΔʁ • ҉తʹߏจղੳҎ߱ͷྲྀΕ͕ߦΘΕΔ͕ɺ໌ࣔతʹߦ͍͍ͨͱ͖ͷΈTQB$Z ʢ(J/;"ʣͳͲͷπʔϧΛ͏
ࢀߟจݙ • ࣗવݴޠॲཧͱ7JTJPOBOE-BOHVBHF • ຒΊࠐΈ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̎ճʮܥྻσʔλΛ
ѻ͏ͨΊͷલॲཧʯ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̍̍ճʮ#&35 5ʯ • 5IF*MMVTUSBUFE5SBOTGPSNFS • #&358JLJQFEJB