Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
BERTでのテキスト分類
Search
kassy11
April 17, 2024
0
4
BERTでのテキスト分類
kassy11
April 17, 2024
Tweet
Share
More Decks by kassy11
See All by kassy11
Git入門
kassy11
0
5
『IT Text自然言語処理』第1章
kassy11
0
6
過学習と未学習について
kassy11
0
5
LLMアプリケーション開発 ~シンとくぽんTalkと論文要約くんの開発について~
kassy11
0
18
Featured
See All Featured
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
21
2k
StorybookのUI Testing Handbookを読んだ
zakiyama
13
4.7k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
242
1.2M
Infographics Made Easy
chrislema
238
18k
Raft: Consensus for Rubyists
vanstee
133
6.3k
Six Lessons from altMBA
skipperchong
22
3k
Building a Scalable Design System with Sketch
lauravandoore
457
32k
GitHub's CSS Performance
jonrohan
1025
450k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
34
6.1k
10 Git Anti Patterns You Should be Aware of
lemiorhan
649
58k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
67
14k
A Tale of Four Properties
chriscoyier
153
22k
Transcript
.ദݪޭଠ #&35ͰͷςΩετྨ
࣍ ਂֶशʹΑΔࣗવݴޠॲཧͷجૅ τʔΫφΠζ ೖྗ·Ͱ &NCFEEJOH
5SBOTGPSNFSͱ "UUFOUJPOͱ 5SBOTGPSNFSΛͬͨϞσϧ #&35ͱ #&35ͷੜϞσϧ ԋश
ਂֶशʹΑΔࣗવݴޠॲཧͷجૅ • ैདྷͷࣗવݴޠॲཧͷྲྀΕɺ ܗଶૉղੳղੳˠߏจղੳˠҙຯղੳˠจ຺ղੳ • ਂֶशΛ༻͍ͨࣗવݴޠॲཧͷྲྀΕɺ τʔΫφΠζʢܗଶૉղੳͳͲʣ*%ԽˠਂֶशϞσϧʢ#&35ͳͲʣ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF IUUQTBJMBCMBQSBTDPNEFFQMFBSOJOHEFQFOEFODZQBSTJOH
τʔΫφΠζ • จষΛτʔΫϯͱݺΕΔ୯Ґʹׂ͢Δ͜ͱ • τʔΫϯͱͯ͠ɺ୯ޠɾจࣈɾαϒϫʔυ͕͋Γɺαϒϫʔυ͕ओྲྀ • τʔΫϯͱͯ͠୯ޠΛͬͨ߹ΛܗଶૉղੳͱݺͿ
τʔΫφΠζ͔ΒਂֶशϞσϧͷೖྗ·ͰͷྲྀΕ ೖྗςΩετΛτʔΫφΠζ͢Δ ֶशσʔλʹؚ·ΕΔτʔΫϯͷࣙॻʢτʔΫϯͱ*%ͷରԠදʣΛͭ͘Δ w ࣄલֶशࡁΈϞσϧͩͱطʹ͋Δ
ೖྗςΩετΛ*%ྻʹม͢Δ ෳςΩετΛೖྗ͢Δͱ͖͞Λଗ͑ΔʢQBEEJOHʣ w Ұ൪͍ͷʹ߹ΘͤΔPS͞ΛઌʹܾΊΔ IUUQTZPVUVCFL8;:B5O#ZD
&NCFEEJOH • ςΩετΛ*%ྻʹมͨ͠ͷΛϞσϧʹೖྗ͢Δͱɺʹ͋Δ&NCFEEJOHͰτʔΫϯ ͷϕΫτϧʹม͞ΕΔ • 8PSE7FDͷ୯ޠϕΫτϧͷΑ͏ͳͷ • ม༻ͷߦྻΛϧοΫΞοϓςʔϒϧͱݺͿ •
5SBOTGPSNFS#&35ͳͲͰɺࣄલֶशͰ&NCFEEJOHֶश͢Δ • ੲ୯ޠຒΊࠐΈͱݴޠϞσϧผʑʹֶश͍͕ͯͨ͠ɺࠓͰಉ࣌ʹʢ&OEUP&OEͰʣֶ श͢Δ͜ͱ͕ओྲྀ IUUQTZPVUVCFL8;:B5O#ZD
5SBOTGPSNFSͱ • 3//$//Λ༻͍ͣʹɺ"UUFOUJPOʢҙػߏʣͷΈͰߏ͞Εͨ&ODPEFS %FDPEFSܕͷϞσϧ • ݴޠσʔλΛ3//Ͱॲཧ͠Α͏ͱ͢Δͱɺஞ࣍ॲཧʢલͷग़ྗΛೖྗʹ͏ʣ͠ ͔Ͱ͖ͳ͍ͷͰ͕͔͔࣌ؒͬͨ • "UUFOUJPOͷΈʹ͢Δ͜ͱͰ
• ฒྻॲཧՄೳʢશ෦Ұؾʹೖྗʣ • ԕ͘ͷใΛऔΓೖΕͯɺ ΑΓྑ͍ϕΫτϧ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
"UUFOUJPOͱ • 5SBOTGPSNFSͰ༻͍ΒΕΔ"UUFOUJPOೋछྨ͋Δ • $SPTT"UUFOUJPOɿ&ODPEFSଆͷେࣄͳใʹΑΓͯ͠ɺ%FDPEFSଆ͔Β ग़ྗ • ผ໊4PVSDF5BSHFU"UUFOUJPO &ODPEFS%FDPEFS"UUFOUJPO
• 4FMG"UUFOUJPOɿࣗͷܥྻʹ͍ͭͯपΓΛݟͯɺΑΓྑ͍ϕΫτϧʹ͢Δ IUUQTTQFBLFSEFDLDPNTFJWJTJPOBOEMBOHVBHFUPGFOZFXPRVSJKVBOLVTIFODFOHYVFYJTIPVGBGBMTFTIBPKJF IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
5SBOTGPSNFSΛͬͨϞσϧ • 5SBOTGPSNFSͷ&ODPEFS%FDPEFSͷͲ͜Λ͏ʹΑͬͯϞσϧ༷ʑɺڧΈ ҟͳΔ • &ODPEFSͷΈΛ͏ʢ#&35ͳͲʣɿࣗવݴޠཧղʢྨ/&3ͳͲʣʹڧ͍ • %FDPEFSͷΈΛ͏ʢ(15ͳͲʣɿࣗવݴޠੜʢରͳͲʣʹڧ͍ •
&ODPEFS%FDPEFS྆ํΛ͏ʢ5#"35ͳͲʣɿܥྻͷม ʢػց༁ཁͳͲʣʹڧ͍ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
#&35ͱ • #JEJSFDUJPOBM&ODPEFS3FQSFTFOUBUJPOGSPN5SBOTGPSNFSTͷུ • 5SBOTGPSNFSͷ&ODPEFSͷΈͰֶशͨ͠Ϟσϧ • ͭͷํ๏Ͱࣄલֶश • .BTLFE-BOHVBHF.PEFMɿೖྗΛҰ෦ϚεΫͯ͠༧ଌ
• /FYU4FOUFODF1SFEJDUJPOɿจೖྗͯͦ͠ΕΒྡจ͔൱͔ • ˢͷํ๏ͷ͓͔͛Ͱࣗવݴޠཧղʹڧ͍ IUUQTTQFBLFSEFDLDPNLZPVOBUVUPSJBMPOOMQBOEWJTJPOBOEMBOHVBHF
#&35ͷੜϞσϧ • #&35ʹ༷ʑͳΛΓࠐΜͩΓɺੑೳҡ࣋ͯ͠ϞσϧαΠζͷখܕԽͳͲͷੜϞσϧ͕ଘࡏ͢Δ • ֶशํ๏Λ • 3P#&35B • %F#&35B
• &-&$53" • 9-/FU • খܕԽ • "-#&35 • %JTUJM#&35 • ϚϧνϞʔμϧ • 7-#&35 IUUQTHJUIVCDPNUIVOMQ1-.QBQFST
༨ஊɿैདྷͷྲྀΕͱͷରԠ • ैདྷͷྲྀΕͱτʔΫφΠζʢܗଶૉղੳͳͲʣڞ௨ • ߏจղੳҎ߱ͷྲྀΕਂֶशϞσϧͷதͰ҉తʹߦΘΕ͍ͯΔʁ • "UUFOUJPOߏจղੳɾΓड͚ղੳΛߦ͍ͬͯΔΑ͏ʹݟΕΔ͠ɺ τʔΫϯͷϕΫτϧԽҙຯղੳΛߦ͍ͬͯΔΑ͏ʹݟΕΔ͠ɺ ෳจΛಛघτʔΫϯΛͬͯϞσϧʹೖྗ͢Δ͜ͱͰจ຺ղੳΛߦ͍ͬͯΔΑ
͏ʹݟΕΔʁ • ҉తʹߏจղੳҎ߱ͷྲྀΕ͕ߦΘΕΔ͕ɺ໌ࣔతʹߦ͍͍ͨͱ͖ͷΈTQB$Z ʢ(J/;"ʣͳͲͷπʔϧΛ͏
ࢀߟจݙ • ࣗવݴޠॲཧͱ7JTJPOBOE-BOHVBHF • ຒΊࠐΈ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̎ճʮܥྻσʔλΛ
ѻ͏ͨΊͷલॲཧʯ • ܥྻσʔλϞσϦϯά 3//-45.5SBOTGPSNFS ɹୈ̍̍ճʮ#&35 5ʯ • 5IF*MMVTUSBUFE5SBOTGPSNFS • #&358JLJQFEJB