Swift からword2vecを使ってみる

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE 4XJGU͔ΒXPSEWFDΛ ࢖ͬͯΈΔ ϦʔυΞʔΩςΫτ  ҏ౻༞ี :VTVLF*UP !OPWJ@ നϠΪίʔϙϨʔγϣϯ 5PLZP4FSWFS4JEF4XJGU.FFUVQ 

5PLZP݄೔ʙ೔

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE 4FF63- • https://github.com/shiroyagicorp/swift-seeurl • ݩʑࣾ಺ϥΠϒϥϦΛެ։ • cURL(curlίϚϯυ), libcurlϕʔε •
ಉظॲཧ(RunLoopෆཁ) let result = try HTTPClient.sendRequest("GET", "https://google.com") print(result.statusCode, result.body) ϑΥϩʔΞοϓهࣄUSZ4XJGU5PLZPͱͦͷޙ  IUUQBJBMTIJSPZBHJDPKQNZUSZTXJGUBOEGPMMPXVQ

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ϝϯςφϯε͍ͯ͠ΔϥΠϒ ϥϦ • novi/mysql-swift: MySQLΫϥΠΞϯτ (όΠϯσΟϯά) • novi/nkf-swift: Network
Kanji FilterͷόΠϯσΟϯά • novi/mecab-swift: MeCabܗଶૉղੳͷόΠϯσΟϯά • novi/i2c-swift: I2CόεϥΠϒϥϦ • shiroyagicorp/swift-seeurl: cURL(HTTPS)ΫϥΠΞϯτ

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE OVNTX • https://github.com/sonsongithub/numsw • try! Swift TokyoͷϋοΧιϯͰ࡞ͬͨ • Pythonʹ͋Δ਺஋ܭࢉϥΠϒϥϦ(numsw)ΛSwift
Ͱ΋࢖͍͍ͨ • ࠓ΋ͨ·ʹϝϯςφϯε͍ͯ͠Δ

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE XPSEWFD • 2013೥͘Β͍ʹެ։ • C࣮૷ • word2vecͷίϯηϓτ͸͜ͷล • https://deepage.net/bigdata/machine_learning/
2016/09/02/ word2vec_power_of_word_vector.html

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE XPSEWFDͷιʔείʔυ • https://code.google.com/archive/p/word2vec/ • ͕ͩɺGoogle Codeऴྃʹ൐͍μ΢ϯϩʔυͰ͖ͳ͍ • https://github.com/svn2github/word2vec.git •
͜ͷลͷϛϥʔΛ࢖͏ • make Ͱ࣮ߦϑΝΠϧΛϏϧυ • macOSͩͱmalloc.hϔομʔ͕ແ͍ͱ͍͏Τϥʔ͕ग़ΔͷͰɺͦͷߦ Λίϝϯτ͢Δ • demo-*.sh͔Β࢝·ΔγΣϧεΫϦϓτͰσϞΛ࣮ߦ

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE XPSEWFDD • ςΩετϑΝΠϧΛೖྗͯ͠ɺτϨʔχϯάɺϞσ ϧΛग़ྗ • Cݴޠ 700ߦఔ౓ͷ CLI •
ϚϧνεϨουରԠ • ίʔυ͕ಡΈʹ͍͘

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE EJTUBODFD • ϞσϧϑΝΠϧͱ୯ޠ(ෳ਺)Λೖྗͯ͠ɺίαΠϯ ྨࣅ౓(ίαΠϯڑ཭)Λܭࢉͯ͠ग़ྗ Enter word or sentence
(EXIT to break): cat dog Word Cosine distance ------------------------------------------------------------------------ goat 0.827205 cow 0.796463 bee 0.788516 blonde 0.784559 hamster 0.784402 ass 0.779677 rat 0.774975

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE 4XJGU͔Β࣮ߦ͢Δʹ͸ 1. .cͷιʔεΛSwift͔ΒݺͿ • ͍ͭ΋ͷCͷϥΠϒϥϦΛSwift͔ΒಡΈࠐΉํ๏ • ࠓճ͸ϥΠϒϥϦͰ͸ͳ͘ɺmain()ͷܗʹͳͬͯ ͍ΔͷͰɺϥούʔؔ਺ͳͲΛఆٛ 2.
͕Μ͹ͬͯSwiftʹҠ২

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ϞσϧϑΝΠϧ • ୯ޠͷϦετ(char*)ͱ୯ޠΠϯσοΫε(Int) • ୯ޠΠϯσοΫεͱ୯ޠϕΫτϧ(Float) • σϞͩͱαΠζ͕30ϝΨόΠτ͋Δ m0
m1 m2 i0 the -0.455356 1.908487 1.365852 i1 of 0.266191 1.750760 0.486601 i2 and 0.889470 1.455499 0.380907 i3 one -2.213606 0.914580 -0.512441

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE EJTUBODFDͷ΍Δ͜ͱ • ϞσϧΛύʔεͯ͠ڊେͳ(30MBఔ౓ͷ)ϝϞϦ্ʹಡΈࠐΉ • ͋Β͔͡Ί୯ޠͱ୯ޠΠϯσοΫεʹ෼͚Δ • ୯ޠΠϯσοΫεͱ୯ޠϕΫτϧΛϝϞϦ্ʹಡΈࠐΉ • ༩͑ΒΕͨɺ୯ޠʹରͯ͠ɺ୯ޠϕΫτϧ͔ΒίαΠϯڑ
཭Λܭࢉͭͭ͠ɺڑ཭͕͍ۙ΋ͷΛιʔτͯ͠ग़ྗ(දࣔ) • https://ja.stackoverﬂow.com/questions/2001/word2vecͷ distance͸ͳͥߴ଎ʹಈ࡞͢Δͷ͔

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE 4XJGUʹҠ২ • Ϟσϧ(୯ޠϕΫτϧ)ΛಡΈࠐΉϝϞϦۭؒ͸  UnsafeMutablePointer<Float>.allocate(capacity:)  Λ࢖༻ • Swift3͔Βಋೖ͞ΕͨϙΠϯλͱϝϞϦۭؒΛ҆શʹޮ཰తʹ ѻ͏࢓૊Έ(݁ߏ೉͍͠) •
ૉ੖Β͍͠SwiftͷϙΠϯλܕͷղઆ: http://qiita.com/ omochimetaru/items/c95e0d36ae7f1b1a9052 • UnsafeRawPointer Migration: https://swift.org/migration- guide/se-0107-migrate.html

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ΍ͬͨ͜ͱ • ୯ޠͱ୯ޠΠϯσοΫεͷରԠΛ഑ྻͰ͸ͳࣙ͘ॻʹมߋ • จࣈྻͷѻ͍ΛStringωΠςΟϒʹมߋ • ݩʑchar*΍strcmpͳͲͷCϨϕϧͩͬͨͷͰɺՄಡੑ ΍ѻ͍͕େม •
(͓ͦΒ͘)ɺϢχίʔυ΁ͷରԠ͕Մೳ • (·ͩ΍͍ͬͯͳ͍͕)ɺιʔτपΓͷվળ

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ࠓճͷϦϙδτϦ • https://github.com/novi/word2vec-swift

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ·ͱΊ • C͔ΒͷҠ২͸ָ • ߏจ΋͍ۙ • ϙΠϯλपΓ΋ಉ͡࢓૊Έ͕࢖͑Δ • word2vecʹ͍ͭͯΑ͘ཧղͰ͖ͯΕ͹͞Βʹ༰қ

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE • ࣍ճ: നϠΪͰӡ༻͍ͯ͠ΔαʔόʔαΠυSwift • ൃදऀืूʂτϐοΫ͸ͳΜͰ΋OKʂ

Swift からword2vecを使ってみる

Swift からword2vecを使ってみる

Yusuke Ito

More Decks by Yusuke Ito

Other Decks in Programming

Featured

Transcript

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE 4XJGU͔ΒXPSEWFDΛ ࢖ͬͯΈΔ ϦʔυΞʔΩςΫτ  ҏ౻༞ี :VTVLF*UP !OPWJ@ നϠΪίʔϙϨʔγϣϯ 5PLZP4FSWFS4JEF4XJGU.FFUVQ

5PLZP݄೔ʙ೔

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE 4FF63- • https://github.com/shiroyagicorp/swift-seeurl • ݩʑࣾ಺ϥΠϒϥϦΛެ։ • cURL(curlίϚϯυ), libcurlϕʔε •

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ϝϯςφϯε͍ͯ͠ΔϥΠϒ ϥϦ • novi/mysql-swift: MySQLΫϥΠΞϯτ (όΠϯσΟϯά) • novi/nkf-swift: Network

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE OVNTX • https://github.com/sonsongithub/numsw • try! Swift TokyoͷϋοΧιϯͰ࡞ͬͨ • Pythonʹ͋Δ਺஋ܭࢉϥΠϒϥϦ(numsw)ΛSwift

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE XPSEWFD • 2013೥͘Β͍ʹެ։ • C࣮૷ • word2vecͷίϯηϓτ͸͜ͷล • https://deepage.net/bigdata/machine_learning/

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE XPSEWFDͷιʔείʔυ • https://code.google.com/archive/p/word2vec/ • ͕ͩɺGoogle Codeऴྃʹ൐͍μ΢ϯϩʔυͰ͖ͳ͍ • https://github.com/svn2github/word2vec.git •

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE XPSEWFDD • ςΩετϑΝΠϧΛೖྗͯ͠ɺτϨʔχϯάɺϞσ ϧΛग़ྗ • Cݴޠ 700ߦఔ౓ͷ CLI •

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE EJTUBODFD • ϞσϧϑΝΠϧͱ୯ޠ(ෳ਺)Λೖྗͯ͠ɺίαΠϯ ྨࣅ౓(ίαΠϯڑ཭)Λܭࢉͯ͠ग़ྗ Enter word or sentence

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE 4XJGU͔Β࣮ߦ͢Δʹ͸ 1. .cͷιʔεΛSwift͔ΒݺͿ • ͍ͭ΋ͷCͷϥΠϒϥϦΛSwift͔ΒಡΈࠐΉํ๏ • ࠓճ͸ϥΠϒϥϦͰ͸ͳ͘ɺmain()ͷܗʹͳͬͯ ͍ΔͷͰɺϥούʔؔ਺ͳͲΛఆٛ 2.

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ϞσϧϑΝΠϧ • ୯ޠͷϦετ(char*)ͱ୯ޠΠϯσοΫε(Int) • ୯ޠΠϯσοΫεͱ୯ޠϕΫτϧ(Float) • σϞͩͱαΠζ͕30ϝΨόΠτ͋Δ m0

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE EJTUBODFDͷ΍Δ͜ͱ • ϞσϧΛύʔεͯ͠ڊେͳ(30MBఔ౓ͷ)ϝϞϦ্ʹಡΈࠐΉ • ͋Β͔͡Ί୯ޠͱ୯ޠΠϯσοΫεʹ෼͚Δ • ୯ޠΠϯσοΫεͱ୯ޠϕΫτϧΛϝϞϦ্ʹಡΈࠐΉ • ༩͑ΒΕͨɺ୯ޠʹରͯ͠ɺ୯ޠϕΫτϧ͔ΒίαΠϯڑ

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE 4XJGUʹҠ২ • Ϟσϧ(୯ޠϕΫτϧ)ΛಡΈࠐΉϝϞϦۭؒ͸  UnsafeMutablePointer<Float>.allocate(capacity:)  Λ࢖༻ • Swift3͔Βಋೖ͞ΕͨϙΠϯλͱϝϞϦۭؒΛ҆શʹޮ཰తʹ ѻ͏࢓૊Έ(݁ߏ೉͍͠) •

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ΍ͬͨ͜ͱ • ୯ޠͱ୯ޠΠϯσοΫεͷରԠΛ഑ྻͰ͸ͳࣙ͘ॻʹมߋ • จࣈྻͷѻ͍ΛStringωΠςΟϒʹมߋ • ݩʑchar*΍strcmpͳͲͷCϨϕϧͩͬͨͷͰɺՄಡੑ ΍ѻ͍͕େม •

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ࠓճͷϦϙδτϦ • https://github.com/novi/word2vec-swift

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE ·ͱΊ • C͔ΒͷҠ২͸ָ • ߏจ΋͍ۙ • ϙΠϯλपΓ΋ಉ͡࢓૊Έ͕࢖͑Δ • word2vecʹ͍ͭͯΑ͘ཧղͰ͖ͯΕ͹͞Βʹ༰қ

$PQZSJHIU4IJSPZBHJ$PSQPSBUJPO"MMSJHIUTSFTFSWFE • ࣍ճ: നϠΪͰӡ༻͍ͯ͠ΔαʔόʔαΠυSwift • ൃදऀืूʂτϐοΫ͸ͳΜͰ΋OKʂ

Swift からword2vecを 使ってみる

Swift からword2vecを 使ってみる

More Decks by Yusuke Ito

Other Decks in Programming

Featured

Transcript

Swift からword2vecを使ってみる

Swift からword2vecを使ってみる