Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Sudachi ❤︎ Elasticsearch

Sudachi ❤︎ Elasticsearch

Elasticsearchで今すぐ使えるビジネス向けトークナイザー『Sudachi』

https://github.com/WorksApplications/Sudachi

【京都開催】Elasticsearch勉強会 #elasticsearchjp
https://www.meetup.com/ja-JP/Tokyo-Elastic-Fantastics/events/252971593/

Sorami Hisamoto

August 02, 2018
Tweet

More Decks by Sorami Hisamoto

Other Decks in Programming

Transcript

  1. 

  2. 5-%3·ͱΊ w ιϑτ΢ΣΞˍߴ඼࣭ࣙॻ w ແྉ 044 "QBDIF w ๛෋ͳಛ௕ෳ਺෼ׂ୯Ґ େن໛ऩ࿥ޠኮ

    දهਖ਼نԽ ϓϥάΠϯ ʜ w اۀͷόοΫΞοϓʹΑΔܧଓతͳϝϯςφϯε w 4VEBDIJެࣜϓϥάΠϯ༗ w ෳ਺෼ׂ୯Ґˠద߹཰Λอͪͭͭ࠶ݱ཰Λ޲্ w දهਖ਼نԽˠΫΤϦͷ༳ΕΛٵऩ ܗଶૉղੳثʮ4VEBDIJʯ &MBTUJDTFBSDIʹ࠷ద
  3. ྫ͑͹ɺ͜Μͳ͜ͱͰ͖·͢ ΫΤϦ͕ʮΧϯψࠃࡍөըࡇʯͷͱ͖ʜ
 ˠΧϯψࠃࡍөըࡇ Χϯψ ࠃࡍ өը ࡇΛશͯ࢖͏ʂ ۭ͖؈ ۭ؈ ۭ͖᠒

    ۭ᠒ ۭ͖Χϯ ۭ͖͔Μ
 ˠɹͥΜͿʮۭ͖؈ʯʹ·ͱΊΔʂ ෳ਺෼ׂ୯Ґͷซ༻ දهͷਖ਼نԽ ଓ͖͸ຊฤͰʜ
  4. 4VEBDIJB+BQBOFTF5PLFOJ[FSGPS#VTJOFTTCZ8"15PLVTIJNB"*/-1-BC ͦ΋ͦ΋ܗଶૉղੳͱ͸ʜ   zʹΘͱΓ͸ඈ͹ͳ͍z 4FHNFOUBUJPO ςΩετΛ෼ׂ 4UFNNJOH ޠܗΛࣙॻܗʹ 1BSUPG4QFFDI5BHHJOH

    ඼ࢺΛ෇༩ ͸ ඈ͹ ͳ͍ ʹΘͱΓ ͸ ॿࢺ ඈ͹ ಈࢺ ͳ͍ ॿಈࢺ ʹΘͱΓ ໊ࢺ ඈ͹ ඈͿ ࣮༻্͸ จࣈਖ਼نԽ ݁߹ॲཧ දهਖ਼نԽ ಡΈ෇༩ʜ ͳͲͳͲ෇ਵ͢Δ͞·͟·ͳॲཧ΋ඞཁ
  5. 4VEBDIJB+BQBOFTF5PLFOJ[FSGPS#VTJOFTTCZ8"15PLVTIJNB"*/-1-BC ෳ਺ͷ෼ׂ୯Ґ   lΧϯψࠃࡍөըࡇz Χϯψࠃࡍөըࡇ "୯Ґ Χϯψ ࠃࡍ өը

    ࡇ Χϯψ ࠃࡍ өըࡇ #୯Ґ $୯Ґ ͦΕͧΕͷ୯ҐͰग़ྗ΍࠶෼ׂ͕Ͱ͖Δ ༻్ʹΑͬͯཉ͍͠௕͞͸͕ͪ͏ݕࡧ"$ ϚΠχϯά$ ޠኮௐࠪ#
  6. 4VEBDIJB+BQBOFTF5PLFOJ[FSGPS#VTJOFTTCZ8"15PLVTIJNB"*/-1-BC දهͷਖ਼نԽ   ύλʔϯ ྫ จࣈछͷҧ͍ ޲೔Ѯͻ·ΘΓώϚϫϦ ྜྷࢎΓΜࢎϦϯࢎ ׽ࣈͷҧ͍


    ʢҟମࣈ ୅༻දه ׳༻දهʣ ܳज़᥁ज़ ڻ୵ڻ୰ ಙ༻ಘ༻ ૹΓԾ໊ͷҧ͍ ड͚෇͚ड෇͚ड෇ ֎དྷޠͷදهҧ͍ ίϛϡχςΟʔίϛϡχςΟίϛχςΟʔDPNNVOJUZ ޡ༻ γϛϡϨʔγϣϯγϡϛϨʔγϣϯ ͚ͩͨ͘ݴ͍ํ ʙͪΌ͋ʙͯ͸ ΋ͪΖΜɺͳΜͰ΋͔ΜͰ΋ਖ਼نԽ͢Ε͹ྑ͍Θ͚Ͱ͸ͳ͍ ༻్Λ౿·͑ɺٞ࿦ͭͭ͠બఆ͍ͯ͠Δ ˞ৄࡉ͸ʮݴޠࢿݯ׆༻ϫʔΫγϣοϓʯͷݪߘΛࢀরͷ͜ͱ
  7. 4VEBDIJB+BQBOFTF5PLFOJ[FSGPS#VTJOFTTCZ8"15PLVTIJNB"*/-1-BC ػೳͷϓϥάΠϯԽ w ೖྗςΩετҟମࣈ౷੍ දهิਖ਼ w ϥςΟεະ஌ޠॲཧ ඼ࢺ઀ଓې੍ w ग़ྗղ਺ࢺਖ਼نԽ

    ਓ໊ॲཧ   ֤εςοϓͰɺ༷ʑͳॲཧΛϓϥάΠϯͱͯ͠௥ՃͰ͖Δ ਺஋ਖ਼نԽ l̍̌̌ઍԁzˠlz ਓ໊ਪఆʢ·ͩ࡞ͬͯͳ͍ʣ lాத˓˓༷zˡະ஌ޠͩͬͨΒਓ໊ͬΆ͍
  8. 4VEBDIJB+BQBOFTF5PLFOJ[FSGPS#VTJOFTTCZ8"15PLVTIJNB"*/-1-BC ػೳͷϓϥάΠϯԽ w ೖྗςΩετҟମࣈ౷੍ දهิਖ਼ w ϥςΟεະ஌ޠॲཧ ඼ࢺ઀ଓې੍ w ग़ྗղ਺ࢺਖ਼نԽ

    ਓ໊ॲཧ   ֤εςοϓͰɺ༷ʑͳॲཧΛϓϥάΠϯͱͯ͠௥ՃͰ͖Δ w ಠࣗͷະ஌ޠॲཧ w ඼൪ɾܕࣜͷநग़ w ʜ Ϣʔβʔ͕ࣗ༝ʹಠࣗͷϓϥάΠϯΛ࡞੒Ͱ͖Δ
  9. 4VEBDIJB+BQBOFTF5PLFOJ[FSGPS#VTJOFTTCZ8"15PLVTIJNB"*/-1-BC ػೳͷϓϥάΠϯԽ w ೖྗςΩετҟମࣈ౷੍ දهิਖ਼ w ϥςΟεະ஌ޠॲཧ ඼ࢺ઀ଓې੍ w ग़ྗղ਺ࢺਖ਼نԽ

    ਓ໊ॲཧ   ֤εςοϓͰɺ༷ʑͳॲཧΛϓϥάΠϯͱͯ͠௥ՃͰ͖Δ ֤ࣾɺΈΜͳಉ͡Α͏ͳ͜ͱΛ΍ͬͯͨΓ͢Δ ंྠͷ࠶ൃ໌Λ΍ΊͯɺϕετɾϓϥΫςΟεΛڞ༗͍͖͍ͯͨ͠ w ಠࣗͷະ஌ޠॲཧ w ඼൪ɾܕࣜͷநग़ w ʜ Ϣʔβʔ͕ࣗ༝ʹಠࣗͷϓϥάΠϯΛ࡞੒Ͱ͖Δ
  10. 4VEBDIJB+BQBOFTF5PLFOJ[FSGPS#VTJOFTTCZ8"15PLVTIJNB"*/-1-BC ଞͷࣙॻͱൺ΂Δͱʜ   *1"%*$ 6OJ%JD /&PMPHE 4VEBDIJ ෳ਺ͷ෼ׂ୯Ґ ✖

    ✖ ✖ ˔ ݻ༗දݱ ˛ ˛ ˔ ˔ දهͷਖ਼نԽ ˔ ˔ ✖ ˔ ܧଓతͳϝϯςφϯε ✖ ˛ ˔ ˔ ਓखʹΑΔਫ਼ࠪ ˔ ˔ ✖ ˔
  11. 4VEBDIJB+BQBOFTF5PLFOJ[FSGPS#VTJOFTTCZ8"15PLVTIJNB"*/-1-BC ,VSPNPKJͱൺ΂Δͱʜ   ,VSPNPKJ 4VEBDIJ ෳ਺ͷ෼ׂ୯Ґ ˛ ˔ දهͷਖ਼نԽ

    ˛ ˔ ·ͱΊ্͛ ิਖ਼ॲཧ ˛ ˔ ෳ਺Ϣʔβʔࣙॻ ✖ ˔ লϝϞϦ ˔ ˕ ղੳਫ਼౓ ˔ ˔ ղੳ଎౓ ˛ ˛ OCFTUղʹΑΔۙࣅ -VDFOFϑΟϧλʔซ༻ ϝϞϦϚοϓར༻ʹΑΔෳ਺+BWB7.Ͱͷࣙॻڞ༗    
  12. ·ͱΊ ͥͻҰ౓͓ࢼ͍ͩ͘͠͞ w ιϑτ΢ΣΞˍߴ඼࣭ࣙॻ w ແྉ 044 "QBDIF w ๛෋ͳಛ௕ෳ਺෼ׂ୯Ґ

    େن໛ऩ࿥ޠኮ දهਖ਼نԽ ϓϥάΠϯ ʜ w اۀͷόοΫΞοϓʹΑΔܧଓతͳϝϯςφϯε w 4VEBDIJެࣜϓϥάΠϯ༗ w ෳ਺෼ׂ୯Ґˠద߹཰Λอͪͭͭ࠶ݱ཰Λ޲্ w දهਖ਼نԽˠΫΤϦͷ༳ΕΛٵऩ ܗଶૉղੳثʮ4VEBDIJʯ &MBTUJDTFBSDIʹ࠷ద