I like sushi

*MJLFTVTIJ /BPZB*UP ,BJ[FO1MBUGPSN *OD

h"p://tenshoku.mynavi.jp/it-‐engineer/knowhow/naoya_sushi/13

ߴ͍͓ۚΛग़͢ͳΒ ྑ͍͓ళʹߦ͖͍ͨ

৯΂˓ά

ܦݧతʹ •  ۜ࠲͸ߴධՁͷ͓ళ͕ଟ͍ͳɺͱ͔ •  ܙൺण͸఺਺ͷߴ͍ళ͕গͳ͍ͳɺͱ͔ •  ߴ͍͓ళ͸఺਺΋ߴͦ͏ɺͱ͔ •  ͜ͷՁ֨Ͱ͜ͷ఺ͷ͓ళ͸͓ಘͩɺͱ͔

ݟ͑ΔԽ͍ͨ͠

ݟ͑ΔԽ •  σʔλΛ࢖ͬͯݟ͑ΔԽ͍ͨ͠ •  "1*ͳ͍ •  "1*͕ͳ͍ͳΒͿͬ͜͵͚͹ৗࣝͷൣғ ಺Ͱਓ༷ͷΞΫηεΛࣗಈԽ͢Ε͹ྑ͍ ͡Όͳ͍ – 
ౖΒΕͨΒ͝ΊΜͳ͍͞ŋŋŋ

΍΍໘౗ͳ͜ͱ ▪「銀座駅」「鮨」の検索結果のURL h"p://tabelog.com/tokyo/A1301/A130101/R3368/rstLst/sushi/?SrtT=rt&sk=鮨 &svd=20150916&svt=1900&svps=2&LstCos=0&LstCosT=0&RdoCosTp=2&LstSitu=0&LstR ev=0&ChkCoupon=0&yahoo_ppc=0&ChkCampaign=0&Srt=D&sort_mode=1 ʮᲔʯ͸ೖͬͯΔ͚Ͳʮۜ ࠲ʯ͕ೖͬͯͳ͍

Ͳ͏΋஍Ҭ໊ͷΫΤϦΛ֬ఆ͠ ͨͱ͜ΖͰಈతʹ஍Ҭ৘ใ ਺ ஋ ʹม׵ͯ͠ΫΤϦͯ͠ΔΆ͍

୯७ͳ)551(&5Ͱ ͸ͩΊ͔

/JHIUNBSF •  /PEFKTϞδϡʔϧ •  ϔουϨεϒϥ΢βͷϋΠϨϕϧ"1*Λఏڙ –  1IBOUPN+4 –  &MFDUSPO • 
ϒϥ΢βͷڍಈΛࣗಈԽ •  $BTQFS+4ΑΓ͞Βʹએݴతʹॻ͚Δ •  ԿͰͦΜͳ໊લ –  1IBOUPN ༓ྶ ˠ$BTQFSˠ/JHIUNBSF ͩͱࢥ͏

/JHIUNBSF&YBNQMF var Nightmare = require('nightmare'); yield Nightmare()
.goto('http://yahoo.com') .type('input[title="Search"]', 'github nightmare') .click('.searchsubmit');

ॾʑ •  WͰ͸ͳ͘W࢖ͬͨ –  &MFDUSPOϕʔεʹมΘ͕ͬͨػೳ͕গ͠མͪͯΔ •  useragent()ͳͲͷ"1*͕ফ͑ͨ •  σόοάग़ྗͷ৘ใ͕গͳ͍ • 
ϒϥ΢βͷݴޠ৘ใΛ੍ޚͰ͖ͳ͍ – "1*গ͠ҧ͏ͷͰ஫ҙ •  yieldͰॻ͚Δͷ͸Ҏ߱

ਓ͕ೖྗ͢Δͱ͖ͷϑ ϩʔΛ࠶ݱ

)5.-ͷύʔε͸ DIFFSJPͰ

ΤΫηϧ΁ •  ஍Ҭ͝ͱʹಘͨσʔλΛΤΫηϧ΁ – ۜ࠲ɺ࿡ຊ໦ɺܙൺणɺங஍ŋŋŋ •  ͦΕͧΕళฮ෼͘Β͍ – είΞ – Ձ֨ଳ •  Ձ֨ͱείΞͷࢄ෍ਤΛ࡞Δ

ۜ࠲ 2.9 3.1 3.3 3.5 3.7
3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000

ܙൺण 2.9 3.1 3.3 3.5 3.7
3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000

݁ߏΘ͔Δ 2.9 3.1 3.3 3.5 3.7
3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000 2.9 3.1 3.3 3.5 3.7 3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000 ܙൺणʹ͸ߴՁ֨ଳͷධ Ձͷߴ͍͓ళ͕ͳ͍ ۜ࠲͸ධՁͷߴ͍ߴڃళ ͕ͻ͠Ί͍͍ͯΔ ʮܙൺण͸ߴڃҿ৯ళີू஍ଳͷׂʹྑ͍͓Ე԰͞Μ͸গͳ͍ʯŋŋŋͱ͍͏ᷚ͸ຊ౰͔΋ ͦ΋ͦ΋͢͠԰͞Μ΋গͳ͍

࿡ຊ໦ 2.9 3.1 3.3 3.5 3.7
3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000

ங஍ 2.9 3.1 3.3 3.5 3.7
3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000

͔Δ͘ߟ࡯

ۜ࠲ 2.9 3.1 3.3 3.5 3.7
3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000 ܦݧతʹ͘Β͍͋Ε͹ϋζ Ϩ͸গͳ͍ͷͰͦ͜Λᮢ஋ʹ͠ ͯΈΔ

ۜ࠲ 2.9 3.1 3.3 3.5 3.7
3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000 ίεύͷྑ͍ళ΋͋Δ ་٢ຕҎ্ͷ௒ߴڃళ ͳΒ͜ͷ͋ͨΓ͕ೲಘ ײ͕ߴͦ͏ ४ߴڃళͰຬ଍౓ͷߴ ͦ͏ͳ͓ళ ඞͣ͠΋ߴՁ֨ͳΒධ Ձ͕ྑ͍Θ͚Ͱ͸ͳ͍

࿡ຊ໦ 2.9 3.1 3.3 3.5 3.7
3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000 ۜ࠲ͱ܏޲͸ࣅ͍ͯΔ ۜ࠲ʹൺֱͯ͜͠ͷՁ ֨ଳͷߴධՁళ͕গͳ ͍ ௿Ձ֨ଳͰ͸௒ߴධՁ ͷళ͸ͳ͍

ங஍ 2.9 3.1 3.3 3.5 3.7
3.9 4.1 4.3 4.5 0 5,000 10,000 15,000 20,000 25,000 ௿Ձ֨ଳͷ͓ళ΋ ີू͍ͯ͠Δ ૂ͍໨ ૂ͍໨

ײ૝ •  શൠతʹ௿Ձ֨ଳ͸ධՁ͕ौΊʹͳΔ܏޲ –  ҆ͯ͘͘Β͍ͳΒίεύ͸ྑ͍ͷͰ͸ •  ջ͕Թ͔͍ͳΒۜ࠲΍࿡ຊ໦ –  ͨͩ͠࿡ຊ໦ʹߦ͘ͳΒத్൒୺͸ආ͚Δ – 
ۜ࠲͸࿡ຊ໦ΑΓ΋બ୒ࢶ •  ࠷ߴڃՁ֨ଳͰͳͯ͘΋ྑ͍ళ͕݁ߏ͋Δ •  ங஍͸ொͷن໛ʹରͯ͢͠͠԰͕ଟ༷ɻ੟஍ •  ܙൺण͸͢͠઀଴ʹ͸޲͔ͳ͍ –  ͳ͓നۜߴྠ΍޿ඌ·Ͱߦ͘ͱ৭ʑ͓ళ͕͋Γ·͢ ˞͋͘·ͰείΞΛ໡৴͢ΔͳΒɻ͋·Γਅʹड͚ͳ͍Ͱ͍ͩ͘͞Ͷ

5IBOLT ͢͠Ώ͖ $ ͋ΘΏ͖ $$#:/$/%

I like sushi

I like sushi

Naoya Ito

More Decks by Naoya Ito

Other Decks in Technology

Featured

Transcript

MJLFTVTIJ /BPZBUP ,BJ[FO1MBUGPSN *OD

h"p://tenshoku.mynavi.jp/it-‐engineer/knowhow/naoya_sushi/13

͢͠

ߴ͍

ߴ͍͓ۚΛग़͢ͳΒ ྑ͍͓ళʹߦ͖͍ͨ

৯΂˓ά

ܦݧతʹ •  ۜ࠲͸ߴධՁͷ͓ళ͕ଟ͍ͳɺͱ͔ •  ܙൺण͸఺਺ͷߴ͍ళ͕গͳ͍ͳɺͱ͔ •  ߴ͍͓ళ͸఺਺΋ߴͦ͏ɺͱ͔ •  ͜ͷՁ֨Ͱ͜ͷ఺ͷ͓ళ͸͓ಘͩɺͱ͔

ݟ͑ΔԽ͍ͨ͠

ݟ͑ΔԽ •  σʔλΛ࢖ͬͯݟ͑ΔԽ͍ͨ͠ •  "1ͳ͍ •  "1͕ͳ͍ͳΒͿͬ͜͵͚͹ৗࣝͷൣғ ಺Ͱਓ༷ͷΞΫηεΛࣗಈԽ͢Ε͹ྑ͍ ͡Όͳ͍ –

Ͳ͏΋஍Ҭ໊ͷΫΤϦΛ֬ఆ͠ ͨͱ͜ΖͰಈతʹ஍Ҭ৘ใ ਺ ஋ ʹม׵ͯ͠ΫΤϦͯ͠ΔΆ͍

୯७ͳ)551(&5Ͱ ͸ͩΊ͔

/JHIUNBSF •  /PEFKTϞδϡʔϧ •  ϔουϨεϒϥ΢βͷϋΠϨϕϧ"1*Λఏڙ –  1IBOUPN+4 –  &MFDUSPO •

/JHIUNBSF&YBNQMF var Nightmare = require('nightmare'); yield Nightmare()

ॾʑ •  WͰ͸ͳ͘W࢖ͬͨ –  &MFDUSPOϕʔεʹมΘ͕ͬͨػೳ͕গ͠མͪͯΔ •  useragent()ͳͲͷ"1*͕ফ͑ͨ •  σόοάग़ྗͷ৘ใ͕গͳ͍ •

ਓ͕ೖྗ͢Δͱ͖ͷϑ ϩʔΛ࠶ݱ

)5.-ͷύʔε͸ DIFFSJPͰ

ΤΫηϧ΁ •  ஍Ҭ͝ͱʹಘͨσʔλΛΤΫηϧ΁ – ۜ࠲ɺ࿡ຊ໦ɺܙൺणɺங஍ŋŋŋ •  ͦΕͧΕళฮ෼͘Β͍ – είΞ – Ձ֨ଳ •  Ձ֨ͱείΞͷࢄ෍ਤΛ࡞Δ

ۜ࠲ 2.9 3.1 3.3 3.5 3.7

ܙൺण 2.9 3.1 3.3 3.5 3.7

݁ߏΘ͔Δ 2.9 3.1 3.3 3.5 3.7

࿡ຊ໦ 2.9 3.1 3.3 3.5 3.7

ங஍ 2.9 3.1 3.3 3.5 3.7

͔Δ͘ߟ࡯

ۜ࠲ 2.9 3.1 3.3 3.5 3.7

ۜ࠲ 2.9 3.1 3.3 3.5 3.7

࿡ຊ໦ 2.9 3.1 3.3 3.5 3.7

ங஍ 2.9 3.1 3.3 3.5 3.7

ײ૝ •  શൠతʹ௿Ձ֨ଳ͸ධՁ͕ौΊʹͳΔ܏޲ –  ҆ͯ͘͘Β͍ͳΒίεύ͸ྑ͍ͷͰ͸ •  ջ͕Թ͔͍ͳΒۜ࠲΍࿡ຊ໦ –  ͨͩ͠࿡ຊ໦ʹߦ͘ͳΒத్൒୺͸ආ͚Δ –

5IBOLT ͢͠Ώ͖ $ ͋ΘΏ͖ $$#:/$/%