Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Elasticsearch on EC2からAmazon Elasticsearch Serv...

ikuwow
September 15, 2016

Elasticsearch on EC2からAmazon Elasticsearch Serviceに 移行してだいぶ楽になった話

ikuwow

September 15, 2016
Tweet

More Decks by ikuwow

Other Decks in Technology

Transcript

  1. Elastic search + Kibanaͱ͸ • Elasticsearch: จॻͷશจ ݕࡧ΍ϩάͷ෼ੳʹར༻ ͞ΕΔݕࡧΤϯδϯʢε ΩʔϚϨεʣ

    • Kibana: Elasticsearchͷϑ ϩϯτΤϯυͱͯ͠௚ײ తͳૢ࡞ͰσʔλΛ؆୯ ʹूܭ΍ՄࢹԽ͕ߦ͑Δ
  2. গ͠લͷߏ੒ node.master: false node.data: false node.master: true node.data: true node.master:

    false node.data: false node.master: true node.data: true Amazon Redshift Amazon S3 teratailͷதͷਓ ४ϦΞϧλΠϜՄࢹԽ KPIΛਂ͘ՄࢹԽ όονॲཧ
  3. cluster_health status: red { "cluster_name" : "elasticsearch", "status" : "

    red", "timed_out" : false, "number_of_nodes" : 1, "number_of_data_nodes" : 1, "active_primary_shards" : 1061, "active_shards" : 1061, "relocating_shards" : 0, "initializing_shards" : 0, "unassigned_shards" : 3488, "delayed_unassigned_shards" : 0, "number_of_pending_tasks" : 0, "number_of_in_flight_fetch" : 0, "task_max_waiting_in_queue_millis" : 0, "active_shards_percent_as_number" : 23.32380743020444 } ͔͠΋Ϋϥελ͕෼཭ͯ͠Δ
  4. ࢖ͬͯΈͯײͨܽ͡఺ • ΞΫηεݩ੍ݶ͕໘౗ • άϩʔόϧͳΤϯυϙΠϯτ͚͕ͩҰ͕ͭ͋ͯΘΕΔ • VPCະରԠͰɺΞΫηεϙϦγʔͰIPΞυϨεɺIAMͰͷ੍ݶ͕ओ • AWS Lambda͔ΒϦΫΤετૹΔͷ͕ඇৗʹ໘౗…

    • ϓϥάΠϯͷ௥Ճ͕Ͱ͖ͳ͍ • Timelion, Sense, Elasticsearch-head, ElastAlert, … • ࢖͑ͳ͍APIΤϯυϙΠϯτ͕͋Δ • /_reindex, /_reroute etc.