Share
Embed
Aggregationあれこれ
第6回elasticsearch勉強会発表スライド。
#elasticsearchjp #elasticsearch
Jun Ohtani
September 17, 2014
Transcript
90 slides
-
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Jun Ohtani @johtani 2014-09-16 Aggregation͋Ε͜Ε -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited about • Me, Jun Ohtani / Technical Adovocate lucene-gosenίϛολʔ ElasticSearch Serverຊޠ൛ͷ༁ elasticsearch-extended-analysisͷ։ൃ http://blog.johtani.info • Elasticsearch, founded in 2012 Products: Elasticsearch, Logstash, Kibana, Marvel Professional services: Support & development subscriptions Trainings -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ΞδΣϯμ • Elasticsearch? • Aggregationͱ • AggregationͷΈ • Aggregationͷछྨ ! -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Elasticsearchʁ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited ϑϦʔϫʔυݕࡧ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited ߜΓࠐΈ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited ϋΠϥΠτ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited ιʔτ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited ϖʔδϯά -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited ूܭ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited αδΣετ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Elasticsearch in 10 seconds • εΩʔϚϑϦʔɺࢄυΩϡϝϯτετΞɺREST & JSON • Φʔϓϯιʔε: Apache License 2.0 • ઃఆͳ͠Ͱ؆୯ʹࢼ͢͜ͱ͕Մೳ • JavaͰ࣮ɻ֦ு༰қ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregation -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregationͱ • 1.0͔Βར༻Մೳ • ݕࡧ݁Ռʹରͯ͠ɺσʔλͷղੳ͕༰қʹ • FacetΑΓڧྗͳूܭͳͲ͕Մೳ ֊తͳूܭɺάϧʔϓԽ ಈతͳूܭɺάϧʔϓԽ • Facetɺdeprecatedɻ2.xܥͰͳ͘ͳΔ ! -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregationͱ • SQLͩͱ ! ! • GROUP BY colorɿBucket • COUNT(color)ɿMetric SELECT COUNT(color) FROM table GROUP BY color -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregations Documents -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregations Documents Query -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregations Documents Query Buckets -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregations Documents Query Buckets -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregations Documents Query Buckets Metrics 123 123 243 185 -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregationͱ • Aggregationେ͖̎͘छྨ • Bucket • ݕࡧ݁ՌͷυΩϡϝϯτΛ ࢦఆͨ݅͠ʢόέπʣʹྨ • Metric • BucketͷυΩϡϝϯτͷσʔλΛ ͱʹ͍Ζ͍Ζܭࢉ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Bucket • Bucketͷྫɿ • Ϣʔβͷੑผɿʮஉੑʯʮঁੑʯ • πΠʔτͷॴɿʮ౦ژʯʮژʯ • πΠʔτͷݴޠɿʮຊޠʯʮӳޠʯ • ϒϥβɿʮIEʯʮChromeʯ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Metric • Metricͷྫɿ • BucketͷυΩϡϝϯτͷ • πΠʔτจࣈͷฏۉ • ച্ߴͷ࠷େ • ϦΫΤετॲཧ࣌ؒͷ࠷େɺ95ύʔηϯλΠϧ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited αϯϓϧ { "price": 10000, "color": "red", "make": "honda", ɹɹ"sold": "2014-10-28" } { "price": 20000, "color": "red", "make": "honda", ɹɹ"sold": "2014-11-05" } { "price": 30000, "color": "green", "make": "ford", ɹɹ"sold": "2014-05-18" } { "price": 15000, "color": "blue", "make": "toyota", ɹɹ"sold": "2014-07-02" } { "price": 12000, "color": "green", "make": "toyota", ɹɹ"sold": "2014-08-19" }... -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:৭Ͱूܭ » GET /cars/transactions/_search?search_type=count { "aggs" : { "popular_colors" : { "terms" : { "field" : "color" } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:৭Ͱूܭ "aggregations": { "popular_colors": { "buckets": [ { "key": "red", "doc_count": 4 },{ "key": "blue", "doc_count": 2 }, { "key": "green", "doc_count": 2 }… -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:৭Ͱྨͯ͠Ձ֨ͷฏۉ » GET /cars/transactions/_search?search_type=count { "aggs": { "colors": { "terms": { "field": "color" }, "aggs": { "avg_price": { "avg": { "field": "price" } } } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:৭Ͱྨͯ͠Ձ֨ͷฏۉ » GET /cars/transactions/_search?search_type=count { "aggs": { "colors": { "terms": { "field": "color" }, "aggs": { "avg_price": { "avg": { "field": "price" } } } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:৭Ͱྨͯ͠Ձ֨ͷฏۉ "aggregations": { "colors": { "buckets": [ { "key": "red", "doc_count": 4, "avg_price": { "value": 32500 } }, {"key": "blue", "doc_count": 2, "avg_price": { "value": 20000 } },,… -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:ϝʔΧʔΛՃ » GET /cars/transactions/_search?search_type=count { "aggs": { "colors": { "terms": { "field": “color" }, "aggs": { "avg_price": { "avg": { "field": “price" } }, "make": { "terms": { "field": "make" } } } } }} -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:ϝʔΧʔΛՃ » GET /cars/transactions/_search?search_type=count { "aggs": { "colors": { "terms": { "field": “color" }, "aggs": { "avg_price": { "avg": { "field": “price" } }, "make": { "terms": { "field": "make" } } } } }} -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:ϝʔΧʔΛՃ "aggregations": { "colors": { "buckets": [ { "key": "red", "doc_count": 4, "make": { "buckets": [ { "key": "honda", "doc_count": 3 }, { "key": "bmw", "doc_count": 1 } ] }, "avg_price": { "value": 32500 }… -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:ϝʔΧʔ͝ͱͷ࠷খ/࠷େՁ֨ » GET /cars/transactions/_search?search_type=count { "aggs": { "colors": { "terms": { "field": “color” }, "aggs": { "avg_price": { "avg": { "field": "price" } }, "make" : { "terms" : { "field" : “make" }, "aggs" : { "min_price" : { "min": { "field": "price"} }, "max_price" : { "max": { "field": "price"} } } } } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:ϝʔΧʔ͝ͱͷ࠷খ/࠷େՁ֨ » GET /cars/transactions/_search?search_type=count { "aggs": { "colors": { "terms": { "field": “color” }, "aggs": { "avg_price": { "avg": { "field": "price" } }, "make" : { "terms" : { "field" : “make" }, "aggs" : { "min_price" : { "min": { "field": "price"} }, "max_price" : { "max": { "field": "price"} } } } } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫ:ϝʔΧʔ͝ͱͷ࠷খ/࠷େՁ֨ { "key": "red", "doc_count": 4, "make": { "buckets": [ { "key": "honda", "doc_count": 3, "min_price": { "value": 10000 }, "max_price": { "value": 20000 } }, { "key": “bmw”, … } ] }, "avg_price": { "value": 32500 }… -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited AggregationͷΈ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited AggregationͷΠϝʔδ » GET /cars/transactions/_search? search_type=count { "aggs": { "colors": { "terms": { "field": “color" }, "aggs": { "avg_price": { "avg": { "field": “price" } }, "make": { "terms": { "field": "make" } } } } } } root terms (color) terms (make) avg (price) -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited AggregationͷΠϝʔδ » GET /cars/transactions/_search? search_type=count { "aggs": { "colors": { "terms": { "field": “color" }, "aggs": { "avg_price": { "avg": { "field": “price" } }, "make": { "terms": { "field": "make" } } } } } } root terms (color) terms (make) avg (price) -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited AggregationͷΠϝʔδ » GET /cars/transactions/_search? search_type=count { "aggs": { "colors": { "terms": { "field": “color" }, "aggs": { "avg_price": { "avg": { "field": “price" } }, "make": { "terms": { "field": "make" } } } } } } root terms (color) terms (make) avg (price) -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited AggregationͷΠϝʔδ » GET /cars/transactions/_search? search_type=count { "aggs": { "colors": { "terms": { "field": “color" }, "aggs": { "avg_price": { "avg": { "field": “price" } }, "make": { "terms": { "field": "make" } } } } } } root terms (color) terms (make) avg (price) -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited AggregationͷΠϝʔδ » GET /cars/transactions/_search? search_type=count { "aggs": { "colors": { "terms": { "field": “color" }, "aggs": { "avg_price": { "avg": { "field": “price" } }, "make": { "terms": { "field": "make" } } } } } } root terms (color) terms (make) avg (price) -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggsͷࢄॲཧ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ݕࡧॲཧ Node Shard 1 Shard 2 Shard 0 Query -
Shard 2 Node Query Shard 1 Shard 0 Query Query
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited ΫΤϦͷड͚औΓ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited γϟʔυʹݕࡧ Node Shard 1 Shard 2 Shard 0 Query Query Query -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited γϟʔυͷ݁ՌΛϚʔδ Node Shard 1 Shard 2 Shard 0 Results 2 Results 1 Results 0 Results -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ݁ՌΛΫϥΠΞϯτ Node Shard 1 Shard 2 Shard 0 Results -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregationಉ༷ Node Shard 1 Shard 2 Shard 0 Query -
Shard 2 Shard 1 Shard 0 Node Query Query Query
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited ΫΤϦͱAggsͷड͚औΓ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited γϟʔυʹࢄ(ΫΤϦޙʹAggs) Node Shard 1 Shard 2 Shard 0 Query Query Query -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ΫΤϦͱAggsͷ݁ՌͷϚʔδ Node Shard 1 Shard 2 Shard 0 Results 2 Results 0 Results 1 Results -
Node Results Copyright Elasticsearch 2014. Copying, publishing and/or distributing without
written permission is strictly prohibited ݁ՌΛΫϥΠΞϯτʹ Shard 1 Shard 2 Shard 0 -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ॲཧγʔέϯεʢ·ͱΊʣ • AggregationݕࡧͷΫΤϦϑΣʔζͰ࣮ߦ ݕࡧΫΤϦͱϑΣονͷϑΣʔζ͕͋Δ • γϟʔυ୯ҐͰॲཧΛ࣮ߦ • Ϛʔδ͢ΔϊʔυͰɺ ֤γϟʔυͷAggsͷ݁ՌΛϚʔδ͢Δ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited post_filterͱaggs • post_filterΛར༻ͨ͠߹ɺpost_filterͰࢦఆͨ͠ ϑΟϧλΛద༻͢Δʮલʯͷݕࡧ݁Ռʹରͯ͠ AggsॲཧΛ࣮ߦ • Aggsॲཧʹରͯ͠ϑΟϧλΛద༻͢Δ߹filter aggregationΛར༻ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited Aggregationͷछྨ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited bucket • filter • filters (>=1.4.0) • missing • nested • reverse nested (>=1.2.0) • children • terms • significant terms (>=1.1.0) • range • date range • ipv4 range • histogram • date histogram • geo distance • geohash grid -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited terms • ΠϯσοΫεʢϑΟʔϧυʣͷ୯ޠ͝ͱʹ BucketΛੜ • औಘ݅ΛsizeͰɺιʔτ݅ΛorderͰࢦఆՄೳ • ݁Ռۙࣅ sizeࢦఆ͞Ε͕ͨ݅γϟʔυ͔Βฦ٫͞ΕΔͨΊ ͨͩ͠ɺorder͕_termͷ߹ۙࣅͰͳ͍ shard_sizeΛར༻͢Δͱγϟʔυ͔Βͷฦ٫Λผ్ɺࢦఆՄೳ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿtermsͷΫΤϦ » GET /cars/transactions/_search?search_type=count { "aggs" : { "popular_colors" : { "terms" : { "field" : "color" } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿtermsͷ݁Ռ "aggregations": { "popular_colors": { "buckets": [ { "key": "red", "doc_count": 4 },{ "key": "blue", "doc_count": 2 }, { "key": "green", "doc_count": 2 }… -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited significant terms • Uncommonly common • ҟৗݕɺϨίϝϯυͳͲʹར༻ • ྫɿ өըͷϨίϝϯυ ΫϨδοτΧʔυͷར༻ཤྺͰͷҟৗͷݕग़ Ҭͷಛతͳ൜ࡑ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿsignificant termsͷΫΤϦ » GET /cars/transactions/_search?search_type=count { "query" : { "terms" : {"force" : [ "British Transport Police" ]} }, "aggregations" : { "significantCrimeTypes" : { "significant_terms" : { "field" : "crime_type" } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿsignificant termsͷ݁Ռ "aggregations" : { "significantCrimeTypes" : { "doc_count": 47347, "buckets" : [ { "key": "Bicycle theft", "doc_count": 3640, "score": 0.371235374214817, "bg_count": 66799 } ... ] } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited range • BucketΛൣғͰఆٛͯ͠ࢦఆ • Range Facetͱಉ༷ • ͦͷଞʹσʔλʹಛԽͨ͠ͷ date rangeɿσʔλ͚ɻdate format͕ར༻Մ ipv4 rangeɿIPv4σʔλ͚ɻCIDRར༻Մ geo distanceɿཧใ͚ɻڑʹΑΔൣғ ! -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿrangeͷΫΤϦ » GET /cars/transactions/_search?search_type=count {"aggs":{ "price_ranges":{ "range":{ "field":"price", "ranges":[ {“to":50 }, {"from":50,"to":100}, {"from":100} ] } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿrangeͷ݁Ռ "aggregations": { "price_ranges" : { "buckets": [ { "to": 50, "doc_count": 2 },{ "from": 50, "to": 100, "doc_count": 4 }, { "from": 100, "doc_count": 4 } ] } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿkeyedΫΤϦ { "aggs" : { "price_ranges" : { "range" : { "field" : "price", "keyed" : true, "ranges" : [ {"key": "cheap", "to": 50 }, {"key": "average", "from": 50, "to": 100 }, {"key": "expensive", "from": 100 } ] } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited histogram • Bar Chart͚ • ෯ʢintervalʣΛࢦఆ • Λ෯ຖʹ۠ΒΕͨBucketʹྨ • min_doc_countʹ0Λઃఆ͢ΔͱɺۭͷBucketऔ ಘՄೳ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿhistogramͷΫΤϦ » GET /cars/transactions/_search?search_type=count { "aggs" : { "prices" : { "histogram" : { "field" : "price", "interval" : 50, “min_doc_count” : 0, } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿhistogramͷ݁Ռ "aggregations": { "prices" : { "buckets": [ { "key": 0, "doc_count": 2 }, { "key": 50, "doc_count": 4 }, { "key": 100, "doc_count":0 }, { "key": 150, "doc_count": 3 } ] } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited metric • min • max • sum • avg • stats • extended_stats • value count • percentiles (>=1.1.0) • percentile ranks (>=1.3) • cardinality (>=1.1.0) • geo bounds (>=1.3.0) • top_hits (>=1.3.0) • scripted metric (>= 1.4.0) -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited min/max/sum/avg/stats • Bucketͷmin/max/sum/avgΛฦ͢ • statsmin/max/sum/avg͓ΑͼcountΛฦ͢ • sum_of_squaresɺvarianceɺstd_deviationΛՃ ͨ͠extended_stats͋Γ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿminͷΫΤϦ » GET /cars/transactions/_search?search_type=count { "aggs" : { "min_price" : { "min" : { "field" : "price" } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿminͷ݁Ռ "aggregations": { "min_price": { "value": 10 } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿstatsͷΫΤϦ » GET /cars/transactions/_search?search_type=count { "aggs" : { "grades_stats" : { "stats" : { "field" : "grade" } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿstatsͷ݁Ռ "aggregations": { "grades_stats": { "count": 6, "min": 60, "max": 98, "avg": 78.5, "sum": 471 } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited cardinality • SQLͷDISTINCT • ۙࣅʢHyperLogLog++ʣ precision_thresholdʹͯਫ਼ΛࢦఆՄೳ ࠷େ40,000·ͰࢦఆՄೳ precision_threshold * 8 όΠτͷϝϞϦ͕ඞཁ ! • ࢿྉɿhttp://www.elasticsearch.org/guide/en/elasticsearch/ reference/1.x/search-aggregations-metrics-cardinality- aggregation.html -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿcardinalityͷΫΤϦ » GET /cars/transactions/_search?search_type=count { "aggs" : { "distinct_colors" : { "cardinality" : { "field" : "color" } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿcardinalityͷ݁Ռ "aggregations": { "distinct_colors": { "value": 3 } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿprecision_thresholdͷࢦఆ » GET /cars/transactions/_search?search_type=count { "aggs" : { "distinct_colors" : { "cardinality" : { "field" : "color", "precision_threshold" : 100 } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited percentiles • ύʔηϯλΠϧܭࢉ • percentsଐੑͰܭࢉ͢ΔൣғΛࢦఆՄೳ • σϑΥϧτ1ɺ5ɺ25ɺ50ɺ75ɺ95ɺ99 • compressionͰϝϞϦ༻ྔΛௐՄೳ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿpercentilesͷΫΤϦ » GET /cars/transactions/_search?search_type=count { "aggs" : { "load_time_outlier" : { "percentiles" : { "field" : "load_time" } } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿtermsͷ݁Ռ "aggregations": { "load_time_outlier": { "values" : { "1.0": 15, "5.0": 20, "25.0": 23, "50.0": 25, "75.0": 29, "95.0": 60, "99.0": 150 } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited top-hits • άϧʔϐϯά͞Εͨݕࡧ݁ՌʢField Collapsingʣ • BucketͷυΩϡϝϯτΛ݁Ռͱͯ͠ग़ྗ • ҎԼͷݕࡧػೳ͕ར༻Մ ϋΠϥΠτɺNamed FilterɺQueryɺSource FilteringɺScript Field • ࢀߟɿhttps://medium.com/hello-elasticsearch/ top-hits-aggregation-f091986cb66e -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿtop_hitsͷΫΤϦ » GET /cars/transactions/_search?search_type=count {"aggs": { "top-tags": { "terms": { "field": "tags", "size": 3 }, "aggs": { "top_tag_hits": { "top_hits": { "sort": [ { "last_activity_date": { "order": “desc" } } ], "_source": { "include": [ "title" ] }, "size" : 1 } } } } }} -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿtermsͷ݁Ռ "aggregations": { "top-tags": { "buckets": [ { "key": "windows-7", "doc_count": 25365, "top_tags_hits": { "hits": { "total": 25365, "max_score": 1, "hits": [ { "_index": "stack", "_type": "question", "_id": "602679", "_score": 1, "_source": {"title": "Windows port opening"}, "sort": [ 1370143231177 ] … -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited scripted metrics • 1.4.0Ͱಋೖ༧ఆ • scriptʹΑΔMetricࢦఆ͕Մೳ • ҎԼͷεςʔδຖʹهड़ init_script map_script combine_script reduce_script -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ྫɿscripted metricͷΫΤϦ » GET /cars/transactions/_search?search_type=count {“aggs": { "profit": { "scripted_metric": { "init_script" : "_agg['transactions'] = []", "map_script" : "if (doc['type'].value == \"sale\") { _agg.transactions.add(doc['amount'].value) } else { _agg.transactions.add(-1 * doc['amount'].value) }", "combine_script" : "profit = 0; for (t in _agg.transactions) { profit += t }; return profit", "reduce_script" : "profit = 0; for (a in _aggs) { profit += a }; return profit" } } } -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ·ͱΊ • Aggregationͷ֓ཁ BucketͱMetric • Aggregationͷಈ࡞ ݕࡧ࣌ʹಉ࣌ʹ࣮ߦ͠ɺ1ύεͰॲཧ • Aggregationͷछྨ ͍Ζ͍Ζͳ༻్ͷAggs͕͋Δ -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ࢀߟ • The Significant Terms Aggregation (Slide) https://speakerdeck.com/elasticsearch/the-significant-terms- aggregation • elasticsearc - aggregations (Slide & Video) Berlin Buzzwords 2014 http://berlinbuzzwords.de/session/elasticsearch-aggregations • Elasticsearch - The Definitive Guide http://shop.oreilly.com/product/0636920028505.do -
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission
is strictly prohibited ࢀߟ • Github https://github.com/elasticsearch • ΨΠυ http://www.elasticsearch.org/guide/ • αϙʔτ http://www.elasticsearch.com/support/