Deep Dive into Faceting

Presentation given by me on the first ElasticSearch NL meetup - 20/9/2012

Transcript

1. ElasticSearch NL 20/9/2012
2. Tonight • Pizza & Beer • Deep dive into faceting ( me :) ) • ElasticSearch.com introduction ( Uri/Shay ) • More drinks..
3. Deep Dive into Faceting Boaz Leskes CTO Buzzcapture @bleskes
4. ?
5. q = fox 5 times a The lazy dog jumps over a quick brown fox
6. The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The lazy dog jumps over the brown fox The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog q = fox
7. The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The lazy dog jumps over the brown fox The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog 5 a 2 a 3 a 10 a "facets": { "o_count": { "lettercount": { "letter": "o", "field": "doc" } } } "facets": { "o_count": { "type ": "lettercount" "count": 12 } }
8. Intermezzo A plugin to register your facet
9. The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The lazy dog jumps over the brown fox The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog q = fox
10. Facet Processor parse Facet Collector doc ids per shard Field Cache doc ids doc values Facet creates
11. brown dog fox quick 2 5 10 12 5 6 12 13 2 5 6 10 12 13 brown dog fox quick
12. The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The lazy dog jumps over the brown fox The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog The quick brown fox jumps over the lazy dog 5 a 2 a 3 a 10 a
13. Facet Processor reduce internal stream Facet Facet Facet Facet
14. James 3 Charlie 2 Adam 2 Eve 1 Brown 2 Remco 2 Adam 2 Eve 1 David 3 James 2 Jan 2 Eve 1 James 3 Charlie 2 Adam 2 Brown 2 Remco 2 Adam 2 David 3 James 2 Jan 2 James 5 Adam 4 Remco 2
15. Facet Processor parse Facet Collector Facet Facet Processor reduce internal stream output multi threaded single thread
16. Faceted Date Histogram
17. Existing Machinery
18. Facet Processor parse Facet Collector Facet Facet Processor reduce internal stream output multi threaded single thread
19. Facet Processor parse Date Facet Collector Value Facet Value Facet Reduce Value Facet Collector Value Facet Reduce Value Processor Value Facet Collector Value Facet 10 sept. 17 sept.
20. Thanks! Code is available on https://github.com/bleskes