Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
500
1

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1.1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
180
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
370
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.8k

Other Decks in Research

See All in Research
明日から使える！研究効率化ツール入門
Avatar for Yusuke Matsui matsui_528
13
7.5k
Sequences of Logits Reveal the Low Rank Structure of Language Models
Avatar for SansanTech sansantech
PRO
1
280
はじまりの クエスチョンブック —余暇と豊かさにあふれた社会とは？
Avatar for 立ち止まれる社会 culturaltransition
PRO
0
560
研究室単位での自律的 IPv6接続性確立に向けたAS共同運用モデルの提案と実証
Avatar for Hiroki (REO) Kashiwazaki reokashiwa
PRO
0
150
正規分布と最適化について
Avatar for koide3 koide3
1
300
Unified Audio Source Separation (Defense Slides)
Avatar for Kohei Saijo kohei_1979
1
630
Apache Gravitinoで実現する Icebergカタログ統合とアクセスの一元化
Avatar for matsumooon matsumooon
0
330
COFFEE-Japan PROJECT Impact Report（海ノ向こうコーヒー）
Avatar for 坂ノ途中 ontheslope
0
2k
Cross-Media Information Spaces and Architectures
Avatar for Beat Signer signer
PRO
0
310
Spatial Active Noise Control Based on Sound Field Interpolation Incorporating Physical Constraints
Avatar for NII S. Koyama's Lab skoyamalab
0
120
英語教育 “研究” のあり方：学術知とアウトリーチの緊張関係
Avatar for TerasawaT terasawat
1
1k
人間中心の意思決定支援AI
Avatar for Yukino Baba yukinobaba
PRO
7
3.4k

Featured

See All Featured
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
3
440
KATA
Avatar for Megan Lloyd mclloyd
PRO
35
15k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
52k
SERP Conf. Vienna - Web Accessibility: Optimizing for Inclusivity and SEO
Avatar for Sara Fernández Carmona sarafernandez
2
1.5k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
88
5.1k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
40k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.8k
The Hidden Cost of Media on the Web [PixelPalooza 2025]
Avatar for Tammy Everts tammyeverts
2
340
30 Presentation Tips
Avatar for Ian Lurie portentint
PRO
1
350
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
A brief & incomplete history of 
UX Design for the World Wide Web: 1989–2019
Avatar for Jason CranfordTeague jct
2
420
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
390

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop