Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
500
1

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1.1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
180
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
380
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.7k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.5k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.8k

Other Decks in Research

See All in Research
Karkada さんの論文 × 2 の紹介: (1) Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models, (2) Symmetry in language statistics shapes the geometry of model representations
Avatar for Sho Yokoi eumesy
PRO
1
740
[CV勉強会＠関東 CVPR2026] PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow / kantocv 67th CVPR 2026
Avatar for Shunsuke KITADA shunk031
0
320
Harness Engineering and Al Agent
Avatar for Kazuki Inamura kzinmr
3
2k
VLMの推論を高速化する視覚トークン削減の仕組み
Avatar for tattaka tattaka
2
310
クラウド・AI 時代の研究開発 DX / R&D Digital Transformation
Avatar for Yoshitaka Haribara hariby
0
140
多様なデータを許容し学習し続ける模倣学習 / Advanced Imitation Learning for VLA
Avatar for PRIN Lab prinlab
0
300
SoftMatcha 2: 1兆語規模コーパスの超高速かつ柔らかい検索
Avatar for Masataka YONEDA e869120_sub
7
3.8k
某助成金プロジェクト採択に向けて企業研究所のアウトリーチ専任者がやったこと
Avatar for afroscript afroscript
0
180
【ローカルAIに向き合う展示会vol.2】液体時間定数型モジュールを用いた オリジナルの双方向エンコーダーモデルNexteraBERT 推論速度向上検討並びにダウンストリーム評価
Avatar for Rikka Botan rikkabotan7
0
200
CVPR2026論文紹介_VLMにとって​良いvision encoderとは何か？​Rethinking Model Selection in VLM Through the Lens of Gromov-Wasserstein Distance​
Avatar for 小林優斗 kobayashi31
1
220
Ghost in the 7‑Zip: The Shadow of Residential Proxies Creeping into Your Life
Avatar for NTT docomo Business nttcom
0
2.1k
全国町字単位空き家率推定データver1.0データ仕様
Avatar for microbase microbaseinc
0
240

Featured

See All Featured
Leo the Paperboy
Avatar for Maya Tellez mayatellez
10
2.3k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
8.3k
It's Worth the Effort
Avatar for 3n 3n
188
29k
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1033
470k
Faster Mobile Websites
Avatar for Dean Hume deanohume
310
32k
AI: The stuff that nobody shows you
Avatar for John Nunemaker jnunemaker
PRO
10
1k
How to optimise 3,500 product descriptions for ecommerce in one day using ChatGPT
Avatar for Katarina Dahlin katarinadahlin
PRO
3
3.8k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.4k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
7k
Prompt Engineering for Job Search
Avatar for Mfonobong Umondia mfonobong
0
450
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
Avatar for Yuki Nakata chikuwait chikuwait
0
800
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
163
24k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop