Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
450

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
990
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
140
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
310
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.5k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.3k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.5k

Other Decks in Research

See All in Research
MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation
Avatar for SatAI.challenge satai
4
280
なめらかなシステムと運用維持の終わらぬ未来 / dicomo2025_coherently_fittable_system
Avatar for monochromegane monochromegane
0
3.4k
EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues
Avatar for SatAI.challenge satai
3
200
診断前の病歴テキストを対象としたLLMによるエンティティリンキング精度検証
Avatar for Takashi Nishibayashi hagino3000
1
140
Galileo: Learning Global & Local Features of Many Remote Sensing Modalities
Avatar for SatAI.challenge satai
3
330
EarthSynth: Generating Informative Earth Observation with Diffusion Models
Avatar for SatAI.challenge satai
3
340
20250624_熊本経済同友会6月例会講演
Avatar for Traffic Brain trafficbrain
1
640
SSII2025 [TS3] 医工連携における画像情報学研究
Avatar for 画像センシングシンポジウム ssii
PRO
3
1.3k
SSII2025 [SS1] レンズレスカメラ
Avatar for 画像センシングシンポジウム ssii
PRO
2
1.1k
Time to Cash: The Full Stack Breakdown of Modern ATM Attacks
Avatar for D ratatata
0
160
ip71_contraflow_reconfiguration
Avatar for SatokiMasuda stkmsd
0
100
多言語カスタマーインタビューの“壁”を越える~PMと生成AIの共創~ 株式会社ジグザグ 松野 亘
Avatar for Wataru Matsuno watarumatsuno
0
130

Featured

See All Featured
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
1.6k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
330
21k
Navigating Team Friction
Avatar for Lara Hogan lara
189
15k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
231
18k
It's Worth the Effort
Avatar for 3n 3n
187
28k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
352
21k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
368
20k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
185
22k
A better future with KSS
Avatar for Kyle Neath kneath
239
17k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
188
55k
Designing Experiences People Love
Avatar for Jonathan Moore moore
142
24k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop