Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
440

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
980
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
130
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
300
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.5k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.3k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.5k

Other Decks in Research

See All in Research
時系列データに対する解釈可能な 決定木クラスタリング
Avatar for MIKIO KUBO mickey_kubo
2
860
Adaptive fusion of multi-modal remote sensing data for optimal sub-field crop yield prediction
Avatar for SatAI.challenge satai
3
230
20250502_ABEJA_論文読み会_スライド
Avatar for Tomoki Fujihara flatton
0
190
利用シーンを意識した推薦システム 〜SpotifyとAmazonの事例から〜
Avatar for kuri8ive kuri8ive
1
240
最適化と機械学習による問題解決
Avatar for MIKIO KUBO mickey_kubo
0
160
SSII2025 [TS1] 光学・物理原理に基づく深層画像生成
Avatar for 画像センシングシンポジウム ssii
PRO
4
4k
20250624_熊本経済同友会6月例会講演
Avatar for Traffic Brain trafficbrain
1
530
データサイエンティストの就労意識～2015→2024 一般（個人）会員アンケートより
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
840
2025年度 生成AIの使い方/接し方
Avatar for taichi_murayama hkefka385
1
750
A scalable, annual aboveground biomass product for monitoring carbon impacts of ecosystem restoration projects
Avatar for SatAI.challenge satai
3
140
Combinatorial Search with Generators
Avatar for Keisuke Okumura | 奥村圭祐 kei18
0
530
AIによる画像認識技術の進化 -25年の技術変遷を振り返る-
Avatar for Hironobu Fujiyoshi hf149
7
3.8k

Featured

See All Featured
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
267
13k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
283
13k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.7k
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
29
5.5k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
53
2.9k
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.4k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
70
11k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
26
3k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
229
22k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
134
9.5k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
695
190k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop