Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
490
1

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
170
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
350
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.7k

Other Decks in Research

See All in Research
通時的な類似度行列に基づく単語の意味変化の分析
Avatar for hajime kiyama rudorudo11
0
230
データサイエンティストの業務変化
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
340
言語モデルから言語について語る際に押さえておきたいこと
Avatar for Sho Yokoi eumesy
PRO
5
2k
離散凸解析に基づく予測付き離散最適化手法 (IBIS '25)
Avatar for Taihei OKI taihei_oki
PRO
1
740
Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning
Avatar for SatAI.challenge satai
3
720
「行ける・行けない表」による地域公共交通の性能評価
Avatar for 萬創社 bansousha
0
130
世界モデルにおける分布外データ対応の方法論
Avatar for Hidehisa Arai koukyo1994
7
2k
Unified Audio Source Separation (Defense Slides)
Avatar for Kohei Saijo kohei_1979
1
550
ドメイン知識がない領域での自然言語処理の始め方
Avatar for Hayahide Yamagishi hargon24
1
280
AIスーパーコンピュータにおけるLLM学習処理性能の計測と可観測性 / AI Supercomputer LLM Benchmarking and Observability
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
1
790
非試合日の野球場を楽しむためのARホームランボールキャッチ体験システムの開発 / EC79-miyazaki
Avatar for yumulab yumulab
0
100
Tiaccoon: Unified Access Control with Multiple Transports in Container Networks
Avatar for Hiroya Onoe hiroyaonoe
0
1.4k

Featured

See All Featured
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
280
Embracing the Ebb and Flow
Avatar for Simon Collison colly
88
5k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
20k
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
Code Reviewing Like a Champion
Avatar for maltzj maltzj
528
40k
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
160
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
463
34k
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
90
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
49
3.4k
Navigating Algorithm Shifts & AI Overviews - #SMXNext
Avatar for Aleyda Solis aleyda
1
1.2k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop