I? Abhiram Ravikumar • Cloud Machine Learning Engineer, Collinson • MSc in Data Science, King’s College London • Data Science Research Fellow, SAP Labs (ex) • LinkedIn Learning (prev. Lynda) Instructor • Volunteer at DataKind Bengaluru • Loves to play badminton and listen to 80’s rock music 2 Questions or Feedback: @abhi12ravi
me.. Why BERTopic? 5 • Works on unstructured data • Takes advantage of transformer models • Offers modularity • Contextual embeddings • Flexible structure • New advancements in clustering can be adapted easily • c-TF-IDF extraction of topic representations Source: Clustering in BERTOPIC
me.. Dataset Description 8 rating date variation verified_reviews feedback 5 31-Jul-18 Charcoal Fabric Love my Echo! 1 5 31-Jul-18 Charcoal Fabric Loved it! 1 4 31-Jul-18 Walnut Finish Sometimes while playing a game, you can answer a question correctly but Alexa says you got it wrong and answers the same as you. I like being able to turn lights on and off while away from home. 1 5 31-Jul-18 Charcoal Fabric I have had a lot of fun with this thing. My 4 yr old learns about dinosaurs, i control the lights and play games like categories. Has nice sound when playing music as well. 1 5 31-Jul-18 Charcoal Fabric Music 1 5 31-Jul-18 Heather Gray Fabric I received the echo as a gift. I needed another Bluetooth or something to play music easily accessible, and found this smart speaker. Can’t wait to see what else it can do. 1 3 31-Jul-18 Sandstone Fabric Without having a cellphone, I cannot use many of her features. I have an iPad but do not see that of any use. It IS a great alarm. If u r almost deaf, you can hear her alarm in the bedroom from out in the living room, so that is reason enough to keep her.It is fun to ask random questions to hear her response. She does not seem to be very smartbon politics yet. 1 Amazon Alexa Reviews dataset - Kaggle
me.. HDBSCAN steps 10 1. Transform the space as per density 2. Build minimum spanning tree 3. Construct cluster hierarchy 4. Condense the hierarchy based on min cluster size 5. Extract stable clusters from the condensed tree Source: How HDBSCAN works
me.. HDBSCAN – strengths and weaknesses 13 • HDBSCAN focuses on high-density clustering -> reduces noise clustering problem • Min-cluster-size parameter can be set, relatively fast • Difficulty in handling large amounts of data ◦ cuML HDBSCAN speeds up HDBSCAN using GPU acceleration • Read: Comparing Python Clustering Algorithms https://hdbscan.readthedocs.io/en/latest/comparing_clustering_algorithms.html
me.. Conclusion and Future Scope 14 • BERTopic – modular, scalable, flexible • Clustering is modular • BERTopic assumption: Every document contains only one topic • Large Language Models (ChatGPT, etc.) could impact topic modeling • Be cautious of inherent biases, and ethical issues with LLMs • Online topic modeling • Cloud vendors • Operationalization