Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Turn Email into Data with Deep Learning (Plus O...

Turn Email into Data with Deep Learning (Plus Other Industry Tasks with Gensim Topic Modeling)

Slides presented at LT-Accelerate 2016

Lev Konstantinovskiy

November 21, 2016
Tweet

More Decks by Lev Konstantinovskiy

Other Decks in Programming

Transcript

  1. About Lev Konstantinovskiy @teagermylk [email protected] NLP consultant at RaRe Technologies

    Community manager of Gensim Open Source Project Background in Financial Trading and Mathematics
  2. Client: publicly traded mass media company Business problem: How is

    the CELEBRITY content driving revenue this month? Technical problem: search. Find all CELEBRITY articles Which keywords to search for?
  3. Remove “Hannah Montana” keyword in 2011. Add “Miley Cyrus” back

    in 2012. Technical problem: find all CELEBRITY articles Which keyword to search for? Google Trends Maintaining keywords is expensive
  4. Better solution An algorithm can group together the words that

    appear together. “You shall know a word by the company it keeps” John Firth 1957 We call these groups of words Topics.
  5. Gensim Open Source Package • Numerous Industry Adopters • 140

    Code contributors, 3000 Github stars • 200 Messages per month on the mailing list • 100 People chatting on Gitter • 380 Academic citations
  6. The Gensim algorithm block is nice, but... How to apply

    it to my domain? (media, HR, legal etc) How to integrate with my analytics suite? The business value is in the application. How to have a view of my business? increasing resource efficiency is nicer. How to make it robust?
  7. ScaleText User-friendly topic modelling solution Any File Type Slice into

    coherent sections Plain text Metadata Deep Learning Semantic Model Topics Specific modules for media, HR, legal The business value is in the application
  8. Business problem: extract data from truck reports Content: A truck

    of type “Englewood” owned by ForestCo left Cold Stream forest on 26 August for the mill in Enderby carrying 140 logs of wood at the rate of $10k. In an email it looks like this: ENGLEWOOD 140 26/08 Cold Stream/Enderby 10k ForestCo
  9. Problem: Constantly changing 100 formats In an email it looks

    like this: ENGLEWOOD 140 26/08 Cold Stream/Enderby 10k ForestCo Sometimes like this: 26/08 ENGLEWOOD ForestCo 140 Cold Stream to Enderby at 10k Or even like this: ForestCo Cold Stream==Enderby 26/08 ENGLEWOOD 140 - 10k Would you like to maintain 100 changing regexes?
  10. End-to-end learning of semantic role labeling using recurrent neural networks

    Zhou & Xu International joint conference on Natural Language Processing, 2015 Model: Deep bi-directional LSTM network
  11. Task: Character-level annotation L244:ENGLEWOOD 140 26/08 Cold Stream/Enderby 10k ForestCo

    Pred:vvvvvvvvv--------qqq---tt-tt--lllllllllll-uuuuuuu------rrr------cccccccc Labels: [u]nloading, [l]oading, [c]ompany, [t]ime, [r]ate, [v]ehicle, [-]junk_field, [q]uantity
  12. Deep Learning Tricks Trick: generate canned data to supplement manual

    annotations Result: increase accuracy by 20%
  13. Model Performance Business value: no manual labor to maintain 100

    regexes anymore. Performance metric: only exact match in all characters is valuable to the client. When confidence is low - ask a human. Human in the loop alerting on: 5% lines Accuracy achieved: 96% of lines match exactly on every character.
  14. Business metrics more important than algos and code - Algorithms

    don’t know how to drive value - Open source software is only a part of the solution - Achieving business goals requires an entire production class ML application We do theoretical papers, practical software… but most of all we believe in executing on Business metrics.
  15. RARE Training •customized, interactive corporate training hosted on-site for technical

    teams of 5-15 developers, engineers, analysts and data scientists •2-day intensives include Tensorflow Training, Python Best Practices and Practical Machine Learning, and 1-day intensive Topic Modelling RNDr. Radim Řehůřek, Ph.D. Gordon Mohr, BA in CS & Econ industry-leading instructors for more information email [email protected]
  16. Q&A Lev Konstantinovskiy If you need help with solving your

    business problems or Training [email protected] Twitter @teagermylk