Elastic{ON} 2018 - Deep Learning & Accelerating the NLP Journey in the Unstructured World

Transcript

1. 28 Februrary 2018 Deep Learning & Accelerating the NLP Journey in the Unstructured World Jenny Chong, Global Head of eCommunications Surveillance Shahzad Chohan, Global Head of Machine Intelligence and Accelerated Computing
2. eCommunications Surveillance Deep Learning & Accelerating the NLP Journey in the Unstructured World Not for Distribution
3. Our team
4. Team Motto Empower the Art of the Impossible Empower the Art of the Impossible
5. Innovation in Surveillance The Smell of Success Agenda The Surveillance Problem
6. The Surveillance Problem
7. Let’s manipulate the market
9. Electronic Communications Surveillance Threat Analysis to mitigate risk Detect potentially malicious and fraudulent activity Detect anomalous behaviour for investigation
10. Forensics Review Resolve Ingest Filter The Surveillance Pipeline
11. Volume of Noise Months Hours Simplicity Chaos Time to Insight Matrix Time Manual Discovery
12. Innovation in Surveillance
13. Surveillance Toolkit Forensics Filter Review Resolve Entity Resolution Artemis
14. Forensics Review Resolve Ingest Filter Artemis
15. Artemis Entity Resolution Artemis Map all communications to the right person accurately Temporal view of a person’s identities across systems Canonical view of a person
16. Entity Resolution Time Volume of Noise Manual Discovery Months Hours Simplicity Chaos Artemis
17. Surveillance Toolkit Forensics Filter Review Resolve Entity Resolution Artemis Natural Language Processing Talos
18. Forensics Review Resolve Ingest Filter Artemis
19. Intelligent Filtering Deep Learning Workflow Parsing Phase Vectorising Phase Algorithmic Phase Stop Words & Stemming Word Embeddings Deep Neural Network “fix market” -> [042 312] “fix car” -> [042 911] “car park” -> [911 020] Machine Learning Workflow Potentially Malicious eComms Classified Malicious eComms “I am fixing the market” “fixing market” “fix market” “fix market” -> “Malign” “fix car” -> “Benign” “car park” -> “Benign”
20. Intelligent Filtering GPU CUDA CUBLAS Python Tensorflow/Theano Keras Magic
21. Entity Resolution Intelligent Filtering Time Volume of Noise Manual Discovery Months Hours Simplicity Chaos Artemis
22. Surveillance Toolkit Forensics Filter Review Resolve Entity Resolution Artemis Natural Language Processing Talos Alert Dashboard
23. Forensics Review Resolve Ingest Filter Artemis Alert Dashboard
24. Entity Resolution Intelligent Filtering Time Volume of Noise Manual Discovery Months Hours Simplicity Chaos Artemis Alert Dashboard
25. Surveillance Toolkit Filter Review Resolve Entity Resolution Artemis Natural Language Processing Talos Alert Dashboard Forensics Cypher Dynamic Visualization of Communication Networks
26. Forensics Review Resolve Ingest Filter Artemis Cypher Alert Dashboard
27. Entity Resolution Intelligent Filtering Time Volume of Noise Manual Discovery Months Hours Simplicity Chaos Artemis Alert Dashboard Cypher Forensics
28. Alert Dashboard Surveillance Toolkit Cypher Dynamic Visualization of Communication Networks Natural Language Processing Talos Review Entity Resolution Artemis
29. Forensics Review Resolve Ingest Filter Artemis Cypher Alert Dashboard
30. Mind the Gap! Producer Consumer Predictive Analytics Surveillance Cost Modelling Catalyst For Success Our Team Our Team
31. The Smell of Success
32. 13% Lexicon Search Logistic Regression Machine Learning Naïve Bayes Random Forest Support Vector Machine Target (12.5%) Team Target Deep Learning 37% Number of Alerts
33. Intelligence Engineering Hours Accuracy Heuristic Approaches Generic ML Model Libraries Credit Suisse Model Performance Why such a big difference? • Internal and Domain- Specific Knowledge • Algorithmic and Mathematical Expertise • Reduced time-loss in needless integration activities
34. GPU Innovation 2250 15 Mins per Execution 150 x
35. Deep Learning Toolsets Training | Inference | Emotion | Forensics
36. Over & Out
37. Unicorns are Rare Enterprise is Tough Choose Passengers Carefully Explore without Fear Ecosystem Beats Product Key Learnings
38. Team Motto Empower the Art of the Impossible Empower the Art of the Impossible
39. Deep Learning & Accelerating the NLP Journey in the Unstructured World Q & A Jenny Chong Global Head of eCommunications Surveillance Shahzad Chohan Global Head of Machine Intelligence & Accelerated Computing