Elastic{ON} 2018 - Lessons Learned from Workday's Search Application Journey from POC to Production

Transcript

1. Workday February 28, 2018 https://github.com/Workday Lessons Learned from A Search Application POC to Production Journey Angela Juang, Tech Lead Search Madhura Dudhgaonkar, Head of Search/ML
2. This presentation may contain forward-looking statements for which there are risks, uncertainties, and assumptions. If the risks materialize or assumptions prove incorrect, Workday’s business results and directions could differ materially from results implied by the forward-looking statements. Forward-looking statements include any statements regarding strategies or plans for future operations; any statements concerning new features, enhancements or upgrades to our existing applications or plans for future applications; and any statements of belief. Further information on risks that could affect Workday’s results is included in our filings with the Securities and Exchange Commission which are available on the Workday investor relations webpage: www.workday.com/company/investor_relations.php Workday assumes no obligation for and does not intend to update any forward-looking statements. Any unreleased services, features, functionality or enhancements referenced in any Workday document, roadmap, blog, our website, press release or public statement that are not currently available are subject to change at Workday’s discretion and may not be delivered as planned or at all. Customers who purchase Workday, Inc. services should make their purchase decisions upon services, features, and functions that are currently available. Safe Harbor Statement
3. Introductions Workday Confidential Angela Juang Tech Lead Search, Workday
4. Workday Confidential Elasticon 2017!
5. Creating things that delight people Workday Confidential
6. Creating things that delight people Workday Confidential
7. Creating things that delight people Workday Confidential
8. Workday Search Creating things that delight people Workday Confidential
9. Introductions Workday Confidential Madhura Dudhgaonkar Head of Search/ML, Workday
10. Mar 2009 - March 2006
11. Mar 2009 - March 2009 Mt. Denali | 20,320 ft | 6,194 m
12. Mar 2009 - March 2009 The Crazy Ones!
13. March 2009 - June 2010
14. July 2010
15. Mar 2009 - Audacious Goals Accelerated Learning and Mastery!
16. Workday Confidential Happy Madhura!
17. The Enterprise Cloud for Finance and HR Workday Confidential
18. Search and Machine Learning Teams San Francisco Dublin, Ireland Pleasanton Workday Confidential
19. Search @ Workday Recruiting Recruiting Search Relevance Workday Confidential 2007-2011 2012-2014 2015-2018
20. Mar 2009 - 2014 - Recruiting search needs upgrade Workday Confidential
21. Workday Confidential Options..Options..
22. Choice Workday Confidential
23. Search Relevance Search Scale
24. Search Relevance
25. scala & search & senior developer & (San Francisco or San Mateo or Dublin, Ireland) & enterprise software & file systems & distributed systems & query latency tuning Workday Confidential What Customers Told
26. Workday Confidential User Research
27. Angela Juang java Madhura Dudhgaonkar senior developer & scala Megan Gates Workday Confidential
28. Name Job Title Skill Workday Confidential They Cared About
29. Workday Confidential More User Research
30. Angela Gates 10 of 10000 Angela Juang Srini Nithyanandan Angela Gates . . Workday Confidential
31. Angela Gates & scala 10 of 5000 Angela Juang Jas Singh Angela Gates . . Workday Confidential
32. Angela Gates & scala & senior developer 10 of 2000 Angela Juang Jas Singh John Washington Angela Gates . Workday Confidential
33. Workday Confidential Eureka!
34. Workday Confidential Deep Search Find oysters (no rocks/fish) - Precision
35. Workday Confidential Shallow Search Find a pearl oyster in top 3-5 - Ranking
36. Solve the Right Search Problem
37. Workday Confidential Tune Precision and Victory
38. Workday Confidential
39. Angela Gates & scala & senior developer 10 of 500 Angela Juang Jas Singh John Washington Angela Gates . Workday Confidential
40. Workday Confidential What Is Going On?
41. Workday Confidential Spelunking Began
42. Job Application Form: Name * Skills Title Attachments * Workday Confidential
43. Cover Letters Resumes Portfolio docs Workday Confidential Nothing in Structured Fields!
44. John Washington 10 of 2000 John Singh (Ref: John Washington) John Washington Angela Gates (John Hopkins University) . . Workday Confidential
45. Workday Confidential Doc Parsing to Rescue
46. Angela Gates & scala & senior developer 10 of 20 Angela Gates Angela Juang Jas Singh John Washington . Workday Confidential
47. Check Data Quality Early! Garbage in, Garbage out. Workday Confidential
48. Total Results Workday Confidential Total Results
49. Precision @50 Workday Confidential Precision @50
50. Ndcg for Ranking Workday Confidential Ndcg for Ranking
51. Search Scale
52. Tenant Index Workday Confidential
53. Workday Confidential
54. Workday Confidential Unmanageable Indices
55. Workday Confidential
56. Workday Confidential
57. Understand your data and growth patterns! Workday Confidential
58. Cluster State Size: Before & After Workday Confidential Cluster State Size: Before & After
59. Workday Confidential Security
60. 22 TB JVM heap <= 30GB per data node 734 data nodes (minimum!) Workday Confidential
61. Workday Confidential Outage Scenario
62. Workday Confidential
63. https://github.com/Workday/elasticrypt Workday Confidential
64. Plan for the unknown! Workday Confidential
65. But don’t reinvent the wheel. Workday Confidential
66. If you do invent, share it! :) Workday Confidential
67. Workday Confidential
68. Workday Confidential
69. • Solve the right search problem • Check data quality early • Understand the characteristics of your data and growth patterns • Plan for the unknown Workday Confidential In Summary
70. We Are Hiring! Distributed systems engineer Elasticsearch engineer Search engineer Data scientist Machine Learning engineer Deep learning engineer Workday Confidential
71. TM Thank You