Micro-Blogging for The Enterprise (MongoDB)

Transition from relational structure to MongoDB

Transcript

1. MICRO-BLOGGING FOR THE ENTERPRISE Sunday, September 16, 12
2. Who Am I Sunday, September 16, 12
3. Amit Kumar Who Am I Sunday, September 16, 12
4. Amit Kumar Consultant and Rubyist Who Am I Sunday, September 16, 12
5. Amit Kumar Consultant and Rubyist TATA Consultancy Services Limited Who Am I Sunday, September 16, 12
6. Amit Kumar Consultant and Rubyist TATA Consultancy Services Limited twitter.com/toamit Who Am I Sunday, September 16, 12
7. Amit Kumar Consultant and Rubyist TATA Consultancy Services Limited twitter.com/toamit github.com/toamitkumar Who Am I Sunday, September 16, 12
8. AGENDA Sunday, September 16, 12
9. AGENDA Micro-Blogging for “The Enterprise” Sunday, September 16, 12
10. AGENDA Micro-Blogging for “The Enterprise” Relational DB Structure Sunday, September 16, 12
11. AGENDA Micro-Blogging for “The Enterprise” Relational DB Structure Performance issues Sunday, September 16, 12
12. AGENDA Micro-Blogging for “The Enterprise” Relational DB Structure Performance issues Caching? Sunday, September 16, 12
13. AGENDA Micro-Blogging for “The Enterprise” Relational DB Structure Performance issues Caching? MongoDB Sunday, September 16, 12
14. AGENDA Micro-Blogging for “The Enterprise” Relational DB Structure Performance issues Caching? MongoDB Hybrid Approach Sunday, September 16, 12
15. What Micro-Blogging Mean To Enterprise Sunday, September 16, 12
16. Sunday, September 16, 12
17. Sunday, September 16, 12
18. Sunday, September 16, 12
19. Sunday, September 16, 12
20. Enterprise Demands Sunday, September 16, 12
21. Message threads (Facebook like experience) Enterprise Demands Sunday, September 16, 12
22. Message threads (Facebook like experience) Activities of follower list Enterprise Demands Sunday, September 16, 12
23. Message threads (Facebook like experience) Activities of follower list Two timelines Enterprise Demands Sunday, September 16, 12
24. Message threads (Facebook like experience) Activities of follower list Two timelines Individual Enterprise Demands Sunday, September 16, 12
25. Message threads (Facebook like experience) Activities of follower list Two timelines Individual Public Enterprise Demands Sunday, September 16, 12
26. Message threads (Facebook like experience) Activities of follower list Two timelines Individual Public Filtering messages (role/office etc) Enterprise Demands Sunday, September 16, 12
27. Timeline Sunday, September 16, 12
28. Timeline Sunday, September 16, 12
29. Timeline Sunday, September 16, 12
30. Timeline Sunday, September 16, 12
31. Timeline Sunday, September 16, 12
32. Timeline Sunday, September 16, 12
33. Relational DB Structure Sunday, September 16, 12
34. Traditional Relational Design Sunday, September 16, 12
35. Traditional Relational Design Sunday, September 16, 12
36. Traditional Relational Design Sunday, September 16, 12
37. Enterprise Demands - II Sunday, September 16, 12
38. Enterprise Demands - II Most popular posts Sunday, September 16, 12
39. Enterprise Demands - II Most popular posts Hash-tags (#hashtag) Sunday, September 16, 12
40. Enterprise Demands - II Sunday, September 16, 12
41. Enterprise Demands - II Ability to follow hash-tags Sunday, September 16, 12
42. Enterprise Demands - II Ability to follow hash-tags Sunday, September 16, 12
43. Enterprise Demands - II Sunday, September 16, 12
44. Enterprise Demands - II Activity on hash-tag flow to timeline Sunday, September 16, 12
45. Enterprise Demands - II Activity on hash-tag flow to timeline Sunday, September 16, 12
46. Enterprise Demands - II Activity on hash-tag flow to timeline Sunday, September 16, 12
47. Enterprise Demands - II Activity on hash-tag flow to timeline Sunday, September 16, 12
48. Enterprise Demands - II Sunday, September 16, 12
49. Hash-tag on comment will tag the whole thread Enterprise Demands - II Sunday, September 16, 12
50. Hash-tag on comment will tag the whole thread Enterprise Demands - II Sunday, September 16, 12
51. Traditional Relational Design Sunday, September 16, 12
52. Traditional Relational Design Sunday, September 16, 12
53. Traditional Relational Design Sunday, September 16, 12
54. Traditional Relational Design Sunday, September 16, 12
55. COMPLEX AND UNMAINTAINABLE CODE Sunday, September 16, 12
56. COMPLEX AND UNMAINTAINABLE CODE Sunday, September 16, 12
57. COMPLEX AND UNMAINTAINABLE CODE Sunday, September 16, 12
58. COMPLEX AND UNMAINTAINABLE CODE Sunday, September 16, 12
59. COMPLEX AND UNMAINTAINABLE CODE Sunday, September 16, 12
60. PERFORMANCE DEGRADES WITH INCREASING DATA VOLUME Sunday, September 16, 12
61. Performance Benchmark Sunday, September 16, 12
62. Performance Benchmark SQL query benchmarks Sunday, September 16, 12
63. Performance Benchmark SQL query benchmarks 10,000,000 messages Sunday, September 16, 12
64. Performance Benchmark SQL query benchmarks 10,000,000 messages 200,000,000 comments Sunday, September 16, 12
65. Performance Benchmark SQL query benchmarks 10,000,000 messages 200,000,000 comments 50,000,000 message likes 2 4 8 10 12 0 750 1500 2250 3000 Response ms in millions Sunday, September 16, 12
66. Caching? (Redis) Sunday, September 16, 12
67. Caching Solution Like Sunday, September 16, 12
68. Caching Solution Like Break point in Architecture Sunday, September 16, 12
69. Caching Solution Like Break point in Architecture No Query Interface Sunday, September 16, 12
70. Caching Solution Like Break point in Architecture No Query Interface No clustering support Sunday, September 16, 12
71. Caching Solution Like Break point in Architecture No Query Interface No clustering support More messy code Sunday, September 16, 12
72. A Document Based DB? Sunday, September 16, 12
73. A Document Based DB? Activity threads are like nested “DOCUMENTS” Sunday, September 16, 12
74. Sunday, September 16, 12
75. Sunday, September 16, 12
76. Sunday, September 16, 12
77. One Document Sunday, September 16, 12
78. A Document Based DB? Sunday, September 16, 12
79. A Document Based DB? Storing them as relational structure Sunday, September 16, 12
80. A Document Based DB? Storing them as relational structure Converting them back to documents Sunday, September 16, 12
81. A Document Based DB? Storing them as relational structure Converting them back to documents Store them as “Activity Documents” Sunday, September 16, 12
82. Sunday, September 16, 12
83. Why MONGODB? Sunday, September 16, 12
84. Why MONGODB? It is Cool Sunday, September 16, 12
85. Hybrid Approach (Relational DB + MongoDB) Sunday, September 16, 12
86. Hybrid Approach Sunday, September 16, 12
87. Hybrid Approach Sunday, September 16, 12
88. Architecture Sunday, September 16, 12
89. Architecture Sunday, September 16, 12
90. Data Migration From Relational DB TO MongoDB WAS EASY!! Sunday, September 16, 12
91. Performance Benchmark SQL MongoDB Sunday, September 16, 12
92. Performance Benchmark 2 4 8 10 12 0 750 1500 2250 3000 SQL QUERY vs MongoDB Response in ms in millions SQL MongoDB Sunday, September 16, 12
93. Sunday, September 16, 12
94. Simple, Clean Sunday, September 16, 12
95. Simple, Clean And Sunday, September 16, 12
96. Simple, Clean And Maintainable Code Sunday, September 16, 12
97. Simple, Clean And Maintainable Code BUT WAIT !!! Sunday, September 16, 12
98. Simple, Clean And Maintainable Code BUT WAIT !!! TRANSACTION?? Sunday, September 16, 12
99. Transaction Management Sunday, September 16, 12
100. Transaction Management Sunday, September 16, 12
101. Scaling with MongoDB Sunday, September 16, 12
102. Scaling with MongoDB Indexing Sunday, September 16, 12
103. Scaling with MongoDB Indexing Sharding? Sunday, September 16, 12
104. Scaling with MongoDB Indexing Sharding? 8 GB of Data Sunday, September 16, 12
105. Monitoring Mongos mongostat Http Console (localhost:28017) Sunday, September 16, 12
106. Monitoring Mongos Sunday, September 16, 12
107. Relational DB And MongoDB Live In Harmony Together Sunday, September 16, 12
108. Relational DB And MongoDB Live In Harmony Together Sunday, September 16, 12
109. THANK YOU Sunday, September 16, 12