LinkedIn's data infrastructure: an overview

Talk given at the Budapest Big Data meetup, 18 November 2014. http://www.meetup.com/Big-Data-Meetup-Budapest/events/208253412/

Abstract:

LinkedIn, with over 300 million members, has surmounted some interesting scalability challenges. Many core components of LinkedIn's data infrastructure are open source, so you can benefit from them too. This talk will give an overview of the approaches and tools that have proved successful at massive scale.

Transcript

6. SIGMOD  2013.  h.p://www.slideshare.net/s_shah/the-­‐big-­‐data-­‐ecosystem-­‐at-­‐linkedin-­‐23512853  
8. SIGMOD  2013.  h.p://www.slideshare.net/amywtang/espresso-­‐20952131  
11. SOSP  2007.  h.p://www.allthingsdistributed.com/files/amazon-­‐dynamo-­‐sosp2007.pdf  
13. h.p://engineering.linkedin.com/analyNcs/real-­‐Nme-­‐analyNcs-­‐massive-­‐scale-­‐pinot  
16. h.p://engineering.linkedin.com/search/did-­‐you-­‐mean-­‐galene  
22. IEEE  Data  Engineering  BulleNn,  2012.  h.p://sites.computer.org/debull/A12june/A12JUN-­‐CD.pdf  
27. h.p://engineering.linkedin.com/stream-­‐processing/   moving-­‐faster-­‐data-­‐streams-­‐rise-­‐samza-­‐linkedin  
31. SoCC  2012.  h.p://www.socc2012.org/s18-­‐das.pdf  
42. h.p://shop.oreilly.com/product/   0636920034339.do