Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Morning Paper: foundations & frontiers

The Morning Paper: foundations & frontiers

Talk from Craft-Conf 2017

Adrian Colyer

April 28, 2017
Tweet

More Decks by Adrian Colyer

Other Decks in Research

Transcript

  1. Brain storm 01 02 05 04 rainstorm 03 5 Reasons

    to <3 Papers Thinking tools Raise Expectations Applied Lessons Order of magnitude breakthroughs Heads-up 3
  2. 4 01 02 03 04 05 Software development Distributed Systems

    & Big Data Infrastructure implications Security ML & DL
  3. $PRGXOHLVDXQLWRIZRUNDVVLJQPHQW  6KRUWHQGHYHORSPHQW WLPH  ,PSURYHV\VWHP IOH[LELOLW\  ,PSURYH XQGHUVWDQGDELOLW\!

    EHWWHURYHUDOOGHVLJQ Ɣ ,QGHSHQGHQW GHSOR\PHQW Ɣ )LQHJUDLQHGVFDOLQJ Ɣ )DXOWLVRODWLRQ
  4. Circa 1979 (& 2016!) &RPPRQ3UREOHPV  :HZHUHEHKLQGVFKHGXOHDQG ZDQWHGWRGHOLYHUDQHDUO\ UHOHDVHEXWIRXQGWKDWZH FRXOGQşWVXEVHWWKHV\VWHP

     :HZDQWHGWRDGGDVLPSOH IHDWXUHEXWIRXQGLWZRXOG KDYHUHTXLUHGUHZULWLQJDOORU PRVWRIWKHFXUUHQWFRGH  :HZDQWHGWRVLPSOLI\WKH V\VWHPE\UHPRYLQJVRPH IHDWXUHEXWWDNLQJDGYDQWDJH RILWPHDQWUHZULWLQJODUJH VHFWLRQVRIWKHFRGH  :HZDQWHGDFXVWRP GHSOR\PHQW HJLQGHYRUWHVW HQYLURQPHQWV EXWWKHV\VWHP ZDVQşWIOH[LEOHHQRXJK
  5. 22

  6. But you have BIG Data! 23 Zipf Distribution ³:RUNLQJVHWVDUH =LSIGLVWULEXWHG:HFDQ

    WKHUHIRUHVWRUHLQPHPRU\DOO EXWWKHYHU\ODUJHVW GDWDVHWV´
  7. Redundancy does not imply fault tolerance - FAST’17 27 ŸRdZ_X]VWZ]VdjdeV^WRf]eTR_

    Z_UfTVTReRdec`aYZT`feT`^VdZ_ ^`de^`UVc_UZdecZSfeVUde`cRXV djdeV^dUReR]`ddT`ccfaeZ`_ f_RgRZ]RSZ]ZejR_UZ_d`^V TRdVdeYVdacVRU`WT`ccfaeZ`_ e``eYVcZ_eRTecVa]ZTRdŹ
  8. Computing on a Human Scale 30 10ns 70ns 10ms 10s

    1:10s 116d 5HJLVWHUV // )LOHRQ GHVN 0DLQ PHPRU\ 2IILFHILOLQJ FDELQHW +'' 7ULSWRWKH ZDUHKRXVH
  9. Compute HTM Persistent Memory NI FPGA GPUs Memory NVDIMMs Persistent

    Memory Networking 100GbE RDMA Storage NVMe Next-gen NVM Next Generation Hardware All Change Please 31
  10. 2-10m Computing on a Human Scale 32 10s 1:10s 116d

    File on desk Office filing cabinet Trip to the warehouse 4x capacity fireproof local filing cabinets 23-40m Phone another office (RDMA) 3h20m Next-gen warehouse
  11. The New ~Numbers Everyone Should Know 33 Latency Bandwidth Capacity/IOPS

    Register 0.25ns L1 cache 1ns L2 cache 3ns 8MB L3 cache 11ns 45MB DRAM 62ns 120GBs 6TB - 4 socket NVRAM’ DIMM 620ns 60GBs 24TB - 4 socket 1-sided RDMA in Data Center 1.4us 100GbE ~700K IOPS RPC in Data Center 2.4us 100GbE ~400K IOPS NVRAM’ NVMe 12us 6GBs 16TB/disk,~2M/600K NVRAM’ NVMf 90us 5GBs 16TB/disk, ~700/600K
  12. No Compromises - FaRM 34 TPC-C (90 nodes) 4.5M tps

    99%ile 1.9ms KV (per node) 6.3M qps at peak throughput 41μs
  13. Making smart contracts smarter CCS ‘16 38 19,366 contracts $30M

    USD 8,833 vulnerable 27.9% 15.7% 340 83  (UURU  H[FHSWLRQ KDQGOLQJ  7UDQVDFWLRQ RUGHULQJ 5HHQWUDQF\ KDQGOLQJ 7LPHVWDPS RUGHULQJ
  14. NDSS ‘17 Thou shalt not depend on me 40 37%

    vulnerable jQuery -> 36.7%, Angular -> 40.1%
  15. lessons from Google Machine Learning Systems 42 Feature Management Visualisation

    Relative Metrics Systematic Bias Correction Alerts on action Thresholds 01 02 03 04 05
  16. Brain storm 01 02 05 04 rainstorm 03 5 Reasons

    to <3 Papers Thinking tools Raise Expectations Applied Lessons Order of magnitude breakthroughs Heads-up 46
  17. Don’t just take my word for it... 47 HYV_:eR]\e`cVdVRcTYVcdhYV_:eR]\ e`aV`a]VhR_eZ_Xe`V_XRXVZ_

    V_ecVacV_VfcdYZa:eV]]eYV^eYReZWj`f cVRUcVdVRcTYaRaVcdT`_dZdeV_e]jZW j`fdVcZ`fd]jdefUjYR]WRU`kV_aRaVcd RhVV\R_Uj`fU`eYReW`ceh`jVRcd RWeVceY`dVeh`jVRcdj`fhZ]]YRgV ]VRc_VUR]`eEYZdZdRWR_eRdeZT Z_gVde^V_eZ_j`fc`h_]`_XeVc^ UVgV]`a^V_e $QGUHZ1J ³,QVLGHWKHPLQGWKDWEXLOW*RRJOH%UDLQ´  KWWSZZZKXIILQJWRQSRVWFRPDX DQGUHZQJBQBKWPO
  18. Don’t just take my word for it... 48 :U`_Ŷe\_`hY`heYVYf^R_ScRZ_ h`c\dSfeZeŶdR]^`de^RXZTR]hYV_

    j`fcVRUV_`fXY`ceR]\e`V_`fXY ViaVcedhYV_j`fYRgVV_`fXYZ_afed _VhZUVRddeRceRaaVRcZ_X $QGUHZ1J ³,QVLGHWKHPLQGWKDWEXLOW*RRJOH%UDLQ´ KWWSZZZKXIILQJWRQSRVWFRPDXDQGUHZQJBQBKWPO
  19. A new paper every weekday Published at http://blog.acolyer.org. 01 Delivered

    Straight to your inbox If you prefer email-based subscription to read at your leisure. 02 Announced on Twitter I’m @adriancolyer. 03 Go to a Papers We Love Meetup A repository of academic computer science papers and a community who loves reading them. 04 Share what you learn Anyone can take part in the great conversation. 05