AWS DynamoDB Accelerator (DAX) 101

Introduction to AWS DynamoDB Accelerator (DAX)

Transcript

1. DAX 101 1 2020/2/15 Kenju Wagatsuma
2. DAX Wrap Up 2
3. DAX is… DynamoDB-specific in-memory cache store 3
4. [DAX] Glossary of Terms 4 5FSN %FTDSJQUJPO /PEFT "
   OPEF
   JT
   UIF
   NJOJNVN
   DPNQPOFOU
   GPS
   B
   %"9
   DMVTUFS
   
   l1SJNBSZ
   OPEFz
   IBOEMF
   SFBE
   
   XSJUF
   SFRVFTUT
   BOE
   lSFQMJDB
   OPEFTz
   POMZ
   IBOEMF
   SFBE
   SFRVFTUT $MVTUFST "
   DMVTUFS
   JT
   DPNQPTFE
   GSPN
   
   OPEFT 1BSBNFUFS
   (SPVQT :PV
   DBO
   DIBOHF
   55-
   CZ
   TFUUJOH
   DVTUPN
   1BSBNFUFS
   (SPVQT
5. [DAX] Comparison to other cache store 5 %"9 &MBTUJDBDIF
   NFNDBDIFE JONFNPSZ .BOBHFE ✅ ✅  4IBSFE
   DBDIF ✅ ✅  #BDLFOE
   EBUBTPVSDF %ZOBNP%#
   POMZ BOZUIJOH
   .Z42-
   %JTL
   31$
   FUD .FUSJDT ✅ ✅  55- ⚠
   HMPCBM
   55- ✅ ⚠
   IBSE
   XPSL
   SFRVJSFE 1FSGPSNBODF Ж
   d
   NT dNT Ж
   d
   Ж
6. [DAX] Single-leader Replication 6 +3 nodes for different Multi-A/Z for production Background replication (eventually consistent model) Single “primary node” handles all write requests
7. Subnet C Subnet B DAX Cluster Subnet A [DAX] Single-leader Replication - Write 7 Primary Replica Replica
8. DAX Cluster [DAX] Single-leader Replication - Write 8 Primary Replica Replica Application DynamoDB Table DynamoDB Table Write Read
9. DAX Cluster [DAX] Single-leader Replication - Replicate 9 Primary Replica Replica Application DynamoDB Table DynamoDB Table Write Read
10. DAX Cluster [DAX] Single-leader Replication - Read 10 Primary Replica Replica Application DynamoDB Table DynamoDB Table Write Read
11. [DAX] Cache Algorithm 11 Least Recently Used (LRU) cache Negative cache also implemented Eviction happens when items are taken & cache is full Global Time-To-Live (TTL)
12. [DAX] Item Cache / Query Cache 12 Item Cache Query Cache Operation GetItem / BatchGetItem Query / Scan Metrics ItemCacheHits/ItemCacheMisses QueryCacheHits/QueryCacheMisses ScanCacheHits/ScanCacheMisses
13. [DAX] Write Strategy - Write-Through 13 #write #read Application DAX DynamoDB Application DAX DynamoDB
14. [DAX] Write Strategy - Write-Around 14 #write #read Application DynamoDB Application DAX DynamoDB
15. [DAX] Write Strategy 15 8SJUF
    5ISPVHI 8SJUF
    "SPVOE 1SPT
    4ZODISPOJ[FE
    JUFNT
    CFUXFFO
    %"9
    BOE
    %ZOBNP%#
    8SJUF
    DBO
    TDBMF
    FH
    CVML
    VQEBUF $POT ☹
    8SJUF
    PQFSBUJPO
    IBT
    PWFSIFBE
    ☹
    *UFNT
    DBO
    CF
    JODPOTJTUFOU
    JG
    PUIFS
    BQQ
    XSJUF
    UP
    %ZOBNP%#
    EJSFDUMZ ☹
    &WFOUVBMMZ
    $POTJTUFOU
    JUFNT
    JO
    %"9
    OPEFT
    DBO
    CF
    PVUEBUFE
16. [DAX] Within VPC + Multi-A/Z 16
17. [DAX] Limitation 17 Maximum nodes is 10 (1 primary node + ~9 replica nodes) Maximum nodes is 50 per Region. Maximum Parameter Groups is 20 per Region Maximum DAX Subnet Groups is 50 per Region. Maximum subnets per groups is 20.
18. Monitoring 18
19. [Monitoring] CloudWatch Metrics 19 NFUSJDT EFTDSJQUJPO $166UJMJ[BUJPO 
    PG
    $16
    VUJMJ[BUJPO
    UTNBMM
    VTF
    
    W$16
    
    ⚠
    :PV
    OFFE
    UP
    TDBMF
    VQ
    JG
    UIJT
    NFUSJDT
    JT
    TBUVSBUFE *UFN$BDIF)JUT *UFN$BDIF.JTTFT $BMDVMBUF
    $BDIF)JU3BUJP
    
    GSPN
    UIFTF
    NFUSJDT
    ⚠
    *UFN
    $BDIF
    
    2VFSZ
    $BDIF
20. [Monitoring] CloudWatch Metrics 20 NFUSJDT EFTDSJQUJPO 5ISPUUMJOH3FRVFTU$PVOU 
    PG
    SFRVFTUT
    UISPUUMFE
    CZ
    UIF
    OPEF
    PS
    DMVTUFS
    ⚠
    5ISPUUMFE
    BU
    %"9
    
    5ISPUUMFE
    BU
    %ZOBNP%# 'BJMFE3FRVFTU$PVOU 
    PG
    SFRVFTUT
    UIBU
    SFTVMUFE
    JO
    BO
    FSSPS
    SFQPSUFE
    ⚠
    &SSPS3FR$PVOU
    
    5ISPUUMFE
    
    'BJMFE
21. [Monitoring] CloudWatch Metrics 21 NFUSJDT EFTDSJQUJPO &WJDUFE4J[F ⚠
    *G
    $BDIF)JU3BUJP
    
    &WJDUFE4J[F
    JT
    HSPXJOH
    UIF
    XPSLJOH
    TFU
    NJHIU
    JODSFBTF
    4IPVME
    DPOTJEFS
    TDBMFVQ $MJFOU$POOFDUJPOT 
    PG
    TJNVMUBOFPVT
    DPOOFDUJPOT
    GSPN
    DMJFOUT
    ⚠
    $MJFOU$PO$PVOU
    㲈
    
    PG
    3VOOJOH
    5BTLT
22. [Monitoring] Grafana 22
23. [Monitoring] SLI/SLO 23
24. Alerting 24
25. [Alerting] CW Alarm - Infrastructure 25 CW Alarm SNS Topic Lambda Slack
26. [Alerting] CW Alarm - CPUUtilization 26
27. [Alerting] CW Alarm - Cache Hit Ratio 27 ItemCacheHitRatio = ItemCacheHits / ( ItemCacheHits + ItemCacheMisses )
28. [Alerting] CW Alarm - Cache Hit Ratio 28
29. [Alerting] DAX Events - Infrastructure 29 DAX Event SNS Topic Lambda Slack
30. [Alerting] DAX Events - Infrastructure 30 failure/success in adding a node changes to the security groups