SLIDE 1
CACHING BEYOND RAM CACHING BEYOND RAM memcached.org/blog @dormando - - PowerPoint PPT Presentation
CACHING BEYOND RAM CACHING BEYOND RAM memcached.org/blog @dormando - - PowerPoint PPT Presentation
CACHING BEYOND RAM CACHING BEYOND RAM memcached.org/blog @dormando WHY RAM? WHY RAM? Identical Cache W W W Broadcast Invalidation W W W MC HASH(key) MC 1G RAM 4G RAM W DB 32bit OS! 4G RAM 4G RAM W DB Filled Empty RAM Slots
SLIDE 2
SLIDE 3
W W W
Identical Cache
SLIDE 4
W W W
Broadcast Invalidation
SLIDE 5
MC MC
HASH(key)
SLIDE 6
W DB
1G RAM 4G RAM 32bit OS!
SLIDE 7
W DB
4G RAM 4G RAM Filled Empty RAM Slots
SLIDE 8
W DB
16G RAM 4G RAM
W W W
SLIDE 9
ENTER FLASH ENTER FLASH
SLIDE 10
FLASH! NOT JUST FOR HEAVY FLASH! NOT JUST FOR HEAVY MACHINERY MACHINERY
SLIDE 11
X25-M 80G IOPS: 35k read, 300 write X25-E 64G IOPS: 35k read, 3300 write
SLIDE 12
V LB
RAM cache! Sticky L7
V V V
SLIDE 13
SLIDE 14
LB
Flash Cache! Sticky L7
V V
X25-E X25-E
SLIDE 15
BAM! BAM! CDN CDN
SLIDE 16
GOOD (ENOUGH) SSD'S ARE GOOD (ENOUGH) SSD'S ARE EVERYWHERE EVERYWHERE
SLIDE 17
TRADEOFFS TRADEOFFS
SLIDE 18
Moneta [SET] REND MC STORE
SLIDE 19
Moneta [MISS] REND MC STORE
SLIDE 20
Moneta [MISS] REND MC STORE
SLIDE 21
Moneta [MISS] REND MC STORE
SLIDE 22
CACHE -> DB -> DB CACHE -> DB -> DB
SLIDE 23
ARE SMALL ITEMS VALUABLE ON DISK ARE SMALL ITEMS VALUABLE ON DISK CACHE? CACHE?
SLIDE 24
NO. NO.
SLIDE 25
MEMCACHED EXTSTORE MEMCACHED EXTSTORE
SLIDE 26
RAM DISK
* metadata * key * pointer * metadata * key * value
SLIDE 27
RAM HEAD TAIL Write Buffer DISK
SLIDE 28
Bad: Still limited by RAM. Good: Much less writing, consistent reads.
SLIDE 29
WORKLOADS WORKLOADS
ML facts / computed data / templated data Sessions :P Saving the 50% of RAM used in 8k+ items
SLIDE 30
FUTURE FUTURE
SLIDE 31
JBOD [JUST A BUNCH OF JBOD [JUST A BUNCH OF DEVICES] DEVICES]
memcached -o ext_path=/m/f:64g,ext_path=/m2/f:64g
SLIDE 32
TIERED STORAGE TIERED STORAGE
github.com/memcached/memcached/pull/432 ext_path=/m/f:64g:compact ext_path=/m/f:64g:lowttl
SLIDE 33
PERSISTENT MEMORY PERSISTENT MEMORY
HTABLE VALUES
SLIDE 34
WRAP UP: PERFORMANCE WRAP UP: PERFORMANCE
SLIDE 35
99
SLIDE 36
SLIDE 37
SLIDE 38
SLIDE 39