IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models ...

Google's TurboQuant compression tech cuts LLM memory use by 6x with no accuracy loss

The biggest memory burden for LLMs is the key-value cache, which stores conversational context as users interact with AI ...
IEEE

An Efficient Hybrid Cache Replacement Policy for Cloud Block Storage

Abstract: With the popularity of cloud services, Cloud Block Storage (CBS) systems have been widely deployed by cloud providers. Cloud cache plays a vital role in maintaining high and stable ...
IEEE

LiC: Low-Cost Cache Replacement Algorithm for All Cache Levels

Abstract: Modern processors use caches to reduce memory access time. However, their limited size leads to frequent misses, requiring an efficient replacement policy. The Least Recently Used (LRU) ...
GitHub

neighbor-cache-example.cc

Rx pkt from 03-07-0a:01:01:01:01:c0:00 to 03-07-0a:01:01:02:09:00:00 -> (size=512) AND (seq=0 time=+1s) Rx pkt from 03-07-0a:01:01:01:01:c0:00 to 03-07-0a:01:01:02:09 ...