The idea is to reduce the chance of something being cached to improve the hit ratio of those items in the cache. Instead of having say a 100% chance of an item being stored in the cache it instead only has say a 1% chance of being cached meaning on average it will only be cached after being access 100 times.
I don't have access to a large system anymore, so I lack the ability to test my hypothesis, was wondering if anyone has tried not caching things as a means to improving their cache hit ratio and if it worked?
Thoughts?
Most policies try to minimize the impact of low frequency items. For example SLRU uses a small probation space that promotes to a protected region if re-accessed. This allows quickly discarding low frequent items. ARC uses an adaptive version of this idea.
LIRS uses a very small region (HIR) that promotes to a large region (LIR) based in the inter-reference period. This allows it to discard many new arrivals by using a large number of ghosts to retain usage history.
TinyLFU is a probabilistic LFU filter that decides whether to admit by comparing the frequency of the arrival to the victim. This is often near optimal, but can suffer due to sparse bursts causing consecutive misses. An admission window (W-TinyLFU) resolves this problem, usually with a 1% window.
I have a simulator and traces that you could easily add onto to experiment. [1]
I recommend reading the TinyLFU paper as I think it is the best match to your ideas. [2]
[1] https://github.com/ben-manes/caffeine [2] http://arxiv.org/pdf/1512.00727.pdf