This web site has an interesting visualization of the latency of accessing data from caches and from memory.