Now we use less memory

Now we use less memory for caches in CI and have better tests for eviction. #84676 (alesapin).