Experiments show that an on disk cache compresses very well.
A 105MB cached payload compressed to 272KB with zip and 79KB with bzip2.
zip compression was much faster so seems like a good thing to implement.
The total cache size was 1.5GB and it came down to about 4MB after zip compression which is very manageable.