Improve caching for max efficiency and best UX

[nathfavour]

So the goal is to implement very rich and robust middleware to protect against abusive behaviour that puts load on database for example. While ensuring that 99% of users don't experience any friction due to these guardrails introduced.