Skip to content

Conversation

@Granitosaurus
Copy link

Add policy for scrapy's http caching that will refuse caching of banned responses as per #20

@Granitosaurus Granitosaurus changed the title add BanAwareCachePolicy for http caching WIP: add BanAwareCachePolicy for http caching May 15, 2019
@Granitosaurus
Copy link
Author

I'm not sure how should we cover multiple policies? Should we just wrap the two default policies that scrapy has (RFC2616Policy and DummyPolicy) or maybe we should extend HttpCacheMiddleware this way all policies would be supported?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant