Knowledge curation

[Daspony]

Hi, is there currently any way to clean or curate the database? I’ve noticed that a lot of irrelevant content is generated after running the web crawler.

[Zebastjan]

I'm doing a lot of work on the ingestion pipeline on my fork, which I'll be doing pull requests for back to the main project. And so a lot of the work I'm doing touches on curation. And actually, I want to add a mechanism to share knowledge sets over IPFS. Did you have any particular ideas regarding curation tools? I've got ideas about sanity checking, which is important. But sanity checking is not quite the same as curation.