This website generates news articles using LLama-Node and presents them on a front-end. I'm making a video about it that will release some time in February.
Install Node.JS. Download a LLama-Node compatible model (I used airoboros-13b-gpt4.ggmlv3.q4_0.bin) and place it in the /models directory (change /generator/index.mjs if using a different file). Then run the following commands.
npm install
npm run build
npm run startThis project is vaguelly inspired by this article by Julian Bilcke. The execution is wildly different from how it's done in the article but it would feel wrong not giving it credit for the idea.