Skip to content

Commit ff36010

Browse files
mudlergithub-actions[bot]
authored andcommitted
chore(model gallery): 🤖 add new models via gallery agent
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
1 parent 7abc024 commit ff36010

File tree

1 file changed

+25
-0
lines changed

1 file changed

+25
-0
lines changed

gallery/index.yaml

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,29 @@
11
---
2+
- name: "thestoryteller-12b-i1"
3+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+
urls:
5+
- https://huggingface.co/mradermacher/TheStoryteller-12B-i1-GGUF
6+
description: |
7+
The model `TheStoryteller-12B` is a 12-billion parameter language model trained for storytelling tasks. It uses a quantized version (e.g., Q2_K, IQ3_M) for efficient deployment, but the base model (unquantized) is available at `huggingface.co/lordalbior/TheStoryteller-12B`. The quantized version is optimized for inference but may differ slightly from the original model's capabilities. For model gallery purposes, this is a compressed version for practical use.
8+
overrides:
9+
parameters:
10+
model: llama-cpp/models/TheStoryteller-12B.i1-Q4_K_M.gguf
11+
name: TheStoryteller-12B-i1-GGUF
12+
backend: llama-cpp
13+
template:
14+
use_tokenizer_template: true
15+
known_usecases:
16+
- chat
17+
function:
18+
grammar:
19+
disable: true
20+
description: Imported from https://huggingface.co/mradermacher/TheStoryteller-12B-i1-GGUF
21+
options:
22+
- use_jinja:true
23+
files:
24+
- filename: llama-cpp/models/TheStoryteller-12B.i1-Q4_K_M.gguf
25+
sha256: 4af5ffd111e7b1a8e61b6f14de3f886636d9e37d656692907c643d672dda3c25
26+
uri: https://huggingface.co/mradermacher/TheStoryteller-12B-i1-GGUF/resolve/main/TheStoryteller-12B.i1-Q4_K_M.gguf
227
- name: "mistral-nemo-instruct-2407-12b-thinking-m-claude-opus-high-reasoning-i1"
328
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
429
urls:

0 commit comments

Comments
 (0)