Skip to content

Commit f5a4da1

Browse files
committed
doc: add feature Prompting Creator in the roadmap
1 parent 1da9469 commit f5a4da1

1 file changed

Lines changed: 16 additions & 7 deletions

File tree

README.md

Lines changed: 16 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -165,7 +165,7 @@ export GI_MODELS_DIR=/path1:/path2:/path3
165165
```
166166
167167
`GI_MODELS_DIR` is the root path where your models are stored.
168-
`goinfer will search `*.gguf` files within all `GI_MODELS_DIR` sub-folders.
168+
`goinfer` will search `*.gguf` files within all `GI_MODELS_DIR` sub-folders.
169169
So you can organize your models within a folders tree.
170170
171171
The other environment variables are:
@@ -252,8 +252,8 @@ metricsMaxInMemory: 1000 # maximum number of metrics to keep in memory
252252
startPort: 6000 # first ${PORT} incremented for each model
253253
254254
macros: # macros to reduce common conf settings
255-
cmd-fim: /home/me/llama.cpp/build/bin/llama-server --props --no-warmup --no-mmap --verbose-prompt --jinja
256-
cmd-common: ${cmd-fim} --port ${PORT}
255+
cmd-fim: /home/me/llama.cpp/build/bin/llama-server --props --no-warmup --no-mmap --verbose-prompt
256+
cmd-common: ${cmd-fim} --jinja --port ${PORT}
257257
cmd-goinfer: ${cmd-common} --chat-template-file template.jinja
258258
259259
models:
@@ -445,8 +445,7 @@ You receive a JSON response generated by the model running on your GPU rig.
445445
### March 2023
446446
447447
In March 2023, [Goinfer](https://github.com/LM4eu/goinfer)
448-
was an early local LLM proxy swapping models and supporting
449-
Ollama, Llama.cpp, and KoboldCpp.
448+
was an early local LLM proxy swapping models and supporting Ollama, Llama.cpp, and KoboldCpp.
450449
Goinfer has been initiated for two needs:
451450
452451
1. to swap engine and model at runtime, something that didn’t exist back then
@@ -519,19 +518,29 @@ Manage the OpenRouter API key of a AI-powered frontend.
519518
520519
> **contribute** – If you’re interested in any of the above, open an issue or submit a PR :)
521520
521+
### Prompting creator UI
522+
523+
Integrate a Web UI to ease creation of multi-step AI agents like:
524+
525+
- [github/synw/agent-smith](https://github.com/synw/agent-smith)
526+
- [n8n](https://n8n.io/)
527+
- [flowiseai](https://flowiseai.com/)
528+
- tools from [github/HKUDS](https://github.com/HKUDS)
529+
530+
The angentic prompt syntax [YALP](https://yapl-language.github.io) and its [VS-Code extension](https://github.com/yapl-language/yapl-vscode) authored by two Germans: [Nils Abegg](https://github.com/nilsabegg) et [einfachai](https://github.com/einfachai) (see also [einfachai.com](https://einfachai.com)).
531+
522532
### Nice to have
523533
524534
Some inspiration to extend the Goinfer stack:
525535
526536
- [`compose.yml`](./compose.yml) with something like [github/j4ys0n/local-ai-stack](https://github.com/j4ys0n/local-ai-stack) and [github/LLemonStack/llemonstack](https://github.com/LLemonStack/llemonstack)
527-
- Multi-step AI agents like [github/synw/agent-smith](https://github.com/synw/agent-smith), [n8n](https://n8n.io/), [flowiseai](https://flowiseai.com/), tools from [github/HKUDS](https://github.com/HKUDS)
528537
- WebUI [github/oobabooga/text-generation-webui](https://github.com/oobabooga/text-generation-webui), [github/danny-avila/LibreChat](https://github.com/danny-avila/LibreChat), [github/JShollaj/Awesome-LLM-Web-UI](https://github.com/JShollaj/Awesome-LLM-Web-UI)
529538
- Vector Database and Vector Search Engine [github/qdrant/qdrant](https://github.com/qdrant/qdrant)
530539
- Convert an webpage (URL) into clean markdown or structured data [github/firecrawl/firecrawl](https://github.com/firecrawl/firecrawl) [github/unclecode/crawl4ai](https://github.com/unclecode/crawl4ai) [github/browser-use/browser-use](https://github.com/browser-use/browser-use)
531540
- [github/BerriAI/litellm](https://github.com/BerriAI/litellm) + [github/langfuse/langfuse](https://github.com/langfuse/langfuse)
532541
- [github/claraverse-space/ClaraCore](https://github.com/claraverse-space/ClaraCore) automatizes installation & configuration of llama-swap
533542
534-
## Contributing
543+
## Contributions welcomed
535544
536545
1. Fork the repository.
537546
2. Create a feature branch (`git checkout -b your‑feature`)

0 commit comments

Comments
 (0)