Skip to content

Add Llama server (OpenAI compatible)#56

Open
shubham0204 wants to merge 1 commit intomainfrom
add-smollm-server
Open

Add Llama server (OpenAI compatible)#56
shubham0204 wants to merge 1 commit intomainfrom
add-smollm-server

Conversation

@shubham0204
Copy link
Copy Markdown
Owner

Tasks

  • Add smollm-server module that exposes the server (built with Ktor/Netty)
  • Add LlamaServerService in the app module that holds an instance to LlamaServer and allows it to run even when the app is not in foreground

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant