Search results

Llama-API info about rate limits and status monitoring

Status: Open.

#30 In c0sogi/llama-api;

· AndreiBlindu opened on Mar 25, 2025

FastAPI + llamapi issue

Status: Open.

#29 In c0sogi/llama-api;

· Samraw003 opened on May 15, 2024

Stopped working after enabling CUDA

Status: Open.

#28 In c0sogi/llama-api;

· alexellis opened on Jan 12, 2024

High RAM and CPU usage

Status: Open.

#27 In c0sogi/llama-api;

· delta-whiplash opened on Dec 21, 2023

Usage of embedding through langchain

Status: Open.

#26 In c0sogi/llama-api;

· jordandroid opened on Dec 11, 2023

Support min_p sampler

Status: Open.

#25 In c0sogi/llama-api;

· atisharma opened on Nov 15, 2023

How can I use a specific prompt template?

Status: Open.

#24 In c0sogi/llama-api;

· Dougie777 opened on Nov 7, 2023

how to run this api in cpu only mode

Status: Open.

#23 In c0sogi/llama-api;

· delta-whiplash opened on Nov 7, 2023

Zephyr7b gives gobbly gook output but Mistral7b works fine.

Status: Open.

#22 In c0sogi/llama-api;

· Dougie777 opened on Nov 1, 2023

exllama GPU split

Status: Open.

#21 In c0sogi/llama-api;

· atisharma opened on Oct 27, 2023

exllamav2

Status: Open.

#20 In c0sogi/llama-api;

· ehartford opened on Oct 20, 2023

Any way to define embeddings model in model_definitions.py?

Status: Open.

#19 In c0sogi/llama-api;

· morgendigital opened on Oct 9, 2023