Is function calling supported with Litellm + Llama3 (with huggingface TGI) #4634
Unanswered
ManivannanGuru
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have the setup with Litellm + Llama3 (with huggingface TGI) where function calling is not working.
But function calling is working fine with Litellm + Llama3 (With Ollama)
So does this mean litellm does not support function calling with TGI ? Or is there any settings to enable this ? FYI i tried add_function_to_prompt=True but that doesn't help
Beta Was this translation helpful? Give feedback.
All reactions