Do you support SGLang video inference for Llava-OneVision ? #1303

Closed Answered by merrymercy

ehayeshaiper asked this question in Q&A

ehayeshaiper
Sep 2, 2024

If so, do you have an example of video inference?

Answered by merrymercy

see this example

sglang/test/srt/test_vision_openai_server.py

Line 208 in 5ab9418

def test_video_chat_completion(self):

View full answer

Replies: 1 comment

merrymercy
Sep 4, 2024
Maintainer

see this example

sglang/test/srt/test_vision_openai_server.py

Line 208 in 5ab9418

def test_video_chat_completion(self):

0 replies

Answer selected by merrymercy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment