Skip to content
This repository has been archived by the owner on Jul 17, 2024. It is now read-only.

bug: connection 504 gateway timeout #123

Open
Zheaoli opened this issue Aug 5, 2023 · 3 comments
Open

bug: connection 504 gateway timeout #123

Zheaoli opened this issue Aug 5, 2023 · 3 comments

Comments

@Zheaoli
Copy link
Member

Zheaoli commented Aug 5, 2023

I follow the step in the documentation Create your first OpenAI compatible API server

Here's the list info detail

╰─ mdz list
 NAME      ENDPOINT                                                    STATUS   INVOCATIONS  REPLICAS
 jupyter   http://jupyter-2j8g8a2w664nwlsu.192.168.0.239.modelz.live   Scaling            5  0/1
           http://localhost:80/inference/jupyter.default
 jupyter1  http://jupyter1-s37e8r27fc0bt7ap.192.168.0.239.modelz.live  Ready            187  1/1
           http://localhost:80/inference/jupyter1.default

Then when I access the deployment by using endpoint, the error message has been raised

{"message":"no addresses for \"mdz-jupyter.default\"","request":"GET /inference/jupyter.default/","op":"inference-proxy","error":{}}

I guess this is related to the scaling status, but I can't find the root cause by using the command mdz logs jupyter

@gaocegege
Copy link
Member

We should add a doc abot the status.

@cybergeekgyan
Copy link

Can you assign this issue to me, I would like to work on this issue and resolve with adding documentation and requiured code logic for the same... @gaocegege

@gaocegege
Copy link
Member

Sure, thanks! Currently I think we could just add the doc to tell users please use the first endpoint (xxx.modelz.live)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

3 participants