Requests hanging

[karam-khanna]

Context: I have the server running as a container in GCP cloud run, and am using the Mozilla agent

Problem: It seems to work for a few requests, but then quickly after I'm not sure exactly what happens but every request hangs and doesn't return anything. When there's no client connected often it will return no client connected, but once it correctly has a connection, everything hangs. In terms of errors, it's usually no error, or a 503. In addition, sometimes there's a correctly registered connection, but when a request comes in to /api/ask, it returns "No client connected".

[PlutoniaX]

could it be because the chats filled out and nears clearing?

[karam-khanna]

I don't think so. It quickly can start hanging within 1~2 requests. I also have used multiple different accounts so I don't think it's tied to that.

[tomasliachovskis]

Same here requests are hanging. Did anyone manage to fix this ?

[acheong08]

Hanging requests might mean that the pool isn't getting unlocked. I'm having some issues debugging as I can't replicate it reliably

[acheong08]

The official API via the completions endpoint has been released. I suggest you use that instead

[acheong08]

https://rentry.org/xp22i

[acheong08]

Edit: ChatGPT is down