Is your feature request related to a problem? Please describe.
Sometimes you just want to disable access to a model quickly without either changing the config and redeploying or just let users run into errors.
Describe the solution you'd like
Somewhere in the admin panel or the models page should be a switch to activate maintenance mode for a model, at which case the server responds with an error code (503) with the corresponding message.
We could also probe the model or show the last request that went through it (if it was 500 we could infer that it is down). We could also define a health check endpoint that we query regularly.
Is your feature request related to a problem? Please describe.
Sometimes you just want to disable access to a model quickly without either changing the config and redeploying or just let users run into errors.
Describe the solution you'd like
Somewhere in the admin panel or the models page should be a switch to activate maintenance mode for a model, at which case the server responds with an error code (503) with the corresponding message.
We could also probe the model or show the last request that went through it (if it was 500 we could infer that it is down). We could also define a health check endpoint that we query regularly.