04772bf17d
This sets us up to display queue position information to the user, once
our language model backend is updated to support request queuing.
The JSON returned by the LLM backend will need to look like this:
```json
{"queue": {"status": "queued", "position": 1}}
{"queue": {"status": "started"}}
{"event": {"THE_UPSTREAM_MODEL_PROVIDER_EVENT": "..."}}
```
Release Notes:
- N/A
---------
Co-authored-by: Marshall Bowers <git@maxdeviant.com>
|
||
|---|---|---|
| .. | ||
| provider | ||
| ui | ||
| language_models.rs | ||
| provider.rs | ||
| settings.rs | ||
| ui.rs | ||