docs: Ollama api_url improvements (#18440)

This commit is contained in:
Peter Tripp 2024-09-27 10:29:49 -04:00 committed by GitHub
parent 73ff8c0f1f
commit 03c7f08581
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -124,7 +124,7 @@ Download and install Ollama from [ollama.com/download](https://ollama.com/downlo
3. In the assistant panel, select one of the Ollama models using the model dropdown. 3. In the assistant panel, select one of the Ollama models using the model dropdown.
4. (Optional) Specify a [custom api_url](#custom-endpoint) or [custom `low_speed_timeout_in_seconds`](#provider-timeout) if required. 4. (Optional) Specify an [`api_url`](#custom-endpoint) or [`low_speed_timeout_in_seconds`](#provider-timeout) if required.
#### Ollama Context Length {#ollama-context} #### Ollama Context Length {#ollama-context}
@ -138,6 +138,7 @@ Depending on your hardware or use-case you may wish to limit or increase the con
{ {
"language_models": { "language_models": {
"ollama": { "ollama": {
"api_url": "http://localhost:11434",
"low_speed_timeout_in_seconds": 120, "low_speed_timeout_in_seconds": 120,
"available_models": [ "available_models": [
{ {