Yehowshua/ZIm
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

lmstudio: Support missing quantization in model metadata (#24054)

Browse source 
- Closes https://github.com/zed-industries/zed/issues/23764

Certain models do not include `quantization` parameter from lm studio rest API.
This commit is contained in:
Peter Tripp 2025-01-31 17:28:11 -05:00 • committed by GitHub
parent df16ef209c
commit 3af37ddf6d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
crates/lmstudio/src/lmstudio.rs
View file

@ -192,7 +192,7 @@ pub struct ModelEntry {
pub publisher: String, pub publisher: String,
pub arch: Option<String>, pub arch: Option<String>,
pub compatibility_type: CompatibilityType, pub compatibility_type: CompatibilityType,
pub quantization: String, pub quantization: Option<String>,
pub state: ModelState, pub state: ModelState,
pub max_context_length: Option<u32>, pub max_context_length: Option<u32>,
pub loaded_context_length: Option<u32>, pub loaded_context_length: Option<u32>,