* chore: fix the load quantization model * change to explicitly check for quantization config |
||
|---|---|---|
| .. | ||
| deepseek-coder | ||
| llama | ||
| mistral | ||
| mixtral | ||
| phi2 | ||
| qwen | ||
| speculative_decoding | ||
* chore: fix the load quantization model * change to explicitly check for quantization config |
||
|---|---|---|
| .. | ||
| deepseek-coder | ||
| llama | ||
| mistral | ||
| mixtral | ||
| phi2 | ||
| qwen | ||
| speculative_decoding | ||