Awni Hannun 3cf436b529 Quantize example (#162) ... * testing quantization * conversion + quantization working * one config processor * quantization in mistral / nits in llama * args for quantization * llama / mistral conversion in good shape * phi2 quantized * mixtral * qwen conversion		2023-12-21 12:59:37 -08:00
..
llama	Quantize example (#162)	2023-12-21 12:59:37 -08:00
mistral	Quantize example (#162)	2023-12-21 12:59:37 -08:00
mixtral	Quantize example (#162)	2023-12-21 12:59:37 -08:00
phi2	Quantize example (#162)	2023-12-21 12:59:37 -08:00
qwen	Quantize example (#162)	2023-12-21 12:59:37 -08:00