3 Commits

Author	SHA1	Message	Date
Awni Hannun	7be292c0c9	Handle longer prompt/generation (#931) ... * rebase * nits * nit * fix rotating cache with step prefill * update version	2024-08-16 15:28:39 -07:00
Awni Hannun	ca7ce60c91	Rename block sparse to gather (#793) ... * rename block sparse to gather * pin mlx version	2024-05-23 19:47:35 -07:00
Angelos Katharopoulos	9f671228cd	Block sparse MM MoEs (#782) ... - Adds SwitchLinear - Adds QuantizedSwitchLinear	2024-05-21 15:58:08 -07:00