3 Commits

Author	SHA1	Message	Date
Awni Hannun	69181e0058	Support non incremental kv cache growth (#766)	2024-05-15 12:56:24 -07:00
Awni Hannun	ee60e2a9d5	Kv cache (#643) ... * in place kv_cache * fix * fix kv cache size * partially fix kv cache dtype * step kv cache * multiple of step size * more teests + kv cache * more kv cache * udpate all models to use kv cache	2024-05-08 08:18:13 -07:00
Awni Hannun	c6440416a2	Mlx llm package (#301) ... * fix converter * add recursive files * remove gitignore * remove gitignore * add packages properly * read me update * remove dup readme * relative * fix convert * fix community name * fix url * version	2024-01-12 10:25:56 -08:00