liuhuayong/mlx-examples
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
195bec2fa3
mlx-examples/llms/speculative_decoding/requirements.txt

4 lines
30 B
Plaintext
Raw Normal View History

add speculative decoding example for llama (#149) * speculative decoding * add sample 0 * spec decode gives same results as regular decode * rebase * use accept reject criteria * switch to t5 * update readme * readme nit * nits * nits * nits --------- Co-authored-by: Benjamin Anderson <benjamin@Benjamins-MBP.lan> Co-authored-by: Awni Hannun <awni@apple.com>
2023-12-29 07:20:43 +08:00
mlx>=0.0.6
transformers
numpy
Reference in New Issue Copy Permalink