liuhuayong/mlx-examples
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
397 Commits 1 Branch 0 Tags 8.1 MiB
d3f8e4aee9
Commit Graph

3 Commits

Author SHA1 Message Date
Awni Hannun
c386dd5f5a
Fix for cohere plus (#650) 
* fix for cohere plus

* version bump
 2024-04-05 14:11:24 -07:00
Awni Hannun
b8a348c1b8
Switch to fast RMS/LN Norm (#603) 
* use nn.RMSNorm, use sdpa, cleanup

* bump mlx versions

* minor update

* use fast layer norm

* version bump

* update requirement for whisper

* update requirement for gguf
 2024-03-23 07:13:51 -07:00
Prince Canuma
76c3244cc5
Add support for Cohere's Command-R (#565) 
* initial commit for command-R

* update mlp, layernorm, lm_head and model args

* add custom layernorm

* add default to tie_word_embeddings

* add layernorm weight type and refactor

* update layernorm (bias conditional) in model/layers

* fix layer norm use traditional rope

* add test

---------

Co-authored-by: Awni Hannun <awni@apple.com>
 2024-03-13 07:03:36 -07:00