liuhuayong/mlx-examples
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Typo: SGD->AdamW (#471)

Browse Source
This commit is contained in:
Kosti 2024-02-20 23:47:17 +00:00 committed by GitHub
parent 838990b33b
commit cfeef6d9d2
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
transformer_lm/main.py
View File

@ -189,7 +189,7 @@ if __name__ == "__main__":
"--num_iters", type=int, default=100000, help="Iterations to train for."
)
parser.add_argument(
"--learning_rate", type=float, default=3e-4, help="SGD learning rate."
"--learning_rate", type=float, default=3e-4, help="AdamW learning rate."
)
parser.add_argument(
"--weight_decay", type=float, default=1e-5, help="Set the weight decay"