Skip to content

Commit f2477c0

Browse files
megeminimegemini
authored
【Hackathon 8th No.32】 Adam-mini 精调算法复现 (#10413)
* [Init] AdamWMini * [Update] blocks per neuron and other * [Update] adamw_python * [Update] adamw_python * [update] fix grad mean * [update] remove bad conflict resolve * [update] moment shape align to torch * [update] test layernorm * [update] logger * [add] test case for adamwmini
1 parent bfba64b commit f2477c0

File tree

2 files changed

+510
-57
lines changed

2 files changed

+510
-57
lines changed

0 commit comments

Comments
 (0)