AlgoPerf (@algoperf) 's Twitter Profile
AlgoPerf

@algoperf

AlgoPerf benchmark for faster neural network training via better training algorithms. Also on bsky.app/profile/algope…

ID: 1899799774674432000

linkhttps://github.com/mlcommons/algorithmic-efficiency calendar_today12-03-2025 12:29:04

13 Tweet

50 Followers

23 Following

AlgoPerf (@algoperf) 's Twitter Profile Photo
AlgoPerf
@algoperf

8 months ago

And the winner in the self-tuning ruleset, based on Schedule Free AdamW, demonstrated a new level of effectiveness for completely hyperparameter-free neural network training. Roughly ~10% faster training, compared to a NadamW baseline with well-tuned default hyperparameters.

And the winner in the self-tuning ruleset, based on Schedule Free AdamW, demonstrated a new level of effectiveness for completely hyperparameter-free neural network training. Roughly ~10% faster training, compared to a NadamW baseline with well-tuned default hyperparameters.