Properly apply gradient norm clipping after it's scaled in the update_parameters.

This commit is contained in:
Tomasz Sobczyk
2020-11-30 20:39:46 +01:00
committed by nodchip
parent de675e3503
commit 256c4b55ec
3 changed files with 10 additions and 8 deletions

View File

@@ -38,6 +38,7 @@ namespace Eval::NNUE {
uint64_t epoch,
bool verbose,
double learning_rate,
double max_grad,
Learner::CalcLossFunc calc_loss);
// Check if there are any problems with learning