JWmer
|
5b3e9b0eb3
|
Update p.cpp
|
2020-11-22 07:45:39 +09:00 |
|
JWmer
|
c04c5b6658
|
Update nnue_common.h
|
2020-11-22 07:45:39 +09:00 |
|
JWmer
|
b27c51b5cf
|
Delete k-p-cr-ep_256x2-32-32.h
|
2020-11-22 07:45:39 +09:00 |
|
JWmer
|
72fee2f7a4
|
Delete k-p-cr_256x2-32-32.h
|
2020-11-22 07:45:39 +09:00 |
|
JWmer
|
d9dcdc2b73
|
Delete k-p_256x2-32-32.h
|
2020-11-22 07:45:39 +09:00 |
|
Tomasz Sobczyk
|
691da3bdad
|
Add more information for factorizers at the start of training.
|
2020-11-14 18:47:22 +09:00 |
|
Tomasz Sobczyk
|
4e1653d53a
|
Fix reliance on transitive includes for factorizers in trainer feature transformer. Add a file that includes all factorizers.
|
2020-11-14 12:35:12 +09:00 |
|
Tomasz Sobczyk
|
987b6c98d4
|
Move the observed feature collection to the threaded part now that it can be done safely.
|
2020-11-01 11:02:44 +09:00 |
|
Tomasz Sobczyk
|
e8907bcfc4
|
Replace omp in trainer_feature_transformer
|
2020-10-31 11:54:03 +09:00 |
|
Tomasz Sobczyk
|
db1b33d4ac
|
Optimize trainer clipped relu propagate
|
2020-10-31 11:52:51 +09:00 |
|
Tomasz Sobczyk
|
b5714c4084
|
Parallelize input slice trainer backprop.
|
2020-10-31 11:52:26 +09:00 |
|
Tomasz Sobczyk
|
941897ff2c
|
Optimize trainer clipped relu backpropagate.
|
2020-10-31 11:50:12 +09:00 |
|
Tomasz Sobczyk
|
c96743c5bd
|
Optimize feature transformer backpropagation stats.
|
2020-10-31 11:49:29 +09:00 |
|
Tomasz Sobczyk
|
2c10b1babc
|
Optimize feature transformer clipped relu.
|
2020-10-31 11:48:02 +09:00 |
|
Tomasz Sobczyk
|
a56d8124d8
|
Replace non-blas parts of trainers with our own blas-like routines.
|
2020-10-31 08:36:58 +09:00 |
|
Tomasz Sobczyk
|
ee0917a345
|
Pass ThreadPool to update_parameters, propagate, and backpropagate.
|
2020-10-29 09:21:19 +09:00 |
|
Tomasz Sobczyk
|
f1e96cab55
|
Align trainer arrays to cache line.
|
2020-10-29 09:12:50 +09:00 |
|
Tomasz Sobczyk
|
ec9e49e875
|
Add a HalfKA architecture (a product of K - king, and A - any piece) along with all required infrastructure. HalfKA doesn't discriminate kings compared to HalfKP. Keep old architecture as the default one.
|
2020-10-29 09:10:01 +09:00 |
|
Tomasz Sobczyk
|
317fda2516
|
Cleanup eval saving and lr scheduling.
|
2020-10-28 23:08:05 +09:00 |
|
Tomasz Sobczyk
|
680654b254
|
Add dots to output every epoch for progress visualization.
|
2020-10-28 09:36:43 +09:00 |
|
Tomasz Sobczyk
|
f81fa3d712
|
Replace global_learning_rate with learning_rate local to the learner and passed to update_parameters as a parameter.
|
2020-10-28 09:36:07 +09:00 |
|
Tomasz Sobczyk
|
cde6ec2bf2
|
Make all grad related functions in learn static. Pass calc_grad as a parameter.
|
2020-10-27 14:47:50 +09:00 |
|
Tomasz Sobczyk
|
ba390a7f9a
|
Print the used factorizer when intializing training.
|
2020-10-27 00:32:39 +09:00 |
|
Tomasz Sobczyk
|
0e528995c2
|
Print avg bias/weight for affine trasform and feature transformer during training.
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
fe766f4f42
|
Additional output from layers during training.
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
2c477d76ec
|
Cleaner and more outputs during training initialization.
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
b882423005
|
Bring back info for finished evalsave. Update tests with the new message.
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
4b72658409
|
Synchronize printed info regions in the learner and sfen reader.
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
cf3edfed82
|
Improve info messages.
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
c49ae541c4
|
Add layer info for check_health. Print subsequent infos from the same scope with "-->" instead of "INFO:" for clarity.
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
8ddef320e6
|
Print an additional new line before calc_loss progress instead of after check_health in the feature transformer layer.
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
a351c1d65e
|
Add verbose flag to learn. Only print update parameters info when vebose=true
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
ec436d3dfd
|
Print some weight update stats
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
be3937c37b
|
Print layers and their indices during training initialization.
|
2020-10-25 22:18:28 +09:00 |
|
Tomasz Sobczyk
|
f7530de20d
|
Fix assertion in trainer
|
2020-10-23 09:35:41 +09:00 |
|
Tomasz Sobczyk
|
146a6b056e
|
PascalCase -> snake_case for consistency with the rest of the codebase.
|
2020-10-19 18:37:23 +09:00 |
|
Tomasz Sobczyk
|
69ea3d30b2
|
Move the extra new line to after check health.
|
2020-10-19 08:29:51 +09:00 |
|
Tomasz Sobczyk
|
9023edc3c8
|
Add missing includes.
|
2020-10-19 08:29:51 +09:00 |
|
Tomasz Sobczyk
|
77624addf2
|
Cleanup last ".." in include paths.
|
2020-10-19 08:29:51 +09:00 |
|
Tomasz Sobczyk
|
497f689aa3
|
Cleanup nnue
|
2020-10-19 08:29:51 +09:00 |
|
Tomasz Sobczyk
|
c286f9cd7d
|
Cleanup trainer.
|
2020-10-19 08:29:51 +09:00 |
|
Tomasz Sobczyk
|
ea8eb415de
|
Cleanup trainer features.
|
2020-10-18 22:24:24 +09:00 |
|
Tomasz Sobczyk
|
3041adb080
|
Cleanup layers.
|
2020-10-18 19:32:15 +09:00 |
|
Tomasz Sobczyk
|
0d4c3014ca
|
Cleanup features.
|
2020-10-17 23:19:16 +09:00 |
|
Tomasz Sobczyk
|
ca760c3a5b
|
Cleanup architecture files.
|
2020-10-17 20:01:09 +09:00 |
|
Tomasz Sobczyk
|
3cf193a90e
|
Properly handle cases in verify and init when SkipLoadingEval is set.
|
2020-10-17 08:44:38 +09:00 |
|
Tomasz Sobczyk
|
5db46d0c82
|
Verify whether there is a network being used during training.
|
2020-10-17 08:44:38 +09:00 |
|
Tomasz Sobczyk
|
0494adeb2c
|
Move nnue evaluation stuff from evaluate.h to nnue/evaluate_nnue.h
|
2020-10-15 20:37:03 +09:00 |
|
noobpwnftw
|
d865159bd6
|
Fix variable initialization in test commands
|
2020-09-29 17:30:08 +08:00 |
|
noobpwnftw
|
a8b502a975
|
Merge remote-tracking branch 'remotes/origin/master'
Bench: 3618595
|
2020-09-29 17:09:14 +08:00 |
|