107 Commits

Author	SHA1	Message	Date
JWmer	3975fc9c0d	Update half_relative_ka.cpp	2020-11-22 07:45:39 +09:00
JWmer	b0429237a8	Update half_ka.cpp	2020-11-22 07:45:39 +09:00
JWmer	ea70e378cd	Update a.cpp	2020-11-22 07:45:39 +09:00
JWmer	be4cd56146	Update half_kp.cpp	2020-11-22 07:45:39 +09:00
JWmer	021f47b00e	Update half_relative_kp.cpp	2020-11-22 07:45:39 +09:00
JWmer	36c801699f	Update k.cpp	2020-11-22 07:45:39 +09:00
JWmer	5b3e9b0eb3	Update p.cpp	2020-11-22 07:45:39 +09:00
JWmer	c04c5b6658	Update nnue_common.h	2020-11-22 07:45:39 +09:00
JWmer	b27c51b5cf	Delete k-p-cr-ep_256x2-32-32.h	2020-11-22 07:45:39 +09:00
JWmer	72fee2f7a4	Delete k-p-cr_256x2-32-32.h	2020-11-22 07:45:39 +09:00
JWmer	d9dcdc2b73	Delete k-p_256x2-32-32.h	2020-11-22 07:45:39 +09:00
Tomasz Sobczyk	691da3bdad	Add more information for factorizers at the start of training.	2020-11-14 18:47:22 +09:00
Tomasz Sobczyk	4e1653d53a	Fix reliance on transitive includes for factorizers in trainer feature transformer. Add a file that includes all factorizers.	2020-11-14 12:35:12 +09:00
Tomasz Sobczyk	987b6c98d4	Move the observed feature collection to the threaded part now that it can be done safely.	2020-11-01 11:02:44 +09:00
Tomasz Sobczyk	e8907bcfc4	Replace omp in trainer_feature_transformer	2020-10-31 11:54:03 +09:00
Tomasz Sobczyk	db1b33d4ac	Optimize trainer clipped relu propagate	2020-10-31 11:52:51 +09:00
Tomasz Sobczyk	b5714c4084	Parallelize input slice trainer backprop.	2020-10-31 11:52:26 +09:00
Tomasz Sobczyk	941897ff2c	Optimize trainer clipped relu backpropagate.	2020-10-31 11:50:12 +09:00
Tomasz Sobczyk	c96743c5bd	Optimize feature transformer backpropagation stats.	2020-10-31 11:49:29 +09:00
Tomasz Sobczyk	2c10b1babc	Optimize feature transformer clipped relu.	2020-10-31 11:48:02 +09:00
Tomasz Sobczyk	a56d8124d8	Replace non-blas parts of trainers with our own blas-like routines.	2020-10-31 08:36:58 +09:00
Tomasz Sobczyk	ee0917a345	Pass ThreadPool to update_parameters, propagate, and backpropagate.	2020-10-29 09:21:19 +09:00
Tomasz Sobczyk	f1e96cab55	Align trainer arrays to cache line.	2020-10-29 09:12:50 +09:00
Tomasz Sobczyk	ec9e49e875	Add a HalfKA architecture (a product of K - king, and A - any piece) along with all required infrastructure. HalfKA doesn't discriminate kings compared to HalfKP. Keep old architecture as the default one.	2020-10-29 09:10:01 +09:00
Tomasz Sobczyk	317fda2516	Cleanup eval saving and lr scheduling.	2020-10-28 23:08:05 +09:00
Tomasz Sobczyk	680654b254	Add dots to output every epoch for progress visualization.	2020-10-28 09:36:43 +09:00
Tomasz Sobczyk	f81fa3d712	Replace global_learning_rate with learning_rate local to the learner and passed to update_parameters as a parameter.	2020-10-28 09:36:07 +09:00
Tomasz Sobczyk	cde6ec2bf2	Make all grad related functions in learn static. Pass calc_grad as a parameter.	2020-10-27 14:47:50 +09:00
Tomasz Sobczyk	ba390a7f9a	Print the used factorizer when intializing training.	2020-10-27 00:32:39 +09:00
Tomasz Sobczyk	0e528995c2	Print avg bias/weight for affine trasform and feature transformer during training.	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	fe766f4f42	Additional output from layers during training.	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	2c477d76ec	Cleaner and more outputs during training initialization.	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	b882423005	Bring back info for finished evalsave. Update tests with the new message.	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	4b72658409	Synchronize printed info regions in the learner and sfen reader.	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	cf3edfed82	Improve info messages.	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	c49ae541c4	Add layer info for check_health. Print subsequent infos from the same scope with "-->" instead of "INFO:" for clarity.	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	8ddef320e6	Print an additional new line before calc_loss progress instead of after check_health in the feature transformer layer.	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	a351c1d65e	Add verbose flag to learn. Only print update parameters info when vebose=true	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	ec436d3dfd	Print some weight update stats	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	be3937c37b	Print layers and their indices during training initialization.	2020-10-25 22:18:28 +09:00
Tomasz Sobczyk	f7530de20d	Fix assertion in trainer	2020-10-23 09:35:41 +09:00
Tomasz Sobczyk	146a6b056e	PascalCase -> snake_case for consistency with the rest of the codebase.	2020-10-19 18:37:23 +09:00
Tomasz Sobczyk	69ea3d30b2	Move the extra new line to after check health.	2020-10-19 08:29:51 +09:00
Tomasz Sobczyk	9023edc3c8	Add missing includes.	2020-10-19 08:29:51 +09:00
Tomasz Sobczyk	77624addf2	Cleanup last ".." in include paths.	2020-10-19 08:29:51 +09:00
Tomasz Sobczyk	497f689aa3	Cleanup nnue	2020-10-19 08:29:51 +09:00
Tomasz Sobczyk	c286f9cd7d	Cleanup trainer.	2020-10-19 08:29:51 +09:00
Tomasz Sobczyk	ea8eb415de	Cleanup trainer features.	2020-10-18 22:24:24 +09:00
Tomasz Sobczyk	3041adb080	Cleanup layers.	2020-10-18 19:32:15 +09:00
Tomasz Sobczyk	0d4c3014ca	Cleanup features.	2020-10-17 23:19:16 +09:00