274 commits

Author	SHA1	Message	Date
Starbeamrainbowlabs	46d1f5e4e0	dataset_mono: fix dataset parsing	2023-01-05 19:00:52 +00:00
Starbeamrainbowlabs	aca7b83a78	dataset_mono: fix sizing ... it didn't account for rainfall_scale_up	2023-01-05 18:38:47 +00:00
Starbeamrainbowlabs	19bb2fcac0	debug	2023-01-05 18:32:22 +00:00
Starbeamrainbowlabs	ef5071b569	DeepLabV3+: start working on version for rainfall radar, but it's not finished yet	2022-12-15 19:33:14 +00:00
Starbeamrainbowlabs	eb47f8f544	dataset_mono: adjust to suit DeepLabV3+ too	2022-12-13 18:37:38 +00:00
Starbeamrainbowlabs	4e4d42a281	LossDice: add comment	2022-12-12 18:34:20 +00:00
Starbeamrainbowlabs	449bc425a7	LossDice: explicitly cast inputs to float32	2022-12-12 17:20:32 +00:00
Starbeamrainbowlabs	dbf8f5617c	drop activation function in last layers	2022-12-12 17:20:04 +00:00
Starbeamrainbowlabs	bcd2f1251e	LossDice: Do 1 - thing instead of -thing	2022-12-09 19:41:32 +00:00
Starbeamrainbowlabs	d0dbc50bb7	debug	2022-12-09 19:33:28 +00:00
Starbeamrainbowlabs	2142bb039c	again	2022-12-09 19:30:01 +00:00
Starbeamrainbowlabs	7000b0f193	fixup	2022-12-09 19:23:35 +00:00
Starbeamrainbowlabs	85012d0616	fixup	2022-12-09 19:18:03 +00:00
Starbeamrainbowlabs	719d8e9819	strip channels layer at end	2022-12-09 19:11:00 +00:00
Starbeamrainbowlabs	0129c35a35	LossDice: remove weird K.* functions	2022-12-09 19:06:26 +00:00
Starbeamrainbowlabs	659fc97fd4	fix crash	2022-12-09 18:39:27 +00:00
Starbeamrainbowlabs	e22c0981e6	actually use dice loss	2022-12-09 18:35:17 +00:00
Starbeamrainbowlabs	649c262960	mono: switch loss from crossentropy to dice	2022-12-09 18:13:37 +00:00
Starbeamrainbowlabs	2a1772a211	confvnext_intrevse: add shallow	2022-12-08 19:10:12 +00:00
Starbeamrainbowlabs	3dde9b69da	fixup	2022-12-08 18:56:32 +00:00
Starbeamrainbowlabs	6fce39f696	WHY?!?!?!	2022-12-08 18:55:53 +00:00
Starbeamrainbowlabs	26766366fc	I hate the python code intelligence ... it's bad	2022-12-08 18:55:15 +00:00
Starbeamrainbowlabs	ff56f591c7	I hate python	2022-12-08 18:53:37 +00:00
Starbeamrainbowlabs	d37e7224f5	train-mono: tidy up arg passing	2022-12-08 18:47:03 +00:00
Starbeamrainbowlabs	b53db648bf	fixup	2022-12-08 18:31:42 +00:00
Starbeamrainbowlabs	18c0210704	typo	2022-12-08 17:00:25 +00:00
Starbeamrainbowlabs	a3c9416cf0	LossCrossentropy: don't sum	2022-12-08 16:57:11 +00:00
Starbeamrainbowlabs	08046340f4	dataset_mono: normalise heightmap	2022-12-08 16:10:34 +00:00
Starbeamrainbowlabs	d997157f55	dataset_mono: log when using heightmap	2022-12-06 19:30:11 +00:00
Starbeamrainbowlabs	d0f2e3d730	readfile: do transparent gzip by default ... ....but there's a glad to turn it off if needed	2022-12-06 19:27:39 +00:00
Starbeamrainbowlabs	eac6472c97	Implement support for (optionally) taking a heightmap in	2022-12-06 18:55:58 +00:00
Starbeamrainbowlabs	f92b2b3472	according to the equation it looks like it's 2	2022-12-02 17:22:46 +00:00
Starbeamrainbowlabs	cad82cd1bc	CBAM: unsure if it's 1 ro 3 dense ayers in the shared mlp	2022-12-02 17:21:13 +00:00
Starbeamrainbowlabs	62f6a993bb	implement CBAM, but it's UNTESTED ... Convolutional Block Attention Module.	2022-12-02 17:17:45 +00:00
Starbeamrainbowlabs	53dfa32685	model_mono: log learning rate	2022-12-01 15:10:51 +00:00
Starbeamrainbowlabs	c384d55dff	add arg to adjust learning rate	2022-11-29 20:55:00 +00:00
Starbeamrainbowlabs	8e23e9d341	model_segmenter: we're no longer using sparse	2022-11-29 19:28:27 +00:00
Starbeamrainbowlabs	9a2b4c6838	dsseg: fix reshape/onehot ordering	2022-11-29 19:28:13 +00:00
Starbeamrainbowlabs	df774146d9	dataset_segmenter: reshape, not squeeze	2022-11-29 19:24:54 +00:00
Starbeamrainbowlabs	77b8a1a8db	dataset_segmenter: squeeze	2022-11-29 19:16:15 +00:00
Starbeamrainbowlabs	01101ad30b	losscrossentropy: return the reduced value * facepalm *	2022-11-29 19:07:08 +00:00
Starbeamrainbowlabs	37f196a785	LossCrossentropy: add kwargs	2022-11-29 15:40:35 +00:00
Starbeamrainbowlabs	838ff56a3b	mono: fix loading checkpoint	2022-11-29 15:25:11 +00:00
Starbeamrainbowlabs	dba6cbffcd	WHY. * facepalms *	2022-11-28 19:33:42 +00:00
Starbeamrainbowlabs	57b8eb93fb	fixup	2022-11-28 19:09:35 +00:00
Starbeamrainbowlabs	6640a41bb7	almost got it....? it's not what I expected....!	2022-11-28 19:08:50 +00:00
Starbeamrainbowlabs	f48473b703	fixup	2022-11-28 19:00:11 +00:00
Starbeamrainbowlabs	f6feb125e3	this iss ome serious debugging. ... This commit will produce an extremely large volume of output.	2022-11-28 18:57:41 +00:00
Starbeamrainbowlabs	09f81b0746	train_mono: debug ... this commit will generate a large amount of debug output.	2022-11-28 16:46:17 +00:00
Starbeamrainbowlabs	f39e4ade70	LayerConvNextGamma: fix config serialisation bug ... .....this is unlikely to be the problem as this bug is in an unused code path.	2022-11-25 21:16:31 +00:00
Starbeamrainbowlabs	105dc5bc56	missing kwargs	2022-11-24 17:51:29 +00:00
Starbeamrainbowlabs	773944f9fa	train_mono_predict: initial implementation	2022-11-24 16:33:50 +00:00
Starbeamrainbowlabs	3a0356929c	mono: drop the sparse	2022-11-22 16:20:56 +00:00
Starbeamrainbowlabs	7e8f63f8ba	fixup	2022-11-21 19:38:24 +00:00
Starbeamrainbowlabs	ace4c8b246	dataset_mono: debug	2022-11-21 18:46:21 +00:00
Starbeamrainbowlabs	527b34942d	convnext_inverse: kernel_size 4→2	2022-11-11 19:29:37 +00:00
Starbeamrainbowlabs	0662d0854b	model_mono: fix bottleneck	2022-11-11 19:11:40 +00:00
Starbeamrainbowlabs	73acda6d9a	fix debug logging	2022-11-11 19:08:38 +00:00
Starbeamrainbowlabs	9da059d738	model shape logging	2022-11-11 19:03:37 +00:00
Starbeamrainbowlabs	00917b2698	dataset_mono: log shapes	2022-11-11 19:02:43 +00:00
Starbeamrainbowlabs	54ae88b1b4	in this entire blasted project I have yet to get the rotation of anything correct....!	2022-11-11 18:58:45 +00:00
Starbeamrainbowlabs	a7a475dcd1	debug 2	2022-11-11 18:38:07 +00:00
Starbeamrainbowlabs	bf2f6e9b64	debug logging ... it begins again	2022-11-11 18:31:40 +00:00
Starbeamrainbowlabs	481eeb3759	mono: fix dataset preprocessing ... rogue dimension	2022-11-11 18:31:27 +00:00
Starbeamrainbowlabs	9035450213	mono: instantiate right model	2022-11-11 18:28:29 +00:00
Starbeamrainbowlabs	8ac5159adc	dataset_mono: simplify param passing, onehot+threshold water depth data	2022-11-11 18:23:50 +00:00
Starbeamrainbowlabs	3a3f7e85da	typo	2022-11-11 18:03:09 +00:00
Starbeamrainbowlabs	3313f77c88	Add (untested) mono rainfall → water depth model ... * sighs * Unfortunately I can't seem to get contrastive learning to work.....	2022-11-10 22:36:11 +00:00
Starbeamrainbowlabs	9384b89165	model_segmentation: spare → normal crossentropy, activation functions at end	2022-11-10 20:53:37 +00:00
Starbeamrainbowlabs	b6676e7361	switch from sparse to normal crossentropy	2022-11-10 20:50:56 +00:00
Starbeamrainbowlabs	d8be26d476	Merge branch 'main' of git.starbeamrainbowlabs.com:sbrl/PhD-Rainfall-Radar	2022-11-10 20:49:01 +00:00
Starbeamrainbowlabs	b03388de60	dataset_segmenter: DEBUG: fix water shape	2022-11-10 20:48:21 +00:00
Starbeamrainbowlabs	daf691bf43	typo	2022-11-10 19:55:00 +00:00
Starbeamrainbowlabs	0aa2ce19f5	read_metadata: support file inputs as well as dirs	2022-11-10 19:53:30 +00:00
Starbeamrainbowlabs	44ad51f483	CallbackNBatchCsv: bugfix .sort() → sorted()	2022-11-04 16:40:21 +00:00
Starbeamrainbowlabs	1375201c5f	CallbackNBatchCsv: open_handle mode	2022-11-03 18:29:00 +00:00
Starbeamrainbowlabs	f2ae74ce7b	how could I be so stupid..... round 2	2022-11-02 17:38:26 +00:00
Starbeamrainbowlabs	5f8d6dc6ea	Add metrics every 64 batches ... this is important, because with large batches it can be difficult to tell what's happening inside each epoch.	2022-10-31 19:26:10 +00:00
Starbeamrainbowlabs	cf872ef739	how could I be so *stupid*......	2022-10-31 18:40:58 +00:00
Starbeamrainbowlabs	da32d75778	make_callbacks: display steps, not samples	2022-10-31 18:36:28 +00:00
Starbeamrainbowlabs	172cf9d8ce	tweak	2022-10-31 18:19:43 +00:00
Starbeamrainbowlabs	dbe35ee943	loss: comment l2 norm	2022-10-31 18:09:03 +00:00
Starbeamrainbowlabs	5e60319024	fixup	2022-10-31 17:56:49 +00:00
Starbeamrainbowlabs	b986b069e2	debug party time	2022-10-31 17:50:29 +00:00
Starbeamrainbowlabs	458faa96d2	loss: fixup	2022-10-31 17:18:21 +00:00
Starbeamrainbowlabs	55dc05e8ce	contrastive: comment weights that aren't needed	2022-10-31 16:26:48 +00:00
Starbeamrainbowlabs	1b489518d0	segmenter: add LayerStack2Image to custom_objects	2022-10-26 17:05:50 +01:00
Starbeamrainbowlabs	48ae8a5c20	LossContrastive: normalise features as per the paper	2022-10-26 16:52:56 +01:00
Starbeamrainbowlabs	843cc8dc7b	contrastive: rewrite the loss function. ... The CLIP paper *does* kinda make sense I think	2022-10-26 16:45:45 +01:00
Starbeamrainbowlabs	fad1399c2d	convnext: whitespace	2022-10-26 16:45:20 +01:00
Starbeamrainbowlabs	1d872cb962	contrastive: fix initial temperature value ... It should be 1/0.07, but we had it set to 0.07......	2022-10-26 16:45:01 +01:00
Starbeamrainbowlabs	f994d449f1	Layer2Image: fix	2022-10-25 21:32:17 +01:00
Starbeamrainbowlabs	6a29105f56	model_segmentation: stack not reshape	2022-10-25 21:25:15 +01:00
Starbeamrainbowlabs	98417a3e06	prepare for NCE loss ... .....but Tensorflow's implementation looks to be for supervised models :-(	2022-10-25 21:15:05 +01:00
Starbeamrainbowlabs	bb0679a509	model_segmentation: don't softmax twice	2022-10-25 21:11:48 +01:00
Starbeamrainbowlabs	f2e2ca1484	model_contrastive: make water encoder significantly shallower	2022-10-24 20:52:31 +01:00
Starbeamrainbowlabs	a8b101bdae	dataset_predict: add shape_water_desired	2022-10-24 18:05:13 +01:00
Starbeamrainbowlabs	8195318a42	SparseCategoricalAccuracy: losses → metrics	2022-10-21 16:51:20 +01:00
Starbeamrainbowlabs	612735aaae	rename shuffle arg	2022-10-21 16:35:45 +01:00
Starbeamrainbowlabs	c98d8d05dd	segmentation: use the right accuracy	2022-10-21 16:17:05 +01:00