sbrl-github/research-rainfallradar
1
0
Fork 0
mirror of https://github.com/sbrl/research-rainfallradar synced 2024-07-02 11:24:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
617 commits 1 branch 0 tags 2.1 MiB
Commit graph

276 commits

Author SHA1 Message Date
Starbeamrainbowlabs 4563fe6b27
dpl: fix moar crashes 2023-01-05 19:03:44 +00:00
Starbeamrainbowlabs fefeb5d531
fix water depth fiddling 2023-01-05 19:01:20 +00:00
Starbeamrainbowlabs 46d1f5e4e0
dataset_mono: fix dataset parsing 2023-01-05 19:00:52 +00:00
Starbeamrainbowlabs aca7b83a78
dataset_mono: fix sizing 
it didn't account for rainfall_scale_up
 2023-01-05 18:38:47 +00:00
Starbeamrainbowlabs 19bb2fcac0
debug 2023-01-05 18:32:22 +00:00
Starbeamrainbowlabs ef5071b569
DeepLabV3+: start working on version for rainfall radar, but it's not finished yet 2022-12-15 19:33:14 +00:00
Starbeamrainbowlabs eb47f8f544
dataset_mono: adjust to suit DeepLabV3+ too 2022-12-13 18:37:38 +00:00
Starbeamrainbowlabs 4e4d42a281
LossDice: add comment 2022-12-12 18:34:20 +00:00
Starbeamrainbowlabs 449bc425a7
LossDice: explicitly cast inputs to float32 2022-12-12 17:20:32 +00:00
Starbeamrainbowlabs dbf8f5617c
drop activation function in last layers 2022-12-12 17:20:04 +00:00
Starbeamrainbowlabs bcd2f1251e
LossDice: Do 1 - thing instead of -thing 2022-12-09 19:41:32 +00:00
Starbeamrainbowlabs d0dbc50bb7
debug 2022-12-09 19:33:28 +00:00
Starbeamrainbowlabs 2142bb039c
again 2022-12-09 19:30:01 +00:00
Starbeamrainbowlabs 7000b0f193
fixup 2022-12-09 19:23:35 +00:00
Starbeamrainbowlabs 85012d0616
fixup 2022-12-09 19:18:03 +00:00
Starbeamrainbowlabs 719d8e9819
strip channels layer at end 2022-12-09 19:11:00 +00:00
Starbeamrainbowlabs 0129c35a35
LossDice: remove weird K.* functions 2022-12-09 19:06:26 +00:00
Starbeamrainbowlabs 659fc97fd4
fix crash 2022-12-09 18:39:27 +00:00
Starbeamrainbowlabs e22c0981e6
actually use dice loss 2022-12-09 18:35:17 +00:00
Starbeamrainbowlabs 649c262960
mono: switch loss from crossentropy to dice 2022-12-09 18:13:37 +00:00
Starbeamrainbowlabs 2a1772a211
confvnext_intrevse: add shallow 2022-12-08 19:10:12 +00:00
Starbeamrainbowlabs 3dde9b69da
fixup 2022-12-08 18:56:32 +00:00
Starbeamrainbowlabs 6fce39f696
WHY?!?!?! 2022-12-08 18:55:53 +00:00
Starbeamrainbowlabs 26766366fc
I hate the python code intelligence 
it's bad
 2022-12-08 18:55:15 +00:00
Starbeamrainbowlabs ff56f591c7
I hate python 2022-12-08 18:53:37 +00:00
Starbeamrainbowlabs d37e7224f5
train-mono: tidy up arg passing 2022-12-08 18:47:03 +00:00
Starbeamrainbowlabs b53db648bf
fixup 2022-12-08 18:31:42 +00:00
Starbeamrainbowlabs 18c0210704
typo 2022-12-08 17:00:25 +00:00
Starbeamrainbowlabs a3c9416cf0
LossCrossentropy: don't sum 2022-12-08 16:57:11 +00:00
Starbeamrainbowlabs 08046340f4
dataset_mono: normalise heightmap 2022-12-08 16:10:34 +00:00
Starbeamrainbowlabs d997157f55
dataset_mono: log when using heightmap 2022-12-06 19:30:11 +00:00
Starbeamrainbowlabs d0f2e3d730
readfile: do transparent gzip by default 
....but there's a glad to turn it off if needed
 2022-12-06 19:27:39 +00:00
Starbeamrainbowlabs eac6472c97
Implement support for (optionally) taking a heightmap in 2022-12-06 18:55:58 +00:00
Starbeamrainbowlabs f92b2b3472
according to the equation it looks like it's 2 2022-12-02 17:22:46 +00:00
Starbeamrainbowlabs cad82cd1bc
CBAM: unsure if it's 1 ro 3 dense ayers in the shared mlp 2022-12-02 17:21:13 +00:00
Starbeamrainbowlabs 62f6a993bb
implement CBAM, but it's UNTESTED 
Convolutional Block Attention Module.
 2022-12-02 17:17:45 +00:00
Starbeamrainbowlabs 53dfa32685
model_mono: log learning rate 2022-12-01 15:10:51 +00:00
Starbeamrainbowlabs c384d55dff
add arg to adjust learning rate 2022-11-29 20:55:00 +00:00
Starbeamrainbowlabs 8e23e9d341
model_segmenter: we're no longer using sparse 2022-11-29 19:28:27 +00:00
Starbeamrainbowlabs 9a2b4c6838
dsseg: fix reshape/onehot ordering 2022-11-29 19:28:13 +00:00
Starbeamrainbowlabs df774146d9
dataset_segmenter: reshape, not squeeze 2022-11-29 19:24:54 +00:00
Starbeamrainbowlabs 77b8a1a8db
dataset_segmenter: squeeze 2022-11-29 19:16:15 +00:00
Starbeamrainbowlabs 01101ad30b
losscrossentropy: return the reduced value * facepalm * 2022-11-29 19:07:08 +00:00
Starbeamrainbowlabs 37f196a785
LossCrossentropy: add kwargs 2022-11-29 15:40:35 +00:00
Starbeamrainbowlabs 838ff56a3b
mono: fix loading checkpoint 2022-11-29 15:25:11 +00:00
Starbeamrainbowlabs dba6cbffcd
WHY. * facepalms * 2022-11-28 19:33:42 +00:00
Starbeamrainbowlabs 57b8eb93fb
fixup 2022-11-28 19:09:35 +00:00
Starbeamrainbowlabs 6640a41bb7
almost got it....? it's not what I expected....! 2022-11-28 19:08:50 +00:00
Starbeamrainbowlabs f48473b703
fixup 2022-11-28 19:00:11 +00:00
Starbeamrainbowlabs f6feb125e3
this iss ome serious debugging. 
This commit will produce an extremely large volume of output.
 2022-11-28 18:57:41 +00:00
Starbeamrainbowlabs 09f81b0746
train_mono: debug 
this commit will generate a large amount of debug output.
 2022-11-28 16:46:17 +00:00
Starbeamrainbowlabs f39e4ade70
LayerConvNextGamma: fix config serialisation bug 
.....this is unlikely to be the problem as this bug is in an unused code path.
 2022-11-25 21:16:31 +00:00
Starbeamrainbowlabs 105dc5bc56
missing kwargs 2022-11-24 17:51:29 +00:00
Starbeamrainbowlabs 773944f9fa
train_mono_predict: initial implementation 2022-11-24 16:33:50 +00:00
Starbeamrainbowlabs 3a0356929c
mono: drop the sparse 2022-11-22 16:20:56 +00:00
Starbeamrainbowlabs 7e8f63f8ba
fixup 2022-11-21 19:38:24 +00:00
Starbeamrainbowlabs ace4c8b246
dataset_mono: debug 2022-11-21 18:46:21 +00:00
Starbeamrainbowlabs 527b34942d
convnext_inverse: kernel_size 4→2 2022-11-11 19:29:37 +00:00
Starbeamrainbowlabs 0662d0854b
model_mono: fix bottleneck 2022-11-11 19:11:40 +00:00
Starbeamrainbowlabs 73acda6d9a
fix debug logging 2022-11-11 19:08:38 +00:00
Starbeamrainbowlabs 9da059d738
model shape logging 2022-11-11 19:03:37 +00:00
Starbeamrainbowlabs 00917b2698
dataset_mono: log shapes 2022-11-11 19:02:43 +00:00
Starbeamrainbowlabs 54ae88b1b4
in this entire blasted project I have yet to get the rotation of anything correct....! 2022-11-11 18:58:45 +00:00
Starbeamrainbowlabs a7a475dcd1
debug 2 2022-11-11 18:38:07 +00:00
Starbeamrainbowlabs bf2f6e9b64
debug logging 
it begins again
 2022-11-11 18:31:40 +00:00
Starbeamrainbowlabs 481eeb3759
mono: fix dataset preprocessing 
rogue dimension
 2022-11-11 18:31:27 +00:00
Starbeamrainbowlabs 9035450213
mono: instantiate right model 2022-11-11 18:28:29 +00:00
Starbeamrainbowlabs 8ac5159adc
dataset_mono: simplify param passing, onehot+threshold water depth data 2022-11-11 18:23:50 +00:00
Starbeamrainbowlabs 3a3f7e85da
typo 2022-11-11 18:03:09 +00:00
Starbeamrainbowlabs 3313f77c88
Add (untested) mono rainfall → water depth model 
* sighs *
Unfortunately I can't seem to get contrastive learning to work.....
 2022-11-10 22:36:11 +00:00
Starbeamrainbowlabs 9384b89165
model_segmentation: spare → normal crossentropy, activation functions at end 2022-11-10 20:53:37 +00:00
Starbeamrainbowlabs b6676e7361
switch from sparse to normal crossentropy 2022-11-10 20:50:56 +00:00
Starbeamrainbowlabs d8be26d476
Merge branch 'main' of git.starbeamrainbowlabs.com:sbrl/PhD-Rainfall-Radar 2022-11-10 20:49:01 +00:00
Starbeamrainbowlabs b03388de60
dataset_segmenter: DEBUG: fix water shape 2022-11-10 20:48:21 +00:00
Starbeamrainbowlabs daf691bf43
typo 2022-11-10 19:55:00 +00:00
Starbeamrainbowlabs 0aa2ce19f5
read_metadata: support file inputs as well as dirs 2022-11-10 19:53:30 +00:00
Starbeamrainbowlabs 44ad51f483
CallbackNBatchCsv: bugfix .sort() → sorted() 2022-11-04 16:40:21 +00:00
Starbeamrainbowlabs 1375201c5f
CallbackNBatchCsv: open_handle mode 2022-11-03 18:29:00 +00:00
Starbeamrainbowlabs f2ae74ce7b
how could I be so stupid..... round 2 2022-11-02 17:38:26 +00:00
Starbeamrainbowlabs 5f8d6dc6ea
Add metrics every 64 batches 
this is important, because with large batches it can be difficult to tell what's happening inside each epoch.
 2022-10-31 19:26:10 +00:00
Starbeamrainbowlabs cf872ef739
how could I be so *stupid*...... 2022-10-31 18:40:58 +00:00
Starbeamrainbowlabs da32d75778
make_callbacks: display steps, not samples 2022-10-31 18:36:28 +00:00
Starbeamrainbowlabs 172cf9d8ce
tweak 2022-10-31 18:19:43 +00:00
Starbeamrainbowlabs dbe35ee943
loss: comment l2 norm 2022-10-31 18:09:03 +00:00
Starbeamrainbowlabs 5e60319024
fixup 2022-10-31 17:56:49 +00:00
Starbeamrainbowlabs b986b069e2
debug party time 2022-10-31 17:50:29 +00:00
Starbeamrainbowlabs 458faa96d2
loss: fixup 2022-10-31 17:18:21 +00:00
Starbeamrainbowlabs 55dc05e8ce
contrastive: comment weights that aren't needed 2022-10-31 16:26:48 +00:00
Starbeamrainbowlabs 1b489518d0
segmenter: add LayerStack2Image to custom_objects 2022-10-26 17:05:50 +01:00
Starbeamrainbowlabs 48ae8a5c20
LossContrastive: normalise features as per the paper 2022-10-26 16:52:56 +01:00
Starbeamrainbowlabs 843cc8dc7b
contrastive: rewrite the loss function. 
The CLIP paper *does* kinda make sense I think
 2022-10-26 16:45:45 +01:00
Starbeamrainbowlabs fad1399c2d
convnext: whitespace 2022-10-26 16:45:20 +01:00
Starbeamrainbowlabs 1d872cb962
contrastive: fix initial temperature value 
It should be 1/0.07, but we had it set to 0.07......
 2022-10-26 16:45:01 +01:00
Starbeamrainbowlabs f994d449f1
Layer2Image: fix 2022-10-25 21:32:17 +01:00
Starbeamrainbowlabs 6a29105f56
model_segmentation: stack not reshape 2022-10-25 21:25:15 +01:00
Starbeamrainbowlabs 98417a3e06
prepare for NCE loss 
.....but Tensorflow's implementation looks to be for supervised models :-(
 2022-10-25 21:15:05 +01:00
Starbeamrainbowlabs bb0679a509
model_segmentation: don't softmax twice 2022-10-25 21:11:48 +01:00
Starbeamrainbowlabs f2e2ca1484
model_contrastive: make water encoder significantly shallower 2022-10-24 20:52:31 +01:00
Starbeamrainbowlabs a8b101bdae
dataset_predict: add shape_water_desired 2022-10-24 18:05:13 +01:00
Starbeamrainbowlabs 8195318a42
SparseCategoricalAccuracy: losses → metrics 2022-10-21 16:51:20 +01:00