Commit graph

594 commits

Author SHA1 Message Date
Starbeamrainbowlabs ff56f591c7
I hate python 2022-12-08 18:53:37 +00:00
Starbeamrainbowlabs d37e7224f5
train-mono: tidy up arg passing 2022-12-08 18:47:03 +00:00
Starbeamrainbowlabs b53db648bf
fixup 2022-12-08 18:31:42 +00:00
Starbeamrainbowlabs 18c0210704
typo 2022-12-08 17:00:25 +00:00
Starbeamrainbowlabs a3c9416cf0
LossCrossentropy: don't sum 2022-12-08 16:57:11 +00:00
Starbeamrainbowlabs 08046340f4
dataset_mono: normalise heightmap 2022-12-08 16:10:34 +00:00
Starbeamrainbowlabs d997157f55
dataset_mono: log when using heightmap 2022-12-06 19:30:11 +00:00
Starbeamrainbowlabs 468c150570
slurm-train-mono: add HEIGHTMAP 2022-12-06 19:28:06 +00:00
Starbeamrainbowlabs d0f2e3d730
readfile: do transparent gzip by default
....but there's a glad to turn it off if needed
2022-12-06 19:27:39 +00:00
Starbeamrainbowlabs eac6472c97
Implement support for (optionally) taking a heightmap in 2022-12-06 18:55:58 +00:00
Starbeamrainbowlabs f92b2b3472
according to the equation it looks like it's 2 2022-12-02 17:22:46 +00:00
Starbeamrainbowlabs cad82cd1bc
CBAM: unsure if it's 1 ro 3 dense ayers in the shared mlp 2022-12-02 17:21:13 +00:00
Starbeamrainbowlabs 62f6a993bb
implement CBAM, but it's UNTESTED
Convolutional Block Attention Module.
2022-12-02 17:17:45 +00:00
Starbeamrainbowlabs 9d666c3b38
train mono: type=int → float 2022-12-01 15:39:44 +00:00
Starbeamrainbowlabs 53dfa32685
model_mono: log learning rate 2022-12-01 15:10:51 +00:00
Starbeamrainbowlabs c384d55dff
add arg to adjust learning rate 2022-11-29 20:55:00 +00:00
Starbeamrainbowlabs 8e23e9d341
model_segmenter: we're no longer using sparse 2022-11-29 19:28:27 +00:00
Starbeamrainbowlabs 9a2b4c6838
dsseg: fix reshape/onehot ordering 2022-11-29 19:28:13 +00:00
Starbeamrainbowlabs df774146d9
dataset_segmenter: reshape, not squeeze 2022-11-29 19:24:54 +00:00
Starbeamrainbowlabs 77b8a1a8db
dataset_segmenter: squeeze 2022-11-29 19:16:15 +00:00
Starbeamrainbowlabs 2258b5a229
slurm-train: reduce RAM required by 10GB 2022-11-29 19:15:34 +00:00
Starbeamrainbowlabs 01101ad30b
losscrossentropy: return the reduced value * facepalm * 2022-11-29 19:07:08 +00:00
Starbeamrainbowlabs ff65393e78
log file naming update 2022-11-29 18:41:14 +00:00
Starbeamrainbowlabs 37f196a785
LossCrossentropy: add kwargs 2022-11-29 15:40:35 +00:00
Starbeamrainbowlabs 838ff56a3b
mono: fix loading checkpoint 2022-11-29 15:25:11 +00:00
Starbeamrainbowlabs dba6cbffcd
WHY. * facepalms * 2022-11-28 19:33:42 +00:00
Starbeamrainbowlabs 57b8eb93fb
fixup 2022-11-28 19:09:35 +00:00
Starbeamrainbowlabs 6640a41bb7
almost got it....? it's not what I expected....! 2022-11-28 19:08:50 +00:00
Starbeamrainbowlabs f48473b703
fixup 2022-11-28 19:00:11 +00:00
Starbeamrainbowlabs f6feb125e3
this iss ome serious debugging.
This commit will produce an extremely large volume of output.
2022-11-28 18:57:41 +00:00
Starbeamrainbowlabs 09f81b0746
train_mono: debug
this commit will generate a large amount of debug output.
2022-11-28 16:46:17 +00:00
Starbeamrainbowlabs f39e4ade70
LayerConvNextGamma: fix config serialisation bug
.....this is unlikely to be the problem as this bug is in an unused code path.
2022-11-25 21:16:31 +00:00
Starbeamrainbowlabs e7410fb480
train_mono_predict: limit label size to 64x64
that's the size the model predicts
2022-11-25 17:47:17 +00:00
Starbeamrainbowlabs 51dd484d13
fixup 2022-11-25 16:55:45 +00:00
Starbeamrainbowlabs 884c4eb150
rainfall_stats: formatting again 2022-11-24 19:08:07 +00:00
Starbeamrainbowlabs bfe038086c
rainfall_stats: formatting 2022-11-24 19:07:44 +00:00
Starbeamrainbowlabs 7dba03200f
fixup 2022-11-24 19:06:48 +00:00
Starbeamrainbowlabs e5258b9c66
typo 2022-11-24 19:06:13 +00:00
Starbeamrainbowlabs 64d646bb13
rainfall_stats: formatting 2022-11-24 19:05:35 +00:00
Starbeamrainbowlabs 675c7a7448
fixup 2022-11-24 19:03:28 +00:00
Starbeamrainbowlabs afc1cdcf02
fixup 2022-11-24 19:02:58 +00:00
Starbeamrainbowlabs e4bea89c89
typo 2022-11-24 19:01:52 +00:00
Starbeamrainbowlabs a40cbe8705
rainfall_stats: remove unused imports 2022-11-24 19:01:18 +00:00
Starbeamrainbowlabs fe57d6aab2
rainfall_stats: initial implementation
this might reveal why we are having problems. If most/all the rainfall radar
data is v small numbers, normalising
might help.
2022-11-24 18:58:16 +00:00
Starbeamrainbowlabs 3131b4f7b3
debug2 2022-11-24 18:25:32 +00:00
Starbeamrainbowlabs d55a13f536
debug 2022-11-24 18:24:03 +00:00
Starbeamrainbowlabs 1f60f2a580
do_argmax 2022-11-24 18:11:03 +00:00
Starbeamrainbowlabs 6c09d5254d
fixup 2022-11-24 17:57:48 +00:00
Starbeamrainbowlabs 54a841efe9
train_mono_predict: convert to correct format 2022-11-24 17:56:07 +00:00
Starbeamrainbowlabs 105dc5bc56
missing kwargs 2022-11-24 17:51:29 +00:00