Commit graph

47 commits

Author SHA1 Message Date
Starbeamrainbowlabs 09f81b0746
train_mono: debug
this commit will generate a large amount of debug output.
2022-11-28 16:46:17 +00:00
Starbeamrainbowlabs f39e4ade70
LayerConvNextGamma: fix config serialisation bug
.....this is unlikely to be the problem as this bug is in an unused code path.
2022-11-25 21:16:31 +00:00
Starbeamrainbowlabs 527b34942d
convnext_inverse: kernel_size 4→2 2022-11-11 19:29:37 +00:00
Starbeamrainbowlabs 44ad51f483
CallbackNBatchCsv: bugfix .sort() → sorted() 2022-11-04 16:40:21 +00:00
Starbeamrainbowlabs 1375201c5f
CallbackNBatchCsv: open_handle mode 2022-11-03 18:29:00 +00:00
Starbeamrainbowlabs 5f8d6dc6ea
Add metrics every 64 batches
this is important, because with large batches it can be difficult to tell what's happening inside each epoch.
2022-10-31 19:26:10 +00:00
Starbeamrainbowlabs 172cf9d8ce
tweak 2022-10-31 18:19:43 +00:00
Starbeamrainbowlabs dbe35ee943
loss: comment l2 norm 2022-10-31 18:09:03 +00:00
Starbeamrainbowlabs 5e60319024
fixup 2022-10-31 17:56:49 +00:00
Starbeamrainbowlabs b986b069e2
debug party time 2022-10-31 17:50:29 +00:00
Starbeamrainbowlabs 458faa96d2
loss: fixup 2022-10-31 17:18:21 +00:00
Starbeamrainbowlabs 55dc05e8ce
contrastive: comment weights that aren't needed 2022-10-31 16:26:48 +00:00
Starbeamrainbowlabs 48ae8a5c20
LossContrastive: normalise features as per the paper 2022-10-26 16:52:56 +01:00
Starbeamrainbowlabs 843cc8dc7b
contrastive: rewrite the loss function.
The CLIP paper *does* kinda make sense I think
2022-10-26 16:45:45 +01:00
Starbeamrainbowlabs fad1399c2d
convnext: whitespace 2022-10-26 16:45:20 +01:00
Starbeamrainbowlabs 1d872cb962
contrastive: fix initial temperature value
It should be 1/0.07, but we had it set to 0.07......
2022-10-26 16:45:01 +01:00
Starbeamrainbowlabs f994d449f1
Layer2Image: fix 2022-10-25 21:32:17 +01:00
Starbeamrainbowlabs 6a29105f56
model_segmentation: stack not reshape 2022-10-25 21:25:15 +01:00
Starbeamrainbowlabs 98417a3e06
prepare for NCE loss
.....but Tensorflow's implementation looks to be for supervised models :-(
2022-10-25 21:15:05 +01:00
Starbeamrainbowlabs f2e2ca1484
model_contrastive: make water encoder significantly shallower 2022-10-24 20:52:31 +01:00
Starbeamrainbowlabs 6423bf6702
LayerConvNeXtGamma: avoid adding an EagerTensor to config
Very weird how this is a problem when it wasn't before..
2022-10-12 17:12:07 +01:00
Starbeamrainbowlabs c45b90764e
segmentation: adds xxtiny, but unsure if it's small enough 2022-10-11 19:22:37 +01:00
Starbeamrainbowlabs 11f91a7cf4
train: add --arch; default to convnext_i_xtiny 2022-10-11 19:18:01 +01:00
Starbeamrainbowlabs 2960d3b645
exception → warning 2022-10-06 18:26:40 +01:00
Starbeamrainbowlabs 0ee6703c1e
Add todo and comment 2022-10-03 19:06:56 +01:00
Starbeamrainbowlabs 2b182214ea
typo 2022-10-03 17:53:10 +01:00
Starbeamrainbowlabs 92c380bff5
fiddle with Conv2DTranspose
you need to set the `stride` argument to actually get it to upscale..... :P
2022-10-03 17:51:41 +01:00
Starbeamrainbowlabs fc6d2dabc9
Upscale first, THEN convnext... 2022-10-03 16:38:43 +01:00
Starbeamrainbowlabs 6a0790ff50
convnext_inverse: add returns; change ordering 2022-10-03 16:32:09 +01:00
Starbeamrainbowlabs 7130c4fdf8
start implementing core image segmentation model 2022-09-07 17:45:38 +01:00
Starbeamrainbowlabs 22620a1854
ai: implement saving only the rainfall encoder 2022-09-06 19:48:46 +01:00
Starbeamrainbowlabs 3e13ad12c8
ai Bugfix LayerContrastiveEncoder: channels → input_channels
for consistency
2022-09-05 23:53:16 +01:00
Starbeamrainbowlabs efe41b96ec
fixup 2022-09-02 17:58:02 +01:00
Starbeamrainbowlabs f8ee0afca1
ai: fix arch_name plumbing 2022-09-02 17:57:07 +01:00
Starbeamrainbowlabs b9d01ddadc
summary logger → summarywriter 2022-09-02 17:28:00 +01:00
Starbeamrainbowlabs b2f1ba29bb
debug a 2022-09-01 18:05:33 +01:00
Starbeamrainbowlabs 2663123407
moar logging 2022-09-01 17:40:23 +01:00
Starbeamrainbowlabs f1d7973f22
ai: add dummy label 2022-09-01 17:01:00 +01:00
Starbeamrainbowlabs e4c95bc7e3
typo 2022-09-01 16:09:24 +01:00
Starbeamrainbowlabs cfbbe8e8cf
ai: global? really? 2022-09-01 16:06:24 +01:00
Starbeamrainbowlabs 4952ead094
ai: try the nonlocal keyword? I'm unsure what's going on here
....clearly I need to read up on scoping in python.
2022-09-01 16:02:37 +01:00
Starbeamrainbowlabs 8bdded23eb
ai: fix 'nother crash' name ConvNeXt submodels 2022-08-31 18:57:27 +01:00
Starbeamrainbowlabs b2a320134e
ai: typo 2022-08-31 18:54:03 +01:00
Starbeamrainbowlabs e4edc68df5
ai: add missing gamma layer 2022-08-31 18:52:35 +01:00
Starbeamrainbowlabs 51cf08a386
ResNetRSV2 → ConvNeXt
ironically this makes the model simpler o/
2022-08-31 18:51:01 +01:00
Starbeamrainbowlabs 3d614d105b
channels first 2022-08-31 18:06:59 +01:00
Starbeamrainbowlabs c0a9cb12d8
ai: start creating initial model implementation.
it's not hooked up to the CLI yet though.
Focus is still on ensuring the dataset is in the right format though
2022-08-10 19:03:25 +01:00