Commit graph

446 commits

Author SHA1 Message Date
Starbeamrainbowlabs 54a841efe9
train_mono_predict: convert to correct format 2022-11-24 17:56:07 +00:00
Starbeamrainbowlabs 105dc5bc56
missing kwargs 2022-11-24 17:51:29 +00:00
Starbeamrainbowlabs 1e1d6dd273
fixup 2022-11-24 17:48:19 +00:00
Starbeamrainbowlabs 011e0aef78
update cli docs 2022-11-24 16:38:07 +00:00
Starbeamrainbowlabs 773944f9fa
train_mono_predict: initial implementation 2022-11-24 16:33:50 +00:00
Starbeamrainbowlabs d31326cb30
slurm train mono: fix partition name 2022-11-22 17:02:02 +00:00
Starbeamrainbowlabs ce28ac4013
slurm: add job for train_mono 2022-11-22 16:58:46 +00:00
Starbeamrainbowlabs 3a0356929c
mono: drop the sparse 2022-11-22 16:20:56 +00:00
Starbeamrainbowlabs 7e8f63f8ba
fixup 2022-11-21 19:38:24 +00:00
Starbeamrainbowlabs ace4c8b246
dataset_mono: debug 2022-11-21 18:46:21 +00:00
Starbeamrainbowlabs 527b34942d
convnext_inverse: kernel_size 4→2 2022-11-11 19:29:37 +00:00
Starbeamrainbowlabs 0662d0854b
model_mono: fix bottleneck 2022-11-11 19:11:40 +00:00
Starbeamrainbowlabs 73acda6d9a
fix debug logging 2022-11-11 19:08:38 +00:00
Starbeamrainbowlabs 9da059d738
model shape logging 2022-11-11 19:03:37 +00:00
Starbeamrainbowlabs 00917b2698
dataset_mono: log shapes 2022-11-11 19:02:43 +00:00
Starbeamrainbowlabs 54ae88b1b4
in this entire blasted project I have yet to get the rotation of anything correct....! 2022-11-11 18:58:45 +00:00
Starbeamrainbowlabs 4b2e418ddc
finish comment
...oops
2022-11-11 18:55:35 +00:00
Starbeamrainbowlabs a7a475dcd1
debug 2 2022-11-11 18:38:07 +00:00
Starbeamrainbowlabs bf2f6e9b64
debug logging
it begins again
2022-11-11 18:31:40 +00:00
Starbeamrainbowlabs 481eeb3759
mono: fix dataset preprocessing
rogue dimension
2022-11-11 18:31:27 +00:00
Starbeamrainbowlabs 9035450213
mono: instantiate right model 2022-11-11 18:28:29 +00:00
Starbeamrainbowlabs 69a2d0cf04
fixup 2022-11-11 18:27:01 +00:00
Starbeamrainbowlabs 65e801cf28
train_mono: fix crash 2022-11-11 18:26:25 +00:00
Starbeamrainbowlabs 8ac5159adc
dataset_mono: simplify param passing, onehot+threshold water depth data 2022-11-11 18:23:50 +00:00
Starbeamrainbowlabs 3a3f7e85da
typo 2022-11-11 18:03:09 +00:00
Starbeamrainbowlabs 3313f77c88
Add (untested) mono rainfall → water depth model
* sighs *
Unfortunately I can't seem to get contrastive learning to work.....
2022-11-10 22:36:11 +00:00
Starbeamrainbowlabs ce194d9227
slurm: customise log file names 2022-11-10 21:09:34 +00:00
Starbeamrainbowlabs 9384b89165
model_segmentation: spare → normal crossentropy, activation functions at end 2022-11-10 20:53:37 +00:00
Starbeamrainbowlabs b6676e7361
switch from sparse to normal crossentropy 2022-11-10 20:50:56 +00:00
Starbeamrainbowlabs d8be26d476
Merge branch 'main' of git.starbeamrainbowlabs.com:sbrl/PhD-Rainfall-Radar 2022-11-10 20:49:01 +00:00
Starbeamrainbowlabs b03388de60
dataset_segmenter: DEBUG: fix water shape 2022-11-10 20:48:21 +00:00
Starbeamrainbowlabs daf691bf43
typo 2022-11-10 19:55:00 +00:00
Starbeamrainbowlabs 0aa2ce19f5
read_metadata: support file inputs as well as dirs 2022-11-10 19:53:30 +00:00
Starbeamrainbowlabs aa7d9b8cf6
fixup 2022-11-10 19:46:09 +00:00
Starbeamrainbowlabs 0894bd09e8
train_predict: add error message for parrams.json not found 2022-11-10 19:45:41 +00:00
Starbeamrainbowlabs e519b0adb3
GzipChildProcess: spawn-stream is buggy IIRC 2022-11-09 16:43:05 +00:00
Starbeamrainbowlabs ddbf2cb734
slurm-process: -n28 → --exclusive 2022-11-04 17:42:50 +00:00
Starbeamrainbowlabs a762664063
slurm-process: -n28 fo uniq call 2022-11-04 17:23:20 +00:00
Starbeamrainbowlabs 0166b4d09e
slurm-process: change log file names 2022-11-04 17:11:10 +00:00
Starbeamrainbowlabs 0353072d15
allow pretrain to run on gpu
we've slashed the size of the 2nd encoder, so ti should fit naow?
2022-11-04 17:02:07 +00:00
Starbeamrainbowlabs 44ad51f483
CallbackNBatchCsv: bugfix .sort() → sorted() 2022-11-04 16:40:21 +00:00
Starbeamrainbowlabs 4dddcfcb42
pretrain_predict: missing \n 2022-11-04 16:01:28 +00:00
Starbeamrainbowlabs 1375201c5f
CallbackNBatchCsv: open_handle mode 2022-11-03 18:29:00 +00:00
Starbeamrainbowlabs 3206d6b7e7
slurm: rename segmenter job name 2022-11-03 17:12:27 +00:00
Starbeamrainbowlabs f2ae74ce7b
how could I be so stupid..... round 2 2022-11-02 17:38:26 +00:00
Starbeamrainbowlabs 441ad92b12
slurm: fixup 2022-11-01 19:57:15 +00:00
Starbeamrainbowlabs bc0e5f05a8
slurm: fixup 2022-11-01 19:55:04 +00:00
Starbeamrainbowlabs 784b8ed35c
recordify: catch NaN --count-file 2022-11-01 19:53:21 +00:00
Starbeamrainbowlabs c17a4ca05a
slurm: fix sanity logic 2022-11-01 19:38:04 +00:00
Starbeamrainbowlabs 79b231198f
slurm-process: check input files are readable 2022-11-01 19:03:37 +00:00