Commit graph

594 commits

Author SHA1 Message Date
Starbeamrainbowlabs 3dee3d8908
update cli help 2022-09-28 16:23:47 +01:00
Starbeamrainbowlabs b836f7f70c
again 2022-09-27 19:06:41 +01:00
Starbeamrainbowlabs 52dff130dd
slurm pretraian predict: moar logging 2022-09-27 19:05:54 +01:00
Starbeamrainbowlabs 2d24174e0a
slurm pretrain predict: add $OUTPUT 2022-09-27 18:58:02 +01:00
Starbeamrainbowlabs 7d0e3913ae
fix logging 2022-09-27 18:51:58 +01:00
Starbeamrainbowlabs d765b3b14e
fix crash 2022-09-27 18:43:43 +01:00
Starbeamrainbowlabs 2cd59a01a5
slurm-pretrain-plot: add ARGS 2022-09-27 18:41:35 +01:00
Starbeamrainbowlabs f4d1d1d77e
just wh 2022-09-27 18:25:45 +01:00
Starbeamrainbowlabs 4c24d69ae6
$d → +d 2022-09-27 18:17:07 +01:00
Starbeamrainbowlabs cdb19b4d9f
fixup 2022-09-27 18:13:21 +01:00
Starbeamrainbowlabs c4d3c16873
add some logging 2022-09-27 18:10:58 +01:00
Starbeamrainbowlabs 3772c3227e
fixup 2022-09-27 17:57:21 +01:00
Starbeamrainbowlabs dbfa45a016
write params.json properly 2022-09-27 17:49:54 +01:00
Starbeamrainbowlabs a5455dc22a
fix import 2022-09-27 17:41:24 +01:00
Starbeamrainbowlabs d6ff3fb2ce
pretrain_predict fix write mode 2022-09-27 17:38:12 +01:00
Starbeamrainbowlabs f95fd8f9e4
pretrain-predict: add .tfrecord output function 2022-09-27 16:59:31 +01:00
Starbeamrainbowlabs 30b8dd063e
fixup 2022-09-27 15:54:37 +01:00
Starbeamrainbowlabs 3cf99587e4
Contraster: add gamma layer to load_model 2022-09-27 15:53:52 +01:00
Starbeamrainbowlabs 9e9852d066
UMAP: 100k random
no labels.
2022-09-27 15:52:45 +01:00
Starbeamrainbowlabs 58c65bdc86
slurm: allow predictions on gpu 2022-09-23 19:21:57 +01:00
Starbeamrainbowlabs d59de41ebb
embeddings: change title rendering; make even moar widererer
We need to see that parallel coordinates  plot in detail
2022-09-23 18:56:39 +01:00
Starbeamrainbowlabs b4ddb24589
slurm plot: compute → highmem 2022-09-22 18:27:58 +01:00
Starbeamrainbowlabs df12470e78
flip conda and time
hopefully we can capture the exit code this way
2022-09-21 14:40:28 +01:00
Starbeamrainbowlabs 5252a81238
vis: don't call add_subplot 2022-09-20 19:06:21 +01:00
Starbeamrainbowlabs 32bb55652b
slurm predict: autoqueue UMAP plot 2022-09-16 19:36:57 +01:00
Starbeamrainbowlabs 24c5263bf0
slurm predict-plot: fixup 2022-09-16 19:27:26 +01:00
Starbeamrainbowlabs 7e9c119b04
slurm: fix job name 2022-09-16 19:20:59 +01:00
Starbeamrainbowlabs 1574529704
slurm pretrain-predict: move to compute; make exclusive just in case
also shortent o 3 days
2022-09-16 19:17:42 +01:00
Starbeamrainbowlabs d7f5958af0
slurm: write new job files 2022-09-16 19:00:43 +01:00
Starbeamrainbowlabs a552cc4dad
ai vis: make parallel coordinates wider 2022-09-16 18:51:49 +01:00
Starbeamrainbowlabs a70794e661
umap: no min_dist 2022-09-16 17:09:09 +01:00
Starbeamrainbowlabs 5778fc51f7
embeddings: fix title; remove colourmap 2022-09-16 17:08:04 +01:00
Starbeamrainbowlabs 4fd852d782
fixup 2022-09-16 16:44:35 +01:00
Starbeamrainbowlabs fcab227f6a
cheese: set label for everything to 1 2022-09-16 16:42:05 +01:00
Starbeamrainbowlabs b31645bd5d
pretrain-plot: fix crash; remove water code
the model doesn't save the water encoder at this time
2022-09-16 16:24:07 +01:00
Starbeamrainbowlabs a5f03390ef
pretrain-plot: handle open w -> r 2022-09-16 16:14:30 +01:00
Starbeamrainbowlabs 1103ae5561
ai: tweak progress bar 2022-09-16 16:07:16 +01:00
Starbeamrainbowlabs 1e35802d2b
ai: fix embed i/o 2022-09-16 16:02:27 +01:00
Starbeamrainbowlabs ed94da7492
fixup 2022-09-16 15:51:26 +01:00
Starbeamrainbowlabs 366db658a8
ds predict: fix filenames in 2022-09-16 15:45:22 +01:00
Starbeamrainbowlabs e333dcba9c
tweak projection head 2022-09-16 15:36:01 +01:00
Starbeamrainbowlabs 6defd24000
bugfix: too many values to unpack 2022-09-15 19:56:17 +01:00
Starbeamrainbowlabs e3c8277255
ai: tweak the segmentation model structure 2022-09-15 19:54:50 +01:00
Starbeamrainbowlabs 1bc8a5bf13
ai: fix crash 2022-09-15 19:37:06 +01:00
Starbeamrainbowlabs bd64986332
ai: implement batched_iterator to replace .batch()
...apparently .batch() means you get a BatchedDataset or whatever when you iterate it like a tf.function instead of the actual tensor :-/
2022-09-15 19:16:38 +01:00
Starbeamrainbowlabs ccd256c00a
embed rainfall radar, not both 2022-09-15 17:37:04 +01:00
Starbeamrainbowlabs 2c74676902
predict → predict_on_batch 2022-09-15 17:31:50 +01:00
Starbeamrainbowlabs f036e79098
fixup 2022-09-15 17:09:26 +01:00
Starbeamrainbowlabs d5f1a26ba3
disable prefetching when predicting a thing 2022-09-15 17:09:09 +01:00
Starbeamrainbowlabs 8770638022
ai: call .predict(), not the model itself 2022-09-14 17:41:01 +01:00