Commit graph

176 commits

Author SHA1 Message Date
Starbeamrainbowlabs 9e9852d066
UMAP: 100k random
no labels.
2022-09-27 15:52:45 +01:00
Starbeamrainbowlabs 58c65bdc86
slurm: allow predictions on gpu 2022-09-23 19:21:57 +01:00
Starbeamrainbowlabs d59de41ebb
embeddings: change title rendering; make even moar widererer
We need to see that parallel coordinates  plot in detail
2022-09-23 18:56:39 +01:00
Starbeamrainbowlabs b4ddb24589
slurm plot: compute → highmem 2022-09-22 18:27:58 +01:00
Starbeamrainbowlabs df12470e78
flip conda and time
hopefully we can capture the exit code this way
2022-09-21 14:40:28 +01:00
Starbeamrainbowlabs 5252a81238
vis: don't call add_subplot 2022-09-20 19:06:21 +01:00
Starbeamrainbowlabs 32bb55652b
slurm predict: autoqueue UMAP plot 2022-09-16 19:36:57 +01:00
Starbeamrainbowlabs 24c5263bf0
slurm predict-plot: fixup 2022-09-16 19:27:26 +01:00
Starbeamrainbowlabs 7e9c119b04
slurm: fix job name 2022-09-16 19:20:59 +01:00
Starbeamrainbowlabs 1574529704
slurm pretrain-predict: move to compute; make exclusive just in case
also shortent o 3 days
2022-09-16 19:17:42 +01:00
Starbeamrainbowlabs d7f5958af0
slurm: write new job files 2022-09-16 19:00:43 +01:00
Starbeamrainbowlabs a552cc4dad
ai vis: make parallel coordinates wider 2022-09-16 18:51:49 +01:00
Starbeamrainbowlabs a70794e661
umap: no min_dist 2022-09-16 17:09:09 +01:00
Starbeamrainbowlabs 5778fc51f7
embeddings: fix title; remove colourmap 2022-09-16 17:08:04 +01:00
Starbeamrainbowlabs 4fd852d782
fixup 2022-09-16 16:44:35 +01:00
Starbeamrainbowlabs fcab227f6a
cheese: set label for everything to 1 2022-09-16 16:42:05 +01:00
Starbeamrainbowlabs b31645bd5d
pretrain-plot: fix crash; remove water code
the model doesn't save the water encoder at this time
2022-09-16 16:24:07 +01:00
Starbeamrainbowlabs a5f03390ef
pretrain-plot: handle open w -> r 2022-09-16 16:14:30 +01:00
Starbeamrainbowlabs 1103ae5561
ai: tweak progress bar 2022-09-16 16:07:16 +01:00
Starbeamrainbowlabs 1e35802d2b
ai: fix embed i/o 2022-09-16 16:02:27 +01:00
Starbeamrainbowlabs ed94da7492
fixup 2022-09-16 15:51:26 +01:00
Starbeamrainbowlabs 366db658a8
ds predict: fix filenames in 2022-09-16 15:45:22 +01:00
Starbeamrainbowlabs e333dcba9c
tweak projection head 2022-09-16 15:36:01 +01:00
Starbeamrainbowlabs 6defd24000
bugfix: too many values to unpack 2022-09-15 19:56:17 +01:00
Starbeamrainbowlabs e3c8277255
ai: tweak the segmentation model structure 2022-09-15 19:54:50 +01:00
Starbeamrainbowlabs 1bc8a5bf13
ai: fix crash 2022-09-15 19:37:06 +01:00
Starbeamrainbowlabs bd64986332
ai: implement batched_iterator to replace .batch()
...apparently .batch() means you get a BatchedDataset or whatever when you iterate it like a tf.function instead of the actual tensor :-/
2022-09-15 19:16:38 +01:00
Starbeamrainbowlabs ccd256c00a
embed rainfall radar, not both 2022-09-15 17:37:04 +01:00
Starbeamrainbowlabs 2c74676902
predict → predict_on_batch 2022-09-15 17:31:50 +01:00
Starbeamrainbowlabs f036e79098
fixup 2022-09-15 17:09:26 +01:00
Starbeamrainbowlabs d5f1a26ba3
disable prefetching when predicting a thing 2022-09-15 17:09:09 +01:00
Starbeamrainbowlabs 8770638022
ai: call .predict(), not the model itself 2022-09-14 17:41:01 +01:00
Starbeamrainbowlabs a96cefde62
ai: predict oops 2022-09-14 17:37:48 +01:00
Starbeamrainbowlabs fa3165a5b2
dataset: simplify dataset_predict 2022-09-14 17:33:17 +01:00
Starbeamrainbowlabs 279e27c898
fixup 2022-09-14 17:16:49 +01:00
Starbeamrainbowlabs fad3313ede
fixup 2022-09-14 17:14:04 +01:00
Starbeamrainbowlabs 1e682661db
ai: kwargs in from_checkpoint 2022-09-14 17:11:06 +01:00
Starbeamrainbowlabs 6bda24d4da
ai: how did I miss that?!
bugfix ah/c
2022-09-14 16:53:43 +01:00
Starbeamrainbowlabs decdd434d8
ai from_checkpoint: bugfix 2022-09-14 16:49:01 +01:00
Starbeamrainbowlabs c9e00ea485
pretrain_predict: fix import 2022-09-14 16:02:36 +01:00
Starbeamrainbowlabs f568d8d19f
io.open → handle_open
this was we get transparent .gz support
2022-09-14 16:01:22 +01:00
Starbeamrainbowlabs 9b25186541
fix --only-gpu 2022-09-14 15:55:21 +01:00
Starbeamrainbowlabs a9c9c70d13
typo 2022-09-14 15:17:59 +01:00
Starbeamrainbowlabs fb8f884487
add umap dependencies 2022-09-14 15:16:45 +01:00
Starbeamrainbowlabs 1876a8883c
ai pretrain-predict: fix - → _ in cli parsing 2022-09-14 15:12:07 +01:00
Starbeamrainbowlabs f97b771922
make --help display help 2022-09-14 15:03:07 +01:00
Starbeamrainbowlabs 3c1aef5913
update help 2022-09-13 19:36:56 +01:00
Starbeamrainbowlabs 206257f9f5
ai pretrain_predict: no need to plot here anymore 2022-09-13 19:35:44 +01:00
Starbeamrainbowlabs 7685ec3e8b
implement ability to embed & plot pretrained embeddings 2022-09-13 19:18:59 +01:00
Starbeamrainbowlabs 7130c4fdf8
start implementing core image segmentation model 2022-09-07 17:45:38 +01:00