Commit graph

594 commits

Author SHA1 Message Date
Starbeamrainbowlabs a96cefde62
ai: predict oops 2022-09-14 17:37:48 +01:00
Starbeamrainbowlabs fa3165a5b2
dataset: simplify dataset_predict 2022-09-14 17:33:17 +01:00
Starbeamrainbowlabs 279e27c898
fixup 2022-09-14 17:16:49 +01:00
Starbeamrainbowlabs fad3313ede
fixup 2022-09-14 17:14:04 +01:00
Starbeamrainbowlabs 1e682661db
ai: kwargs in from_checkpoint 2022-09-14 17:11:06 +01:00
Starbeamrainbowlabs 6bda24d4da
ai: how did I miss that?!
bugfix ah/c
2022-09-14 16:53:43 +01:00
Starbeamrainbowlabs decdd434d8
ai from_checkpoint: bugfix 2022-09-14 16:49:01 +01:00
Starbeamrainbowlabs c9e00ea485
pretrain_predict: fix import 2022-09-14 16:02:36 +01:00
Starbeamrainbowlabs f568d8d19f
io.open → handle_open
this was we get transparent .gz support
2022-09-14 16:01:22 +01:00
Starbeamrainbowlabs 9b25186541
fix --only-gpu 2022-09-14 15:55:21 +01:00
Starbeamrainbowlabs a9c9c70d13
typo 2022-09-14 15:17:59 +01:00
Starbeamrainbowlabs fb8f884487
add umap dependencies 2022-09-14 15:16:45 +01:00
Starbeamrainbowlabs 1876a8883c
ai pretrain-predict: fix - → _ in cli parsing 2022-09-14 15:12:07 +01:00
Starbeamrainbowlabs f97b771922
make --help display help 2022-09-14 15:03:07 +01:00
Starbeamrainbowlabs 3c1aef5913
update help 2022-09-13 19:36:56 +01:00
Starbeamrainbowlabs 206257f9f5
ai pretrain_predict: no need to plot here anymore 2022-09-13 19:35:44 +01:00
Starbeamrainbowlabs 7685ec3e8b
implement ability to embed & plot pretrained embeddings 2022-09-13 19:18:59 +01:00
Starbeamrainbowlabs 7130c4fdf8
start implementing core image segmentation model 2022-09-07 17:45:38 +01:00
Starbeamrainbowlabs 22620a1854
ai: implement saving only the rainfall encoder 2022-09-06 19:48:46 +01:00
Starbeamrainbowlabs 4c4358c3e5
whitespace 2022-09-06 16:24:11 +01:00
Starbeamrainbowlabs 4202821d98
typo 2022-09-06 15:37:36 +01:00
Starbeamrainbowlabs 3e13ad12c8
ai Bugfix LayerContrastiveEncoder: channels → input_channels
for consistency
2022-09-05 23:53:16 +01:00
Starbeamrainbowlabs ead8009425
pretrain: add CLI arg for size of watch prediction width/height 2022-09-05 15:36:40 +01:00
Starbeamrainbowlabs 9d39215dd5
dataset: drop incomplete batches 2022-09-05 15:36:10 +01:00
Starbeamrainbowlabs c94f5d042e
ai: slurm fixup again 2022-09-02 19:13:56 +01:00
Starbeamrainbowlabs 7917820e59
ai: slurm fixup 2022-09-02 19:11:54 +01:00
Starbeamrainbowlabs cd104190e8
slurm: no need to be exclusive anymore 2022-09-02 19:09:45 +01:00
Starbeamrainbowlabs a9dede7bfe
ai: n=10 slurm 2022-09-02 19:09:07 +01:00
Starbeamrainbowlabs 42de502f99
slurm-pretrain: set name 2022-09-02 19:08:16 +01:00
Starbeamrainbowlabs 457c2eef0d
ai: fixup 2022-09-02 19:06:54 +01:00
Starbeamrainbowlabs a3f03b6d8d
slurm-pretrain: prepare 2022-09-02 19:05:18 +01:00
Starbeamrainbowlabs 1d1533d160
ai: how did things get this confusing 2022-09-02 18:51:46 +01:00
Starbeamrainbowlabs 1c5defdcd6
ai: cats 2022-09-02 18:45:23 +01:00
Starbeamrainbowlabs 6135bcd0cd
fixup 2022-09-02 18:41:31 +01:00
Starbeamrainbowlabs c33c0a0899
ai: these shapes are so annoying 2022-09-02 18:39:24 +01:00
Starbeamrainbowlabs 88acd54a97
ai: off-by-one 2022-09-02 18:13:48 +01:00
Starbeamrainbowlabs 23bcd294c4
AI: 0.75 → 0.5? 2022-09-02 18:12:51 +01:00
Starbeamrainbowlabs b0e1aeac35
ai: knew it 2022-09-02 18:10:29 +01:00
Starbeamrainbowlabs ef0f15960d
send correct water shape to 2022-09-02 18:09:36 +01:00
Starbeamrainbowlabs ad156a9a00
ai dataset: centre crop the water data to 75% original size
this should both help the model and reduce memory usage
2022-09-02 18:05:32 +01:00
Starbeamrainbowlabs efe41b96ec
fixup 2022-09-02 17:58:02 +01:00
Starbeamrainbowlabs f8ee0afca1
ai: fix arch_name plumbing 2022-09-02 17:57:07 +01:00
Starbeamrainbowlabs 3d44831080
Add NO_PREFETCH env var 2022-09-02 17:55:04 +01:00
Starbeamrainbowlabs 3e0ca6a315
ai: fix summary file writing; make water encoder smaller 2022-09-02 17:51:45 +01:00
Starbeamrainbowlabs 389216b391
reordering 2022-09-02 17:31:19 +01:00
Starbeamrainbowlabs b9d01ddadc
summary logger → summarywriter 2022-09-02 17:28:00 +01:00
Starbeamrainbowlabs 9f7f4af784
dataset: properly resize 2022-09-02 17:09:38 +01:00
Starbeamrainbowlabs c78b6562ef
debug adjustment 2022-09-02 17:00:21 +01:00
Starbeamrainbowlabs c89677abd7
dataset: explicit reshape 2022-09-02 16:57:59 +01:00
Starbeamrainbowlabs c066ea331b
dataset: namespace → dict
Python is so annoying
2022-09-02 16:07:44 +01:00