sbrl-github/research-rainfallradar
1
0
Fork 0
mirror of https://github.com/sbrl/research-rainfallradar synced 2024-07-02 19:34:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
607 commits 1 branch 0 tags 2.1 MiB
Commit graph

607 commits

This branch
This branch
All branches
Author SHA1 Message Date
Starbeamrainbowlabs b0e1aeac35
ai: knew it 2022-09-02 18:10:29 +01:00
Starbeamrainbowlabs ef0f15960d
send correct water shape to 2022-09-02 18:09:36 +01:00
Starbeamrainbowlabs ad156a9a00
ai dataset: centre crop the water data to 75% original size 
this should both help the model and reduce memory usage
 2022-09-02 18:05:32 +01:00
Starbeamrainbowlabs efe41b96ec
fixup 2022-09-02 17:58:02 +01:00
Starbeamrainbowlabs f8ee0afca1
ai: fix arch_name plumbing 2022-09-02 17:57:07 +01:00
Starbeamrainbowlabs 3d44831080
Add NO_PREFETCH env var 2022-09-02 17:55:04 +01:00
Starbeamrainbowlabs 3e0ca6a315
ai: fix summary file writing; make water encoder smaller 2022-09-02 17:51:45 +01:00
Starbeamrainbowlabs 389216b391
reordering 2022-09-02 17:31:19 +01:00
Starbeamrainbowlabs b9d01ddadc
summary logger → summarywriter 2022-09-02 17:28:00 +01:00
Starbeamrainbowlabs 9f7f4af784
dataset: properly resize 2022-09-02 17:09:38 +01:00
Starbeamrainbowlabs c78b6562ef
debug adjustment 2022-09-02 17:00:21 +01:00
Starbeamrainbowlabs c89677abd7
dataset: explicit reshape 2022-09-02 16:57:59 +01:00
Starbeamrainbowlabs c066ea331b
dataset: namespace → dict 
Python is so annoying
 2022-09-02 16:07:44 +01:00
Starbeamrainbowlabs dbff15d4a9
add bug comment 2022-09-01 19:05:50 +01:00
Starbeamrainbowlabs 9edda1f397
rainfallwrangler json2tfrecord.py: normalise data 2022-09-01 19:03:15 +01:00
Starbeamrainbowlabs 3e4128c0a8
resize rainfall to be 1/2 size of current 2022-09-01 18:47:07 +01:00
Starbeamrainbowlabs 8a86728b54
ai: how did I miss that 2022-09-01 18:07:53 +01:00
Starbeamrainbowlabs b2f1ba29bb
debug a 2022-09-01 18:05:33 +01:00
Starbeamrainbowlabs e2f621e212
even moar debug logging 2022-09-01 17:49:51 +01:00
Starbeamrainbowlabs 2663123407
moar logging 2022-09-01 17:40:23 +01:00
Starbeamrainbowlabs c2fcb3b954
ai: channels_first → channels_last 2022-09-01 17:06:18 +01:00
Starbeamrainbowlabs f1d7973f22
ai: add dummy label 2022-09-01 17:01:00 +01:00
Starbeamrainbowlabs 17d42fe899
ai: json.dumps 2022-09-01 16:21:52 +01:00
Starbeamrainbowlabs 940f7aa1b5
ai: set self.model 2022-09-01 16:20:23 +01:00
Starbeamrainbowlabs f1be5fe2bd
ai: add missing arguments to LossContrastive 2022-09-01 16:14:00 +01:00
Starbeamrainbowlabs ddb375e906
ai: another typo 2022-09-01 16:12:05 +01:00
Starbeamrainbowlabs cb3e1d3a23
ai: fixup 2022-09-01 16:10:50 +01:00
Starbeamrainbowlabs e4c95bc7e3
typo 2022-09-01 16:09:24 +01:00
Starbeamrainbowlabs cfbbe8e8cf
ai: global? really? 2022-09-01 16:06:24 +01:00
Starbeamrainbowlabs 4952ead094
ai: try the nonlocal keyword? I'm unsure what's going on here 
....clearly I need to read up on scoping in python.
 2022-09-01 16:02:37 +01:00
Starbeamrainbowlabs 1d9d0fbb73
requirements.txt:a dd tensorflow_addons 2022-09-01 15:56:02 +01:00
Starbeamrainbowlabs 8bdded23eb
ai: fix 'nother crash' name ConvNeXt submodels 2022-08-31 18:57:27 +01:00
Starbeamrainbowlabs b2a320134e
ai: typo 2022-08-31 18:54:03 +01:00
Starbeamrainbowlabs e4edc68df5
ai: add missing gamma layer 2022-08-31 18:52:35 +01:00
Starbeamrainbowlabs 51cf08a386
ResNetRSV2 → ConvNeXt 
ironically this makes the model simpler o/
 2022-08-31 18:51:01 +01:00
Starbeamrainbowlabs 3d614d105b
channels first 2022-08-31 18:06:59 +01:00
Starbeamrainbowlabs 654eefd9ca
properly handle water dimensions; add log files to .gitignore 
TODO: add heightmap
 2022-08-31 18:03:39 +01:00
Starbeamrainbowlabs 5846828f9e
debug logging 2022-08-31 17:48:09 +01:00
Starbeamrainbowlabs 12c77e128d
handle feature_dim properly 2022-08-31 17:41:51 +01:00
Starbeamrainbowlabs c52a9f961c
and another 2022-08-31 17:37:28 +01:00
Starbeamrainbowlabs 58dbabd561
fix another crash 2022-08-31 17:33:07 +01:00
Starbeamrainbowlabs 5fc0725917
slurm: chmod +x 2022-08-31 16:33:07 +01:00
Starbeamrainbowlabs dbf929325a
typo; add pretrain slurm job file 2022-08-31 16:32:17 +01:00
Starbeamrainbowlabs e0162bc70b
requirements.txt: add missing dependencies 2022-08-31 16:25:47 +01:00
Starbeamrainbowlabs f2312c1184
fix crash 2022-08-31 16:25:27 +01:00
Starbeamrainbowlabs fe7a8b3fc0
Add 9 simple steps to use the rainfall radar model..... oh boy. 2022-08-31 16:18:28 +01:00
Starbeamrainbowlabs 15a3519107
ai: the best thing about implementing a model is that you don't have to test it on the same day :P 2022-08-11 18:26:28 +01:00
Starbeamrainbowlabs 28bcdf2192
vscode settings file 2022-08-11 16:38:25 +01:00
Starbeamrainbowlabs c0a9cb12d8
ai: start creating initial model implementation. 
it's not hooked up to the CLI yet though.
Focus is still on ensuring the dataset is in the right format though
 2022-08-10 19:03:25 +01:00
Starbeamrainbowlabs 6cdf2b2389
wrangler python child: explicitly close stdout+stderr. 
Hopefully this will avoid any more hanging issues.
 2022-08-10 18:51:30 +01:00