557 commits

Author	SHA1	Message	Date
Starbeamrainbowlabs	fe374560a1	I *hate* Tensorflow SO MUCH......	2024-11-14 22:38:27 +00:00
Starbeamrainbowlabs	7c4f3d325d	slurm/dlr: fix workaround logic	2024-11-14 22:28:39 +00:00
Starbeamrainbowlabs	17d2d2bcaf	slurm/dlr: tensorflow is dumb ... Workaround for this crash on Tensorflow 2.13: Could not load library libcublasLt.so.12. Error: libcublasLt.so.12: cannot open shared object file: No such file or directory	2024-11-14 22:26:16 +00:00
Starbeamrainbowlabs	52af6f00ec	dlr/dataset_mono: fix crash in new ssplit3 setup	2024-11-14 22:03:22 +00:00
Starbeamrainbowlabs	159f8a4679	slurm/dlr: DIR_RAINFALLWATER default → ~/data/....	2024-11-14 21:59:32 +00:00
Starbeamrainbowlabs	090ab78457	dlr: fix (another) crash	2024-11-14 21:53:59 +00:00
Starbeamrainbowlabs	7be2222207	dlr: import ...as env	2024-11-14 21:52:41 +00:00
Starbeamrainbowlabs	a7ab5ee341	slurm/dlr: cpu cores 14→9	2024-11-14 21:49:54 +00:00
Starbeamrainbowlabs	e83d901779	env.py: fix crash	2024-11-14 21:49:03 +00:00
Starbeamrainbowlabs	2b69d2c4f2	slurm/dlr: correct logging msg	2024-11-14 21:37:11 +00:00
Starbeamrainbowlabs	bd2c6b1c3f	slurm/dlr: don't runmodule load .... on csgpu cluster	2024-11-14 21:34:04 +00:00
Starbeamrainbowlabs	4ac7082754	write commit info to file in DIR_OUTPUT	2024-11-14 21:17:53 +00:00
Starbeamrainbowlabs	8befef5fc1	slurm/dlr: logging ... it Should™ work now? TODO test this!	2024-11-14 19:55:59 +00:00
Starbeamrainbowlabs	c82e4bf5ac	Merge branch 'main' of github.com:sbrl/research-rainfallradar	2024-11-14 19:09:39 +00:00
Starbeamrainbowlabs	daa923a88b	pyproject.toml: typo	2024-11-14 19:09:26 +00:00
Starbeamrainbowlabs	04ea305b70	dlr/slurm: implement USE_CONDA, module command opt-support	2024-11-08 21:47:55 +00:00
Starbeamrainbowlabs	f94f777f0a	dlr: make cv2 import optional	2024-11-01 20:40:55 +00:00
Starbeamrainbowlabs	e908e4b693	dlr: Note about RANDSEED	2024-08-30 18:50:26 +01:00
Starbeamrainbowlabs	0761651ccf	tvt: implement CallbackExtraValidation, which allows for a third split ... it should tie into Tensorflow's logging just fine so long as it's the first callback in the queue. ***** TEST SCRIPT ***** model = tf.keras.Sequential([ tf.keras.layers.Dense(64, activation='relu', input_shape=(10,)), tf.keras.layers.Dense(64, activation='relu'), tf.keras.layers.Dense(1) ]) model.compile(optimizer='adam', loss='mse', metrics=['mae']) X = np.random.random((100, 10)) y = np.random.random((100, 1)) split = 80 X_train, X_val = X[:split], X[split:] y_train, y_val = y[:split], y[split:] train_dataset = tf.data.Dataset.from_tensor_slices((X_train, y_train)).batch(10) val_dataset = tf.data.Dataset.from_tensor_slices((X_val, y_val)).batch(10) history = model.fit(train_dataset, epochs=10, validation_data=val_dataset, callbacks=[ CallbackExtraValidation({ "test": val_dataset }, verbose=0), tf.keras.callbacks.CSVLogger("/dev/stdout", separator="\t") ], verbose=0 ) print(f"DEBUG history {history}")	2024-08-30 18:07:17 +01:00
Starbeamrainbowlabs	e5f6e6394f	Implement initial UNTESTED support for split_validation and split_test	2024-08-29 19:33:40 +01:00
Starbeamrainbowlabs	b2b96ab636	replace tensorflow_addons with keras_cv	2024-08-29 19:32:54 +01:00
Starbeamrainbowlabs	2d73d84e20	uv pip sync doesn't install dependencies of packages	2024-08-29 19:31:42 +01:00
Starbeamrainbowlabs	b31485f7a1	add pyproject.toml	2024-08-29 18:58:57 +01:00
Starbeamrainbowlabs	61ee2326cf	licence change	2024-08-29 18:36:11 +01:00
Starbeamrainbowlabs	c98c42fa7e	dataset_mono: Implement validate_percentage + test_percentage support ... This removes the train_percentage argument TODO: map this forwards to enable support in deeplabv3_plus_test_rainfall ...thinking about it, it's really not a test now, is it? Updating the filename would be such a /hassle/ though....	2024-08-29 16:44:19 +01:00
Starbeamrainbowlabs	5d62e3cee8	Implement env from PhD-smflooding-scene	2024-08-29 16:43:29 +01:00
Starbeamrainbowlabs	a75d4f5d79	dataset_mono: add todo	2024-08-02 19:48:29 +01:00
Starbeamrainbowlabs	0f9f185983	dlr: add PARALLEL_READS env var, update docs	2023-11-30 16:33:22 +00:00
Starbeamrainbowlabs	e14fa275ab	rr de: rerun to recaalculate ... these values are accurate to our dataset now	2023-11-23 18:35:39 +00:00
Starbeamrainbowlabs	76b2956703	rr de: update to dataset_mono_predict	2023-11-03 15:48:53 +00:00
Starbeamrainbowlabs	e44b5533b1	plot_metrics_multi: add option to plot train/val separately	2023-07-20 15:49:09 +01:00
Starbeamrainbowlabs	b5b26d980b	dlr: print filepaths ... we need to know which is which with this seed so we can visualise for the paper	2023-07-13 19:58:38 +01:00
Starbeamrainbowlabs	636b316bfc	plot_multi: actually fix the plots	2023-07-05 16:35:26 +01:00
Starbeamrainbowlabs	9efc72db73	dlr ds/mono: just why	2023-06-16 18:36:18 +01:00
Starbeamrainbowlabs	a4e80229fb	dlr ds/mono: fixup	2023-06-16 18:35:02 +01:00
Starbeamrainbowlabs	7869505cfb	dlr: add PREDICT_AS_ONE	2023-06-16 18:23:40 +01:00
Starbeamrainbowlabs	4bbc4c29c4	plot_metrics_multi: add RESOLUTION env var	2023-06-14 15:50:37 +01:00
Starbeamrainbowlabs	18db54f0a7	plot_metrics_multi: FINALLY write a script to generate charts for multiple models at the same time	2023-06-08 18:13:20 +01:00
Starbeamrainbowlabs	fa37185950	plot_metrics: improve CLI	2023-06-08 15:20:32 +01:00
Starbeamrainbowlabs	3be38823db	dlr: fix another crash	2023-05-19 22:00:23 +01:00
Starbeamrainbowlabs	3e42972fb0	dlr: add comment	2023-05-11 17:45:52 +01:00
Starbeamrainbowlabs	fe05dd33fc	dlr: missing quotes	2023-05-11 16:23:36 +01:00
Starbeamrainbowlabs	5a73388a80	dlr: add RANDSEED to slurm	2023-05-11 16:02:13 +01:00
Starbeamrainbowlabs	ae0c672f60	Merge branch 'main' of git.starbeamrainbowlabs.com:sbrl/PhD-Rainfall-Radar	2023-05-11 15:59:08 +01:00
Starbeamrainbowlabs	20092c6829	shuffle: add random seed env var	2023-05-11 15:59:01 +01:00
Starbeamrainbowlabs	535bd6f579	dlr: fix crash	2023-05-07 19:00:02 +01:00
Starbeamrainbowlabs	ac040717e6	autoset the value of factor	2023-05-04 19:57:02 +01:00
Starbeamrainbowlabs	214afcc914	dlr: steps per execution is ugh	2023-05-04 19:54:51 +01:00
Starbeamrainbowlabs	f0a2e7c450	dlr: print values of new env vars	2023-05-04 19:42:40 +01:00
Starbeamrainbowlabs	8593999eb6	dlr: add JIT_COMPILE	2023-05-04 18:22:18 +01:00