54 Commits

Author SHA1 Message Date
Hannes Signer
4fe35855f0 Merge branch 'main' of git.gfz-potsdam.de:naaice/model-training 2025-02-27 12:05:31 +01:00
Hannes Signer
91fd34bce0 Merge branch 'loss-experiment' 2025-02-27 12:04:13 +01:00
Hannes Martin Signer
1d9d193668 update julia script 2025-02-27 11:44:51 +01:00
Hannes Martin Signer
5fee700eae Merge branch 'log-scale-error' into 'loss-experiment'
Solve scaling error with min max scaling and restructure notebook as well as preprocessing functions

See merge request naaice/model-training!3
2025-02-27 11:42:05 +01:00
Hannes Signer
471038de50 update linting 2025-02-26 18:51:40 +01:00
Hannes Signer
5f4c863b39 first draft for students 2025-02-26 18:32:22 +01:00
Hannes Signer
331306c141 update mass_balance_evaluation 2025-02-26 18:32:11 +01:00
Hannes Signer
cce2f696a0 document functions 2025-02-26 12:57:39 +01:00
Hannes Signer
03918222c4 test with losses 2025-02-25 18:36:11 +01:00
Hannes Signer
0f7ee78a8a correction of scaling error in mass balance loss 2025-02-25 18:06:56 +01:00
Hannes Signer
8051eb3c3d investigate scaling error 2025-02-21 16:57:55 +01:00
Hannes Signer
c0ca00271e adapt notebook 2025-02-21 09:42:33 +01:00
Hannes Signer
5ffcd75adc update test samples 2025-02-19 17:58:47 +01:00
Hannes Signer
df7cabfb31 update notebook to new training structure 2025-02-18 20:47:24 +01:00
Hannes Signer
1381e9a879 add first models 2025-02-18 20:28:43 +01:00
Hannes Signer
7642d22d4d add 4 corner small dataset 2025-02-18 20:08:13 +01:00
Hannes Signer
3bf4ff42a0 add dataset 2025-02-18 20:06:23 +01:00
Hannes Signer
bf0dfcb690 delete cache 2025-02-18 19:55:13 +01:00
Hannes Signer
c447a6c84a Merge branch 'loss-experiment' of git.gfz-potsdam.de:naaice/model-training into loss-experiment 2025-02-18 17:16:16 +01:00
Hannes Signer
1a3787c530 add measurement plan 2025-02-18 17:08:50 +01:00
Hannes Signer
b58e8869ad prepare optimization study 2025-02-18 17:05:24 +01:00
Hannes Signer
052cf356c9 restructure project 2025-02-18 14:41:41 +01:00
Hannes Signer
019a426af4 update gitignore 2025-02-17 22:23:48 +01:00
Hannes Signer
4a86161cce test combined loss functions 2025-02-17 22:23:28 +01:00
Hannes Signer
986191f72c update training 2025-02-17 18:13:57 +01:00
Max Lübke
5413be8610 Merge branch 'ml/add-iteration' into 'main'
feat: Add iteration number to transport and chemistry DataFrames

See merge request naaice/model-training!2
2025-02-17 14:28:31 +01:00
Max Luebke
ed70b85775 feat: Add iteration number to transport and chemistry DataFrames 2025-02-17 14:27:07 +01:00
Hannes Signer
d27e9e9c5d add optimizer framework 2025-02-17 00:11:36 +01:00
Hannes Signer
3171dd3643 custom loss function 2025-02-14 16:33:32 +01:00
Hannes Signer
e9f49308f2 further tests 2025-02-13 17:11:45 +01:00
Hannes Signer
4d7502c309 Merge branch 'loss-experiment' of git.gfz-potsdam.de:naaice/model-training into loss-experiment 2025-02-11 17:22:13 +01:00
Hannes Signer
a0145576f4 add new model architecture 2025-02-11 17:17:43 +01:00
Hannes Signer
3eb46f6c26 further experiments 2025-01-24 16:28:56 +01:00
Hannes Signer
67b1f23fa3 update preprocessing 2025-01-23 17:51:26 +01:00
Hannes Signer
78a57654a3 encapsulate functionality 2025-01-22 17:36:06 +01:00
Hannes Signer
a4c419c618 add template class 2025-01-21 17:36:41 +01:00
Hannes Signer
81d35796f8 add custom scaler steps 2025-01-20 19:40:57 +01:00
Hannes Signer
f0a4ddddc6 add new dataset 2025-01-20 10:25:27 +01:00
Hannes Signer
d517ca6540 add sampling function 2025-01-15 17:23:58 +01:00
Hannes Signer
bea094be35 update sampling methods 2025-01-15 16:04:14 +01:00
Hannes Signer
6872dc1aed add normal oversampling 2025-01-15 14:11:13 +01:00
Max Lübke
91791d7e61 Merge branch 'ml/new-data-set' into 'main'
Add convert script and new data set

See merge request naaice/model-training!1
2025-01-15 13:43:03 +01:00
Max Lübke
9e884bcc99 Add convert script and new data set 2025-01-15 13:42:27 +01:00
Hannes Signer
78cd2f2083 add data conversion script 2025-01-15 12:02:54 +01:00
Hannes Signer
66fd10c19e add SMORT sampling 2025-01-15 12:01:22 +01:00
Hannes Signer
bb94da79d7 add data conversion script 2025-01-15 12:00:30 +01:00
Hannes Signer
746b469ba7 correct swapped variables 2025-01-15 11:55:24 +01:00
Hannes Signer
4ee967f613 add SMOT sampling strategy 2025-01-15 11:50:05 +01:00
Hannes Signer
60f0165df1 add SMOT sampling strategy 2025-01-15 11:49:01 +01:00
Hannes Signer
f89228de06 add kmeans clustering 2025-01-14 17:48:41 +01:00