yx21e commited on
Commit
a4fad25
verified
1 Parent(s): 1aa3aa7

Add FireWx-FM training and data loader pipeline

Browse files
Files changed (1) hide show
  1. README.md +14 -6
README.md CHANGED
@@ -37,6 +37,7 @@ pretty_name: WildFIRE-FM
37
  <p>
38
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM/blob/main/paper/wildfire_fm_evaluation_contracts.pdf"><b>Read the paper PDF</b></a> 路
39
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/models/wildfire_fm/checkpoints"><b>Download checkpoints</b></a> 路
 
40
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start"><b>Load the model</b></a> 路
41
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot"><b>Inspect task-contract results</b></a>
42
  </p>
@@ -48,6 +49,7 @@ pretty_name: WildFIRE-FM
48
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#release-navigation">Release Navigation</a> 路
49
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#visual-tour">Visual Tour</a> 路
50
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start">Quick Start</a> 路
 
51
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot">Task Snapshot</a> 路
52
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#data-sources">Data Sources</a> 路
53
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#how-to-cite">How to Cite</a>
@@ -79,6 +81,10 @@ pretty_name: WildFIRE-FM
79
  </td>
80
  </tr>
81
  <tr>
 
 
 
 
82
  <td width="33%" valign="top">
83
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start">Quick Start</a></h3>
84
  <p>Clone the repository, instantiate the model, load a seeded checkpoint, and run the artifact check.</p>
@@ -87,12 +93,12 @@ pretty_name: WildFIRE-FM
87
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot">Task Snapshot</a></h3>
88
  <p>View the final-paper task-contract summary for occupancy, spread, retrieval, burned area, smoke, and heat.</p>
89
  </td>
 
 
90
  <td width="33%" valign="top">
91
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/artifacts/results">Numeric Artifacts</a></h3>
92
  <p>Use sanitized CSV and JSON summaries that back the public model-card tables and figure previews.</p>
93
  </td>
94
- </tr>
95
- <tr>
96
  <td width="33%" valign="top">
97
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#visual-tour">Visual Tour</a></h3>
98
  <p>Browse final-paper previews for matching-rule sensitivity, selection regret, and task-form ranking changes.</p>
@@ -101,10 +107,6 @@ pretty_name: WildFIRE-FM
101
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/blob/main/data_sources/DATA_SOURCES.md">Data Sources</a></h3>
102
  <p>See the public provider links and roles for HRRR, FIRMS, LANDFIRE, WRC, LandScan, WFIGS, and MTBS.</p>
103
  </td>
104
- <td width="33%" valign="top">
105
- <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#repository-layout">Repository Layout</a></h3>
106
- <p>Find where checkpoints, manifests, scripts, paper outputs, and release documentation live in this Hub repo.</p>
107
- </td>
108
  </tr>
109
  </table>
110
 
@@ -193,6 +195,7 @@ This Hub repository is model-first. It provides the released weights, model-load
193
  | Training split | June-August 2024 train, September 2024 validation, October 2024 test |
194
  | Released checkpoints | 5 seeded PyTorch checkpoints |
195
  | Data access path | Source links and roles documented in `data_sources/` |
 
196
  | Paper artifact path | Compiled PDF in `paper/`; manuscript source managed in the authors' paper workspace |
197
 
198
  ### Input Channel Contract
@@ -224,6 +227,7 @@ This Hub repository is a model release with paper-aligned reproducibility artifa
224
  | `models/wildfire_fm/` | Model code, manifests, checkpoint metadata | `models/wildfire_fm/modeling_unet.py` |
225
  | `models/wildfire_fm/input_channels.json` | Machine-readable 16-channel input contract | `models/wildfire_fm/input_channels.json` |
226
  | `models/wildfire_fm/checkpoints/` | Five seeded PyTorch checkpoints | `seed_1/best_firms_prauc.pt` |
 
227
  | `paper/` | Compiled paper PDF | `wildfire_fm_evaluation_contracts.pdf` |
228
  | `assets/` | Hub-page visuals and final-paper previews | `selection_regret_final.png` |
229
  | `paper_outputs/figures/` | Selected final-paper figure PDFs | `fig_rank_heatmap1.pdf` |
@@ -319,6 +323,10 @@ WildFIRE-FM/
319
  modeling_unet.py
320
  checkpoint_manifest.json
321
  checkpoints/seed_*/best_firms_prauc.pt
 
 
 
 
322
  paper/
323
  wildfire_fm_evaluation_contracts.pdf
324
  assets/
 
37
  <p>
38
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM/blob/main/paper/wildfire_fm_evaluation_contracts.pdf"><b>Read the paper PDF</b></a> 路
39
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/models/wildfire_fm/checkpoints"><b>Download checkpoints</b></a> 路
40
+ <a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/training"><b>Training/data loader</b></a> 路
41
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start"><b>Load the model</b></a> 路
42
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot"><b>Inspect task-contract results</b></a>
43
  </p>
 
49
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#release-navigation">Release Navigation</a> 路
50
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#visual-tour">Visual Tour</a> 路
51
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start">Quick Start</a> 路
52
+ <a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/training">Training Pipeline</a> 路
53
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot">Task Snapshot</a> 路
54
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#data-sources">Data Sources</a> 路
55
  <a href="https://huggingface.co/RAI-Lab/Wildfire-FM#how-to-cite">How to Cite</a>
 
81
  </td>
82
  </tr>
83
  <tr>
84
+ <td width="33%" valign="top">
85
+ <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/training">Training/Data Loader</a></h3>
86
+ <p>Read the original cache builder, tensor assembly, tile sampler, full-map loader, and training loop.</p>
87
+ </td>
88
  <td width="33%" valign="top">
89
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start">Quick Start</a></h3>
90
  <p>Clone the repository, instantiate the model, load a seeded checkpoint, and run the artifact check.</p>
 
93
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot">Task Snapshot</a></h3>
94
  <p>View the final-paper task-contract summary for occupancy, spread, retrieval, burned area, smoke, and heat.</p>
95
  </td>
96
+ </tr>
97
+ <tr>
98
  <td width="33%" valign="top">
99
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/artifacts/results">Numeric Artifacts</a></h3>
100
  <p>Use sanitized CSV and JSON summaries that back the public model-card tables and figure previews.</p>
101
  </td>
 
 
102
  <td width="33%" valign="top">
103
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#visual-tour">Visual Tour</a></h3>
104
  <p>Browse final-paper previews for matching-rule sensitivity, selection regret, and task-form ranking changes.</p>
 
107
  <h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/blob/main/data_sources/DATA_SOURCES.md">Data Sources</a></h3>
108
  <p>See the public provider links and roles for HRRR, FIRMS, LANDFIRE, WRC, LandScan, WFIGS, and MTBS.</p>
109
  </td>
 
 
 
 
110
  </tr>
111
  </table>
112
 
 
195
  | Training split | June-August 2024 train, September 2024 validation, October 2024 test |
196
  | Released checkpoints | 5 seeded PyTorch checkpoints |
197
  | Data access path | Source links and roles documented in `data_sources/` |
198
+ | Training/data loader path | Original cache builder and PyTorch loader in `training/` |
199
  | Paper artifact path | Compiled PDF in `paper/`; manuscript source managed in the authors' paper workspace |
200
 
201
  ### Input Channel Contract
 
227
  | `models/wildfire_fm/` | Model code, manifests, checkpoint metadata | `models/wildfire_fm/modeling_unet.py` |
228
  | `models/wildfire_fm/input_channels.json` | Machine-readable 16-channel input contract | `models/wildfire_fm/input_channels.json` |
229
  | `models/wildfire_fm/checkpoints/` | Five seeded PyTorch checkpoints | `seed_1/best_firms_prauc.pt` |
230
+ | `training/` | Original cache builder, data loader, tile sampler, and training loop | `train_cold_tiled_mainline.py` |
231
  | `paper/` | Compiled paper PDF | `wildfire_fm_evaluation_contracts.pdf` |
232
  | `assets/` | Hub-page visuals and final-paper previews | `selection_regret_final.png` |
233
  | `paper_outputs/figures/` | Selected final-paper figure PDFs | `fig_rank_heatmap1.pdf` |
 
323
  modeling_unet.py
324
  checkpoint_manifest.json
325
  checkpoints/seed_*/best_firms_prauc.pt
326
+ training/
327
+ build_phase1_cache_regional_hrrr.py
328
+ train_cold_tiled_mainline.py
329
+ configs/
330
  paper/
331
  wildfire_fm_evaluation_contracts.pdf
332
  assets/