Add FireWx-FM training and data loader pipeline
Browse files
README.md
CHANGED
|
@@ -37,6 +37,7 @@ pretty_name: WildFIRE-FM
|
|
| 37 |
<p>
|
| 38 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM/blob/main/paper/wildfire_fm_evaluation_contracts.pdf"><b>Read the paper PDF</b></a> 路
|
| 39 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/models/wildfire_fm/checkpoints"><b>Download checkpoints</b></a> 路
|
|
|
|
| 40 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start"><b>Load the model</b></a> 路
|
| 41 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot"><b>Inspect task-contract results</b></a>
|
| 42 |
</p>
|
|
@@ -48,6 +49,7 @@ pretty_name: WildFIRE-FM
|
|
| 48 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#release-navigation">Release Navigation</a> 路
|
| 49 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#visual-tour">Visual Tour</a> 路
|
| 50 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start">Quick Start</a> 路
|
|
|
|
| 51 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot">Task Snapshot</a> 路
|
| 52 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#data-sources">Data Sources</a> 路
|
| 53 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#how-to-cite">How to Cite</a>
|
|
@@ -79,6 +81,10 @@ pretty_name: WildFIRE-FM
|
|
| 79 |
</td>
|
| 80 |
</tr>
|
| 81 |
<tr>
|
|
|
|
|
|
|
|
|
|
|
|
|
| 82 |
<td width="33%" valign="top">
|
| 83 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start">Quick Start</a></h3>
|
| 84 |
<p>Clone the repository, instantiate the model, load a seeded checkpoint, and run the artifact check.</p>
|
|
@@ -87,12 +93,12 @@ pretty_name: WildFIRE-FM
|
|
| 87 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot">Task Snapshot</a></h3>
|
| 88 |
<p>View the final-paper task-contract summary for occupancy, spread, retrieval, burned area, smoke, and heat.</p>
|
| 89 |
</td>
|
|
|
|
|
|
|
| 90 |
<td width="33%" valign="top">
|
| 91 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/artifacts/results">Numeric Artifacts</a></h3>
|
| 92 |
<p>Use sanitized CSV and JSON summaries that back the public model-card tables and figure previews.</p>
|
| 93 |
</td>
|
| 94 |
-
</tr>
|
| 95 |
-
<tr>
|
| 96 |
<td width="33%" valign="top">
|
| 97 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#visual-tour">Visual Tour</a></h3>
|
| 98 |
<p>Browse final-paper previews for matching-rule sensitivity, selection regret, and task-form ranking changes.</p>
|
|
@@ -101,10 +107,6 @@ pretty_name: WildFIRE-FM
|
|
| 101 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/blob/main/data_sources/DATA_SOURCES.md">Data Sources</a></h3>
|
| 102 |
<p>See the public provider links and roles for HRRR, FIRMS, LANDFIRE, WRC, LandScan, WFIGS, and MTBS.</p>
|
| 103 |
</td>
|
| 104 |
-
<td width="33%" valign="top">
|
| 105 |
-
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#repository-layout">Repository Layout</a></h3>
|
| 106 |
-
<p>Find where checkpoints, manifests, scripts, paper outputs, and release documentation live in this Hub repo.</p>
|
| 107 |
-
</td>
|
| 108 |
</tr>
|
| 109 |
</table>
|
| 110 |
|
|
@@ -193,6 +195,7 @@ This Hub repository is model-first. It provides the released weights, model-load
|
|
| 193 |
| Training split | June-August 2024 train, September 2024 validation, October 2024 test |
|
| 194 |
| Released checkpoints | 5 seeded PyTorch checkpoints |
|
| 195 |
| Data access path | Source links and roles documented in `data_sources/` |
|
|
|
|
| 196 |
| Paper artifact path | Compiled PDF in `paper/`; manuscript source managed in the authors' paper workspace |
|
| 197 |
|
| 198 |
### Input Channel Contract
|
|
@@ -224,6 +227,7 @@ This Hub repository is a model release with paper-aligned reproducibility artifa
|
|
| 224 |
| `models/wildfire_fm/` | Model code, manifests, checkpoint metadata | `models/wildfire_fm/modeling_unet.py` |
|
| 225 |
| `models/wildfire_fm/input_channels.json` | Machine-readable 16-channel input contract | `models/wildfire_fm/input_channels.json` |
|
| 226 |
| `models/wildfire_fm/checkpoints/` | Five seeded PyTorch checkpoints | `seed_1/best_firms_prauc.pt` |
|
|
|
|
| 227 |
| `paper/` | Compiled paper PDF | `wildfire_fm_evaluation_contracts.pdf` |
|
| 228 |
| `assets/` | Hub-page visuals and final-paper previews | `selection_regret_final.png` |
|
| 229 |
| `paper_outputs/figures/` | Selected final-paper figure PDFs | `fig_rank_heatmap1.pdf` |
|
|
@@ -319,6 +323,10 @@ WildFIRE-FM/
|
|
| 319 |
modeling_unet.py
|
| 320 |
checkpoint_manifest.json
|
| 321 |
checkpoints/seed_*/best_firms_prauc.pt
|
|
|
|
|
|
|
|
|
|
|
|
|
| 322 |
paper/
|
| 323 |
wildfire_fm_evaluation_contracts.pdf
|
| 324 |
assets/
|
|
|
|
| 37 |
<p>
|
| 38 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM/blob/main/paper/wildfire_fm_evaluation_contracts.pdf"><b>Read the paper PDF</b></a> 路
|
| 39 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/models/wildfire_fm/checkpoints"><b>Download checkpoints</b></a> 路
|
| 40 |
+
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/training"><b>Training/data loader</b></a> 路
|
| 41 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start"><b>Load the model</b></a> 路
|
| 42 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot"><b>Inspect task-contract results</b></a>
|
| 43 |
</p>
|
|
|
|
| 49 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#release-navigation">Release Navigation</a> 路
|
| 50 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#visual-tour">Visual Tour</a> 路
|
| 51 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start">Quick Start</a> 路
|
| 52 |
+
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/training">Training Pipeline</a> 路
|
| 53 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot">Task Snapshot</a> 路
|
| 54 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#data-sources">Data Sources</a> 路
|
| 55 |
<a href="https://huggingface.co/RAI-Lab/Wildfire-FM#how-to-cite">How to Cite</a>
|
|
|
|
| 81 |
</td>
|
| 82 |
</tr>
|
| 83 |
<tr>
|
| 84 |
+
<td width="33%" valign="top">
|
| 85 |
+
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/training">Training/Data Loader</a></h3>
|
| 86 |
+
<p>Read the original cache builder, tensor assembly, tile sampler, full-map loader, and training loop.</p>
|
| 87 |
+
</td>
|
| 88 |
<td width="33%" valign="top">
|
| 89 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#quick-start">Quick Start</a></h3>
|
| 90 |
<p>Clone the repository, instantiate the model, load a seeded checkpoint, and run the artifact check.</p>
|
|
|
|
| 93 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#task-contract-snapshot">Task Snapshot</a></h3>
|
| 94 |
<p>View the final-paper task-contract summary for occupancy, spread, retrieval, burned area, smoke, and heat.</p>
|
| 95 |
</td>
|
| 96 |
+
</tr>
|
| 97 |
+
<tr>
|
| 98 |
<td width="33%" valign="top">
|
| 99 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/tree/main/artifacts/results">Numeric Artifacts</a></h3>
|
| 100 |
<p>Use sanitized CSV and JSON summaries that back the public model-card tables and figure previews.</p>
|
| 101 |
</td>
|
|
|
|
|
|
|
| 102 |
<td width="33%" valign="top">
|
| 103 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM#visual-tour">Visual Tour</a></h3>
|
| 104 |
<p>Browse final-paper previews for matching-rule sensitivity, selection regret, and task-form ranking changes.</p>
|
|
|
|
| 107 |
<h3><a href="https://huggingface.co/RAI-Lab/Wildfire-FM/blob/main/data_sources/DATA_SOURCES.md">Data Sources</a></h3>
|
| 108 |
<p>See the public provider links and roles for HRRR, FIRMS, LANDFIRE, WRC, LandScan, WFIGS, and MTBS.</p>
|
| 109 |
</td>
|
|
|
|
|
|
|
|
|
|
|
|
|
| 110 |
</tr>
|
| 111 |
</table>
|
| 112 |
|
|
|
|
| 195 |
| Training split | June-August 2024 train, September 2024 validation, October 2024 test |
|
| 196 |
| Released checkpoints | 5 seeded PyTorch checkpoints |
|
| 197 |
| Data access path | Source links and roles documented in `data_sources/` |
|
| 198 |
+
| Training/data loader path | Original cache builder and PyTorch loader in `training/` |
|
| 199 |
| Paper artifact path | Compiled PDF in `paper/`; manuscript source managed in the authors' paper workspace |
|
| 200 |
|
| 201 |
### Input Channel Contract
|
|
|
|
| 227 |
| `models/wildfire_fm/` | Model code, manifests, checkpoint metadata | `models/wildfire_fm/modeling_unet.py` |
|
| 228 |
| `models/wildfire_fm/input_channels.json` | Machine-readable 16-channel input contract | `models/wildfire_fm/input_channels.json` |
|
| 229 |
| `models/wildfire_fm/checkpoints/` | Five seeded PyTorch checkpoints | `seed_1/best_firms_prauc.pt` |
|
| 230 |
+
| `training/` | Original cache builder, data loader, tile sampler, and training loop | `train_cold_tiled_mainline.py` |
|
| 231 |
| `paper/` | Compiled paper PDF | `wildfire_fm_evaluation_contracts.pdf` |
|
| 232 |
| `assets/` | Hub-page visuals and final-paper previews | `selection_regret_final.png` |
|
| 233 |
| `paper_outputs/figures/` | Selected final-paper figure PDFs | `fig_rank_heatmap1.pdf` |
|
|
|
|
| 323 |
modeling_unet.py
|
| 324 |
checkpoint_manifest.json
|
| 325 |
checkpoints/seed_*/best_firms_prauc.pt
|
| 326 |
+
training/
|
| 327 |
+
build_phase1_cache_regional_hrrr.py
|
| 328 |
+
train_cold_tiled_mainline.py
|
| 329 |
+
configs/
|
| 330 |
paper/
|
| 331 |
wildfire_fm_evaluation_contracts.pdf
|
| 332 |
assets/
|