|
|
| --- |
| |
| base_model: westlake-repl/SaProt_35M_AF2 |
|
|
| library_name: peft |
|
|
| --- |
| |
|
|
|
|
| # Model Card for Model-demo-35M |
| This model is used for a demo classification task |
|
|
| ## Task type |
| Protein-level Regression |
|
|
| ## Model input type |
| SA Sequence |
|
|
| ## Label meanings |
| A, B |
|
|
| ## LoRA config |
|
|
| - **r:** 8 |
| - **lora_dropout:** 0.0 |
| - **lora_alpha:** 16 |
| - **target_modules:** ['value', 'intermediate.dense', 'key', 'query', 'output.dense'] |
| - **modules_to_save:** ['classifier'] |
| |
| ## Training config |
| |
| - **optimizer:** |
| - **class:** AdamW |
| - **betas:** (0.9, 0.98) |
| - **weight_decay:** 0.01 |
| - **learning rate:** 0.001 |
| - **epoch:** 1 |
| - **batch size:** 2 |
| - **precision:** 16-mixed |
|
|
|
|
