Instructions to use CluelessNovice/demo_regression with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use CluelessNovice/demo_regression with PEFT:
from peft import PeftModel from transformers import AutoModelForSequenceClassification base_model = AutoModelForSequenceClassification.from_pretrained("westlake-repl/SaProt_35M_AF2") model = PeftModel.from_pretrained(base_model, "CluelessNovice/demo_regression") - Notebooks
- Google Colab
- Kaggle
metadata
base_model: westlake-repl/SaProt_35M_AF2
library_name: peft
Model Card for Model-demo-35M
This model is used for a demo classification task
Task type
Protein-level Regression
Model input type
SA Sequence
Label meanings
A, B
LoRA config
- r: 8
- lora_dropout: 0.0
- lora_alpha: 16
- target_modules: ['value', 'intermediate.dense', 'key', 'query', 'output.dense']
- modules_to_save: ['classifier']
Training config
- optimizer:
- class: AdamW
- betas: (0.9, 0.98)
- weight_decay: 0.01
- learning rate: 0.001
- epoch: 1
- batch size: 2
- precision: 16-mixed