Alexossss commited on
Commit
7830b28
·
verified ·
1 Parent(s): dae9b7e

Model save

Browse files
README.md CHANGED
@@ -1,6 +1,5 @@
1
  ---
2
  base_model: HuggingFaceTB/SmolLM2-135M-Instruct
3
- datasets: QuyenAnhDE/Diseases_Symptoms
4
  library_name: transformers
5
  model_name: medicalia
6
  tags:
@@ -12,7 +11,7 @@ licence: license
12
 
13
  # Model Card for medicalia
14
 
15
- This model is a fine-tuned version of [HuggingFaceTB/SmolLM2-135M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct) on the [QuyenAnhDE/Diseases_Symptoms](https://huggingface.co/datasets/QuyenAnhDE/Diseases_Symptoms) dataset.
16
  It has been trained using [TRL](https://github.com/huggingface/trl).
17
 
18
  ## Quick start
@@ -28,7 +27,7 @@ print(output["generated_text"])
28
 
29
  ## Training procedure
30
 
31
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/alexandredsb-pro-universit-savoie-mont-blanc/huggingface/runs/c0a07g0o)
32
 
33
 
34
  This model was trained with SFT.
 
1
  ---
2
  base_model: HuggingFaceTB/SmolLM2-135M-Instruct
 
3
  library_name: transformers
4
  model_name: medicalia
5
  tags:
 
11
 
12
  # Model Card for medicalia
13
 
14
+ This model is a fine-tuned version of [HuggingFaceTB/SmolLM2-135M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/alexandredsb-pro-universit-savoie-mont-blanc/huggingface/runs/em5dufak)
31
 
32
 
33
  This model was trained with SFT.
final_checkpoint/adapter_config.json CHANGED
@@ -23,10 +23,10 @@
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
26
- "q_proj",
27
- "k_proj",
28
  "o_proj",
29
- "v_proj"
 
 
30
  ],
31
  "task_type": "CAUSAL_LM",
32
  "use_dora": false,
 
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
 
 
26
  "o_proj",
27
+ "v_proj",
28
+ "k_proj",
29
+ "q_proj"
30
  ],
31
  "task_type": "CAUSAL_LM",
32
  "use_dora": false,
final_checkpoint/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:df91e4562c1e11836d7c81a758771631615eb21d3ee825616951e81854e347a8
3
  size 5688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14d9de219e42f571c1387a3be86558b79b2b2b729deb836e82cc2460151cc60a
3
  size 5688