Pritesh-2711 commited on
Commit
fe82d66
·
verified ·
1 Parent(s): ca858c7

Upload PIIBench Direct DeBERTa fine-tuned model

Browse files
Files changed (2) hide show
  1. README.md +44 -11
  2. tokenizer_config.json +1 -6
README.md CHANGED
@@ -1,24 +1,57 @@
1
  ---
2
- license: apache-2.0
3
  library_name: transformers
4
  pipeline_tag: token-classification
5
  base_model: microsoft/deberta-v3-base
 
 
 
 
6
  tags:
7
  - pii-detection
8
  - token-classification
9
  - named-entity-recognition
10
  - deberta
11
  - piibench
12
- datasets:
13
- - Pritesh-2711/pii-bench
14
- metrics:
15
- - f1
16
  ---
17
 
18
- # PIIBench DeBERTa Base Model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
- Dataset: https://huggingface.co/datasets/Pritesh-2711/pii-bench
21
- GitHub: https://github.com/pritesh-2711/pii-bench
22
- Full test F1: 0.6455
23
- Precision: 0.6277
24
- Recall: 0.6645
 
1
  ---
2
+ license: other
3
  library_name: transformers
4
  pipeline_tag: token-classification
5
  base_model: microsoft/deberta-v3-base
6
+ datasets:
7
+ - Pritesh-2711/pii-bench
8
+ metrics:
9
+ - f1
10
  tags:
11
  - pii-detection
12
  - token-classification
13
  - named-entity-recognition
14
  - deberta
15
  - piibench
 
 
 
 
16
  ---
17
 
18
+ # PIIBench Direct Fine-Tuned DeBERTa
19
+
20
+ This is the final selected PIIBench model: a standard DeBERTa-v3-base token
21
+ classifier trained directly on the prepared multi-source PII benchmark splits.
22
+ It outperformed the source-conditioned hierarchical comparison model on the
23
+ complete held-out experiment test split.
24
+
25
+ ## Results
26
+
27
+ The reported evaluation uses the later prepared PIIBench experiment variant
28
+ with `82` retained entity types and a held-out test split of `100,002` records.
29
+ It is not the earlier `48`-type Hub dataset release.
30
+
31
+ | Held-Out Evaluation | Records | F1 | Precision | Recall |
32
+ |---|---:|---:|---:|---:|
33
+ | Corrected heldout subset | 5,000 | 0.6476 | 0.6300 | 0.6662 |
34
+ | Complete experiment test split | 100,002 | 0.6455 | 0.6277 | 0.6645 |
35
+
36
+ Full-test SHA-256:
37
+ `65f8edc86399ba3f9e4ba44591d4583f9271f5d1df20e30a913305049559df77`
38
+
39
+ ## Usage
40
+
41
+ This is a standard Transformers token-classification model:
42
+
43
+ ```python
44
+ from transformers import pipeline
45
+
46
+ pipe = pipeline(
47
+ "token-classification",
48
+ model="Pritesh-2711/piibench-deberta-base",
49
+ aggregation_strategy="simple",
50
+ )
51
+ print(pipe("Contact me at jane@example.com."))
52
+ ```
53
+
54
+ ## Related Resources
55
 
56
+ - Dataset: [Pritesh-2711/pii-bench](https://huggingface.co/datasets/Pritesh-2711/pii-bench)
57
+ - Source-conditioned hierarchical comparison model: [Pritesh-2711/piibench-deberta-sch](https://huggingface.co/Pritesh-2711/piibench-deberta-sch)
 
 
 
tokenizer_config.json CHANGED
@@ -48,15 +48,10 @@
48
  "cls_token": "[CLS]",
49
  "do_lower_case": false,
50
  "eos_token": "[SEP]",
51
- "extra_special_tokens": [
52
- "[PAD]",
53
- "[CLS]",
54
- "[SEP]"
55
- ],
56
  "is_local": false,
57
  "local_files_only": false,
58
  "mask_token": "[MASK]",
59
- "model_max_length": 1000000000000000019884624838656,
60
  "pad_token": "[PAD]",
61
  "sep_token": "[SEP]",
62
  "split_by_punct": false,
 
48
  "cls_token": "[CLS]",
49
  "do_lower_case": false,
50
  "eos_token": "[SEP]",
 
 
 
 
 
51
  "is_local": false,
52
  "local_files_only": false,
53
  "mask_token": "[MASK]",
54
+ "model_max_length": 256,
55
  "pad_token": "[PAD]",
56
  "sep_token": "[SEP]",
57
  "split_by_punct": false,