Token Classification
Transformers
Safetensors
deberta-v2
pii-detection
named-entity-recognition
deberta
piibench
Instructions to use Pritesh-2711/piibench-deberta-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Pritesh-2711/piibench-deberta-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="Pritesh-2711/piibench-deberta-base")# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("Pritesh-2711/piibench-deberta-base") model = AutoModelForTokenClassification.from_pretrained("Pritesh-2711/piibench-deberta-base", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload PIIBench Direct DeBERTa fine-tuned model
Browse files- README.md +44 -11
- tokenizer_config.json +1 -6
README.md
CHANGED
|
@@ -1,24 +1,57 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
| 3 |
library_name: transformers
|
| 4 |
pipeline_tag: token-classification
|
| 5 |
base_model: microsoft/deberta-v3-base
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
tags:
|
| 7 |
- pii-detection
|
| 8 |
- token-classification
|
| 9 |
- named-entity-recognition
|
| 10 |
- deberta
|
| 11 |
- piibench
|
| 12 |
-
datasets:
|
| 13 |
-
- Pritesh-2711/pii-bench
|
| 14 |
-
metrics:
|
| 15 |
-
- f1
|
| 16 |
---
|
| 17 |
|
| 18 |
-
# PIIBench
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
|
| 20 |
-
Dataset: https://huggingface.co/datasets/Pritesh-2711/pii-bench
|
| 21 |
-
|
| 22 |
-
Full test F1: 0.6455
|
| 23 |
-
Precision: 0.6277
|
| 24 |
-
Recall: 0.6645
|
|
|
|
| 1 |
---
|
| 2 |
+
license: other
|
| 3 |
library_name: transformers
|
| 4 |
pipeline_tag: token-classification
|
| 5 |
base_model: microsoft/deberta-v3-base
|
| 6 |
+
datasets:
|
| 7 |
+
- Pritesh-2711/pii-bench
|
| 8 |
+
metrics:
|
| 9 |
+
- f1
|
| 10 |
tags:
|
| 11 |
- pii-detection
|
| 12 |
- token-classification
|
| 13 |
- named-entity-recognition
|
| 14 |
- deberta
|
| 15 |
- piibench
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
---
|
| 17 |
|
| 18 |
+
# PIIBench Direct Fine-Tuned DeBERTa
|
| 19 |
+
|
| 20 |
+
This is the final selected PIIBench model: a standard DeBERTa-v3-base token
|
| 21 |
+
classifier trained directly on the prepared multi-source PII benchmark splits.
|
| 22 |
+
It outperformed the source-conditioned hierarchical comparison model on the
|
| 23 |
+
complete held-out experiment test split.
|
| 24 |
+
|
| 25 |
+
## Results
|
| 26 |
+
|
| 27 |
+
The reported evaluation uses the later prepared PIIBench experiment variant
|
| 28 |
+
with `82` retained entity types and a held-out test split of `100,002` records.
|
| 29 |
+
It is not the earlier `48`-type Hub dataset release.
|
| 30 |
+
|
| 31 |
+
| Held-Out Evaluation | Records | F1 | Precision | Recall |
|
| 32 |
+
|---|---:|---:|---:|---:|
|
| 33 |
+
| Corrected heldout subset | 5,000 | 0.6476 | 0.6300 | 0.6662 |
|
| 34 |
+
| Complete experiment test split | 100,002 | 0.6455 | 0.6277 | 0.6645 |
|
| 35 |
+
|
| 36 |
+
Full-test SHA-256:
|
| 37 |
+
`65f8edc86399ba3f9e4ba44591d4583f9271f5d1df20e30a913305049559df77`
|
| 38 |
+
|
| 39 |
+
## Usage
|
| 40 |
+
|
| 41 |
+
This is a standard Transformers token-classification model:
|
| 42 |
+
|
| 43 |
+
```python
|
| 44 |
+
from transformers import pipeline
|
| 45 |
+
|
| 46 |
+
pipe = pipeline(
|
| 47 |
+
"token-classification",
|
| 48 |
+
model="Pritesh-2711/piibench-deberta-base",
|
| 49 |
+
aggregation_strategy="simple",
|
| 50 |
+
)
|
| 51 |
+
print(pipe("Contact me at jane@example.com."))
|
| 52 |
+
```
|
| 53 |
+
|
| 54 |
+
## Related Resources
|
| 55 |
|
| 56 |
+
- Dataset: [Pritesh-2711/pii-bench](https://huggingface.co/datasets/Pritesh-2711/pii-bench)
|
| 57 |
+
- Source-conditioned hierarchical comparison model: [Pritesh-2711/piibench-deberta-sch](https://huggingface.co/Pritesh-2711/piibench-deberta-sch)
|
|
|
|
|
|
|
|
|
tokenizer_config.json
CHANGED
|
@@ -48,15 +48,10 @@
|
|
| 48 |
"cls_token": "[CLS]",
|
| 49 |
"do_lower_case": false,
|
| 50 |
"eos_token": "[SEP]",
|
| 51 |
-
"extra_special_tokens": [
|
| 52 |
-
"[PAD]",
|
| 53 |
-
"[CLS]",
|
| 54 |
-
"[SEP]"
|
| 55 |
-
],
|
| 56 |
"is_local": false,
|
| 57 |
"local_files_only": false,
|
| 58 |
"mask_token": "[MASK]",
|
| 59 |
-
"model_max_length":
|
| 60 |
"pad_token": "[PAD]",
|
| 61 |
"sep_token": "[SEP]",
|
| 62 |
"split_by_punct": false,
|
|
|
|
| 48 |
"cls_token": "[CLS]",
|
| 49 |
"do_lower_case": false,
|
| 50 |
"eos_token": "[SEP]",
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
"is_local": false,
|
| 52 |
"local_files_only": false,
|
| 53 |
"mask_token": "[MASK]",
|
| 54 |
+
"model_max_length": 256,
|
| 55 |
"pad_token": "[PAD]",
|
| 56 |
"sep_token": "[SEP]",
|
| 57 |
"split_by_punct": false,
|