larc-iu/dmrst-xlm-roberta-base-pcc-2.2
A pretrained DMRST parser trained with Dipo.
This model uses xlm-roberta-base as its underlying encoder.
Data
Potsdam Commentary Corpus 2.2 (German). German newspaper commentaries annotated in RST, with the DISRPT 2025 train/dev/test split. This model was trained on untokenized EDU text aligned from the corpus's primary-data layer, to match raw input.
Relation labels: 31 labels:
antithesis, background, cause, circumstance, concession, condition, conjunction, contrast, disjunction, e-elaboration, elaboration, enablement, evaluation-n, evaluation-s, evidence, interpretation, joint, justify, list, means, motivation, otherwise, preparation, purpose, reason, restatement, result, sequence, solutionhood, summary, unless
Metrics
| Split | Seg | E2E Span | E2E Nuc | E2E Rel | E2E Full | Gold-EDU Span | Gold-EDU Nuc | Gold-EDU Rel | Gold-EDU Full |
|---|---|---|---|---|---|---|---|---|---|
| dev | 94.9 | 69.2 | 44.4 | 27.7 | 26.9 | 70.5 | 45.6 | 29.0 | 28.2 |
| test | 95.4 | 60.5 | 33.1 | 18.6 | 18.6 | 63.5 | 35.8 | 20.8 | 20.8 |
F1 x 100 under original Parseval, with trivial leaf spans excluded. E2E scores parse trees predicted from raw text, segmentation included. Gold-EDU scores them given the gold EDU segmentation. Seg is the per-token BeginSeg F1 computed during training, which can read up to about a point below the official DISRPT scorer's value. The checkpoint was selected on dev e2e_full_f1.
Usage
Install the library first with pip install dipo.
CLI
dipo dmrst predict \
--hub-id larc-iu/dmrst-xlm-roberta-base-pcc-2.2 \
--text 'Auf Grund der dramatischen Kassenlage hat die Landesregierung eine Vorlage überraschend auf Eis gelegt, und die Opposition kritisiert das scharf.'
To parse a raw .txt file or a directory of them instead, use --text-file <path> --output-dir out/.
Python
from dipo.rst.parsers.dmrst.modeling_dmrst import DMRSTParser
parser = DMRSTParser.from_pretrained("larc-iu/dmrst-xlm-roberta-base-pcc-2.2")
tree = parser.predict_from_text(
"Auf Grund der dramatischen Kassenlage hat die Landesregierung eine Vorlage überraschend auf Eis gelegt, und die Opposition kritisiert das scharf."
)
print(tree.to_rs4_string())
Citation
If you use this model, please cite both the paper this parser re-implements:
@inproceedings{dmrst_paper,
title = {DMRST: A Joint Framework for Document-Level Multilingual RST Discourse Segmentation and Parsing},
author = {Zhengyuan Liu, Ke Shi, Nancy F. Chen},
booktitle = {CODI 2021},
url = {https://aclanthology.org/2021.codi-main.15/},
}
And the paper Dipo was released with:
@misc{gessler-zeldes-2026-worth,
title = {{Worth Their Weights? Evaluating Generative Models for Discourse Parsing}},
author = {Gessler, Luke and Zeldes, Amir},
year = {2026},
eprint = {2610.17658},
archivePrefix = {arXiv},
primaryClass = {cs.CL},
url = {https://arxiv.org/abs/2610.17658},
}
Notes
- Input: Raw running text. Line breaks and other whitespace are fine, so there is no need to tokenize or clean the text first.
- Training: Trained on the training split only, with the checkpoint chosen on the dev split. Scores are from a single training run, and run-to-run variation on small test sets can be several points.
- Line structure: The model reads text with all whitespace collapsed, so it cannot see line breaks itself.
predict_from_texttherefore also starts a new segment at each blank-line paragraph break and after short heading-like lines (break_at_paragraphs=Falseturns this off). Hard-wrapped prose is left alone. - License: Derived from
xlm-roberta-base, so use of these weights is subject to that model's terms: MIT. - Data terms: Trained on the Potsdam Commentary Corpus 2.2, which is CC BY-NC-SA 4.0. Non-commercial use only.
- Intended use: Research and analysis of text. The weights carry the terms of the base model and of the training corpus above, and the scores on this card come from this checkpoint and not from the runs reported in the accompanying paper.
Full training configuration
See below for the full training configuration this model was trained with.
{
"train_dir": "data/pcc_notok/train",
"dev_dir": "data/pcc_notok/dev",
"test_dir": "data/pcc_notok/test",
"relation_types": [
[
"antithesis",
"rst"
],
[
"background",
"rst"
],
[
"cause",
"rst"
],
[
"circumstance",
"rst"
],
[
"concession",
"rst"
],
[
"condition",
"rst"
],
[
"conjunction",
"multinuc"
],
[
"contrast",
"multinuc"
],
[
"disjunction",
"multinuc"
],
[
"e-elaboration",
"rst"
],
[
"elaboration",
"rst"
],
[
"enablement",
"rst"
],
[
"evaluation-n",
"rst"
],
[
"evaluation-s",
"rst"
],
[
"evidence",
"rst"
],
[
"interpretation",
"rst"
],
[
"joint",
"multinuc"
],
[
"justify",
"rst"
],
[
"list",
"multinuc"
],
[
"means",
"rst"
],
[
"motivation",
"rst"
],
[
"otherwise",
"rst"
],
[
"preparation",
"rst"
],
[
"purpose",
"rst"
],
[
"reason",
"rst"
],
[
"restatement",
"rst"
],
[
"result",
"rst"
],
[
"sequence",
"multinuc"
],
[
"solutionhood",
"rst"
],
[
"summary",
"rst"
],
[
"unless",
"rst"
]
],
"relation_map": null,
"model_name": "xlm-roberta-base",
"stride": 100,
"encoder_window_size": 300,
"attention_type": "dot_product",
"classifier_use_bias": true,
"num_rnn_layers": 1,
"encoder_dropout": 0.5,
"decoder_dropout": 0.5,
"labeler_dropout": 0.5,
"doc_gru_dropout": 0.2,
"label_input_pooling": "mean",
"freeze_embeddings": false,
"freeze_encoder_layers": 0,
"peft": {
"r": 16,
"alpha": 32,
"dropout": 0.05,
"target_modules": "all-linear",
"bias": "none",
"dora": false,
"modules_to_save": [
"embed_tokens"
],
"train_only_new_embedding_rows": true,
"base_dtype": "float32",
"gradient_checkpointing": false,
"load_in_4bit": false,
"bnb_4bit_quant_type": "nf4",
"bnb_4bit_use_double_quant": true,
"bnb_4bit_compute_dtype": "bfloat16"
},
"curriculum": {
"type": "simple",
"epochs": 100
},
"segmentation": {
"pos_weight": 10,
"start_loss": false,
"scheme": "BIE",
"loss": "crf",
"dropout": 0.3
},
"detokenizer": null,
"split_cjk_tokens": false,
"dlw": {
"temperature": 2,
"window": 30
},
"lr": 0.0002,
"encoder_lr": 0.0003,
"grad_accum": 3,
"amp": true,
"empty_cache_between_docs": false,
"checkpoint_decoder": false,
"patience": 100,
"patience_window": 1,
"max_grad_norm": 20,
"weight_decay": 0.01,
"num_warmup_steps": 100,
"num_warmup_epochs": 5,
"log_every": 1,
"begin_validation_epoch": 0,
"validate_every": 1,
"edu_loss_weight_exponent": 0,
"run_name": "release-dmrst-xlmr-base-pcc-full",
"seed": 42,
"val_metric_name": "e2e_full_f1"
}
- Downloads last month
- 8
Model tree for larc-iu/dmrst-xlm-roberta-base-pcc-2.2
Base model
FacebookAI/xlm-roberta-base