--- license: other license_name: statim-weights license_link: https://huggingface.co/Beko2210/statim-decide-en-large/blob/main/LICENSE-MODEL.md language: - en library_name: gguf pipeline_tag: zero-shot-classification base_model: convaiinnovations/laya datasets: - PolyAI/banking77 - AmazonScience/massive - LocalLLaMA/typed-decisions - tasksource/tasksource-jev-typed-decisions - nvidia/Nemotron-Safety-Guard-Dataset-v3 - l3cube-pune/IndicGuard - PolyAI/minds14 - benayas/snips tags: - statim - gguf - decision-making - text-classification - zero-shot-classification - ModernBERT-large model-index: - name: statim-decide-en-large results: - task: type: text-classification dataset: name: typed-decisions (test split, first 2,000 decisions; its train split is replay data) type: LocalLLaMA/typed-decisions metrics: - type: accuracy value: 0.768 - task: type: text-classification dataset: name: Banking77 (test split, first 2,000 rows, all 77 intents in one question) type: PolyAI/banking77 metrics: - type: accuracy value: 0.928 - task: type: text-classification dataset: name: MASSIVE intents (English) (150 seeded stratified English test rows) type: AmazonScience/massive metrics: - type: accuracy value: 0.8667 - task: type: text-classification dataset: name: AG News (zero-shot (never trained on), first 2,000 test rows) type: fancyzhx/ag_news metrics: - type: accuracy value: 0.939 - task: type: text-classification dataset: name: DAIR Emotion (zero-shot, first 2,000 test rows) type: dair-ai/emotion metrics: - type: accuracy value: 0.588 - task: type: text-classification dataset: name: HWU64 intents (English, 150 rows; rows overlapping MASSIVE removed) type: hwu64 metrics: - type: accuracy value: 0.8333 - task: type: text-classification dataset: name: SIB-200 topics (English, 150 rows; zero-shot) type: Davlan/sib200 metrics: - type: accuracy value: 0.7133 - task: type: text-classification dataset: name: Sentiment (English, 150 rows; zero-shot) type: tyqiangz/multilingual-sentiments metrics: - type: accuracy value: 0.6733 - task: type: text-classification dataset: name: HateCheck (English, 150 rows; zero-shot) type: mteb/multi-hatecheck metrics: - type: accuracy value: 0.78 - task: type: text-classification dataset: name: Belebele reading (English, 150 rows; zero-shot) type: facebook/belebele metrics: - type: accuracy value: 0.4533 --- # Statim Decide EN Large > **Licence notice (2026-10-03).** Version 0.5.0 of this model was trained partly on data whose texts carry no known licence (SDOH-NLI, LEDGAR). From 2026-10-03 these weights are offered only under PolyForm Noncommercial 1.0.0; the Small Business and Free Trial licences and the commercial licence do not apply to them. A replacement trained only on cleared data will follow. Details: [DATA_LICENSES.md](https://github.com/BEKO2210/statim/blob/main/DATA_LICENSES.md#licence-findings-2026-10-03). A decision model for [Statim](https://github.com/BEKO2210/statim), the native C++ engine for typed decisions: ask any text a **choice**, a **score** or a **yes/no** question and get calibrated answers from one forward pass, on CPU or GPU, without Python at runtime. Version **0.5.0**, fine-tuned from [`convaiinnovations/laya`](https://huggingface.co/convaiinnovations/laya) (ModernBERT-large encoder). **[▶ Try it live in your browser](https://huggingface.co/spaces/Beko2210/statim)**: the Space runs the multilingual model on a free CPU; this English model is served the same way. One support ticket, three typed answers, one forward pass: [the 60-second film](https://beko2210.github.io/statim/#film). ## Quick start ```sh # Statim release binary: https://github.com/BEKO2210/statim/releases huggingface-cli download Beko2210/statim-decide-en-large statim-decide-en-large-q8_0.gguf --local-dir models ./statim serve -m english=models/statim-decide-en-large-q8_0.gguf --port 8080 curl -s localhost:8080/v1/systemone -d '{ "state": {"subject": "Duplicate charge on invoice #4411", "body": "We were billed twice for March. Please refund the second charge."}, "questions": { "department": {"type": "choice", "instructions": "Which department should handle this?", "criteria": {"billing": "invoices, refunds", "technical": "bugs, outages", "sales": "pricing, contracts"}}, "urgency": {"type": "score", "instructions": "How urgent is this request?", "criteria": ["not urgent", "soon", "critical"]}, "refund": {"type": "noul", "instructions": "Does the user explicitly request a refund?"}}}' ``` Open `http://127.0.0.1:8080/` for the playground. API reference: [docs/API.md](https://github.com/BEKO2210/statim/blob/main/docs/API.md). ## Files | File | Size | Use | |---|---|---| | `statim-decide-en-large-f32.gguf` | 1.58 GB | reference precision, exact on GPU | | `statim-decide-en-large-q8_0.gguf` | 0.45 GB | recommended for CPU: 4x smaller | | `checkpoint/` | 0.85 GB | Laya-format checkpoint for fine-tuning and the Python reference | Checksums in `SHA256SUMS`. The f32 file reproduces the reference implementation within 1e-4 on Statim's parity tests; q8_0 is smaller and faster on CPU with slightly different logits. ## Evaluation Measured by Statim's no-harm gate ([`tools/finetune/gate.py`](https://github.com/BEKO2210/statim/blob/main/tools/finetune/gate.py)) on held-out test data the model selection never looked at. Against the checkpoint it was trained from, on 54 held-out suites: **11 significant gains, 43 within noise, 0 regressions** (two combined binomial standard errors). | Suite | Role | This model | Base checkpoint | Protocol | |---|---|---|---|---| | typed-decisions | trained | **0.7680** | 0.3610 | test split, first 2,000 decisions; its train split is replay data | | Banking77 | trained | **0.9280** | 0.5500 | test split, first 2,000 rows, all 77 intents in one question | | MASSIVE intents (English) | trained | **0.8667** | 0.5333 | 150 seeded stratified English test rows | | AG News | held out | **0.9390** | 0.9425 | zero-shot (never trained on), first 2,000 test rows | | DAIR Emotion | held out | **0.5880** | 0.5945 | zero-shot, first 2,000 test rows | | HWU64 intents | held out | **0.8333** | 0.6067 | English, 150 rows; rows overlapping MASSIVE removed | | SIB-200 topics | held out | **0.7133** | 0.7267 | English, 150 rows; zero-shot | | Sentiment | held out | **0.6733** | 0.6200 | English, 150 rows; zero-shot | | HateCheck | held out | **0.7800** | 0.7667 | English, 150 rows; zero-shot | | Belebele reading | held out | **0.4533** | 0.3800 | English, 150 rows; zero-shot | Published systems under the same protocol, for orientation: typed-decisions meraGPT 0.768, laya-typed-decisions 0.766, Jev 0.727; AG News zero-shot Laya 0.950, GPT-3 (CARP) 0.926, Jev 0.881; Banking77 supervised MPNet 0.941. Sources: [docs/ROADMAP.md](https://github.com/BEKO2210/statim/blob/main/docs/ROADMAP.md).
All 54 held-out suites | Suite | Accuracy | Rows | |---|---|---| | `amazon_massive_intent/ar` | 0.1067 | 150 | | `amazon_massive_intent/de` | 0.4600 | 150 | | `amazon_massive_intent/en` | 0.8667 | 150 | | `amazon_massive_intent/es` | 0.5333 | 150 | | `amazon_massive_intent/fr` | 0.5667 | 150 | | `amazon_massive_intent/hi` | 0.0467 | 150 | | `amazon_massive_intent/it` | 0.4067 | 150 | | `amazon_massive_intent/ja` | 0.4133 | 150 | | `amazon_massive_intent/pl` | 0.2400 | 150 | | `amazon_massive_intent/ru` | 0.3867 | 150 | | `amazon_massive_intent/tr` | 0.1867 | 150 | | `amazon_massive_intent/zh-CN` | 0.5467 | 150 | | `belebele/ar` | 0.2800 | 150 | | `belebele/de` | 0.4467 | 150 | | `belebele/en` | 0.4533 | 150 | | `belebele/hi` | 0.2333 | 150 | | `farstail/fa` | 0.3933 | 150 | | `go_emotions/en` | 0.5267 | 150 | | `hwu64/en` | 0.8333 | 150 | | `indonli/id` | 0.5133 | 150 | | `multi_hatecheck/ar` | 0.5000 | 150 | | `multi_hatecheck/de` | 0.5133 | 150 | | `multi_hatecheck/en` | 0.7800 | 150 | | `multi_hatecheck/es` | 0.6267 | 150 | | `multi_hatecheck/fr` | 0.5600 | 150 | | `multi_hatecheck/hi` | 0.5400 | 150 | | `multi_hatecheck/it` | 0.5533 | 150 | | `multi_hatecheck/nl` | 0.5400 | 150 | | `multi_hatecheck/pl` | 0.5133 | 150 | | `multi_hatecheck/pt` | 0.5800 | 150 | | `multi_hatecheck/zh` | 0.5933 | 150 | | `multilingual_sentiments/ar` | 0.3667 | 150 | | `multilingual_sentiments/de` | 0.4800 | 150 | | `multilingual_sentiments/en` | 0.6733 | 150 | | `multilingual_sentiments/es` | 0.5333 | 150 | | `multilingual_sentiments/fr` | 0.5067 | 150 | | `multilingual_sentiments/hi` | 0.4933 | 150 | | `multilingual_sentiments/id` | 0.4733 | 150 | | `multilingual_sentiments/it` | 0.3800 | 150 | | `multilingual_sentiments/ja` | 0.4133 | 150 | | `multilingual_sentiments/ms` | 0.4133 | 150 | | `multilingual_sentiments/pt` | 0.4933 | 150 | | `multilingual_sentiments/zh` | 0.6267 | 150 | | `semrel/ar` | 0.2533 | 150 | | `semrel/en` | 0.3133 | 150 | | `semrel/hi` | 0.2333 | 150 | | `sib200/ar` | 0.1867 | 150 | | `sib200/de` | 0.6467 | 150 | | `sib200/en` | 0.7133 | 150 | | `sib200/hi` | 0.1733 | 150 | | `test/ag_news` | 0.9390 | 2000 | | `test/banking77` | 0.9280 | 2000 | | `test/emotion` | 0.5880 | 2000 | | `test/typed_decisions` | 0.7680 | 2000 |
Reproduce these numbers: [REPRODUCE.md](https://github.com/BEKO2210/statim/blob/main/REPRODUCE.md). ## Training Multi-task fine-tuning with `train_multitask.py --clean` from checkpoint `laya`, best epoch `11/raw` selected on validation data only. Training data: only sources whose licence permits commercial use and imposes no ShareAlike or copyleft terms (Banking77, MASSIVE, typed-decisions replay, a licence-audited tasksource mixture, Nemotron-Safety-Guard, IndicGuard, MINDS-14, SNIPS), every one listed with its licence in [DATA_LICENSES.md](DATA_LICENSES.md). Evaluation test rows were removed from the training data. ## Intended use and limits - Classification-style decisions over short texts and JSON: routing, triage, moderation, intent, yes/no checks, ordinal ratings. It does not generate text. - Accuracy varies by task and language (see the table). Reading comprehension (Belebele) and semantic similarity are weak; do not use it for them without your own evaluation. - Use the confidence: Statim's `min_confidence` option marks low-confidence answers with `escalate: true` so a person can review them. Do not automate high-stakes decisions about people without human review. ## Licence The weights may be used under any one of: PolyForm Noncommercial 1.0.0, PolyForm Small Business 1.0.0 (free commercial use below 100 people and 1 M USD revenue), PolyForm Free Trial 1.0.0 (any company, fewer than 32 days), or a Statim commercial licence ([COMMERCIAL.md](https://github.com/BEKO2210/statim/blob/main/COMMERCIAL.md)). Texts in [LICENSE-MODEL.md](LICENSE-MODEL.md). The Statim engine is Apache-2.0. Built on [Laya](https://huggingface.co/convaiinnovations/laya) (Apache-2.0) and [ModernBERT-large](https://huggingface.co/answerdotai/ModernBERT-large) (Apache-2.0). Training data attribution: Banking77 (Casanueva et al., 2020, PolyAI), MASSIVE (FitzGerald et al., 2022, Amazon), and the CC-BY sources in DATA_LICENSES.md. Statim is independent and not affiliated with the Laya authors.