Instructions to use intuitem/Paul-Gen2-14B-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use intuitem/Paul-Gen2-14B-MLX-4bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("intuitem/Paul-Gen2-14B-MLX-4bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use intuitem/Paul-Gen2-14B-MLX-4bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "intuitem/Paul-Gen2-14B-MLX-4bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "intuitem/Paul-Gen2-14B-MLX-4bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use intuitem/Paul-Gen2-14B-MLX-4bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "intuitem/Paul-Gen2-14B-MLX-4bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "intuitem/Paul-Gen2-14B-MLX-4bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8080/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "intuitem/Paul-Gen2-14B-MLX-4bit", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use intuitem/Paul-Gen2-14B-MLX-4bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "intuitem/Paul-Gen2-14B-MLX-4bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default intuitem/Paul-Gen2-14B-MLX-4bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use intuitem/Paul-Gen2-14B-MLX-4bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "intuitem/Paul-Gen2-14B-MLX-4bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "intuitem/Paul-Gen2-14B-MLX-4bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Paul-Gen2-14B MLX 4-bit
Paul is an open-source language model developed by intuitem and fine-tuned from Mistral's Ministral 3 14B Instruct. It specialises in cybersecurity governance, risk and compliance (GRC), with a focus on the French-speaking community: EBIOS Risk Manager (EBIOS RM), ISO/IEC 27005 and security homologation. It answers in French and English.
Paul can serve as the AI backend for CISO Assistant, and works on its own or in any application that speaks the OpenAI chat API. This is Paul Gen2, iteration v64avg; later iterations on the same base keep the Gen2 name and are tagged by iteration.
Gen2 succeeds Poulpe Gen1, on the same base model, with 40% more training data and the rows that contradicted the sources removed. It is named after Paul the Octopus, "Paul le poulpe".
Intended use
- Questions on the EBIOS RM method: workshops, concepts, vocabulary, rating scales, deliverables.
- Guiding a risk analysis step by step, from the framing to the risk treatment plan.
- Calling tools when an application provides them (for example CISO Assistant's MCP tools), and answering in JSON on request.
- General cybersecurity and IT questions.
Out of scope: topics outside cybersecurity and IT (it declines), legal advice, and decisions taken without human review. Answers can be wrong: check them against the ANSSI guide.
Files
4-bit MLX weights (group size 64, about 7 GB) for Apple Silicon.
Run
pip install mlx-lm
mlx_lm.chat --model intuitem/Paul-Gen2-14B-MLX-4bit --max-tokens 2048 --temp 0.2
LM Studio on a Mac: search for "Paul" and pick the MLX version.
Without a system prompt, the chat template adds Paul's own default prompt, the one it was trained with. Recommended temperature: 0.2.
Evaluation
Scores between 0 and 1, held-out sets. Knowledge and facilitation sets are graded by an LLM judge against reference answers and the source pages; tool calling and JSON are checked deterministically. Judge noise is about ยฑ0.02.
| Set | Items | This release | Poulpe Gen1 |
|---|---|---|---|
| Closed-book EBIOS RM questions | 338 | 0.441 | 0.405 |
| True, false and partial premises | 134 | 0.412 | 0.362 |
| Workshop facilitation (multi-turn) | 36 | 0.525 | 0.528 |
| Driving a study with terse replies (multi-turn) | 18 | 0.640 | 0.546 |
| Identity, scope, general IT | 26 | 0.838 | 0.790 |
| Tool calling (CISO Assistant MCP tools, held out) | 36 | 1.000 | 0.986 |
| JSON output (schema-validated) | 10 | 1.000 | 1.000 |
- False premises firmly corrected: 36 of 60.
- Closed-book answers framed with the wrong method or workshop: 29 of 338.
- Repeated replies in the terse-reply sessions: 5 over 18 sessions.
- Tool calls claiming an action without calling the tool: 0.
Known limitations
- Exact wording of rating scales (gravity, likelihood, stakeholder criteria) and the values of the guide's worked examples can be recalled imperfectly; an example value can be presented as if the method fixed it. Check them against the ANSSI guide, or give the model the relevant pages (retrieval) when precision matters.
- Long studies driven with very short replies can still drift or repeat a step.
- It follows the EBIOS RM guide v1.5 (2024); the terms of the 2018 version (for example "criticitรฉ" of a stakeholder) are not always mapped to the current ones.
- Not legal or regulatory advice; a risk analysis remains the responsibility of the people who carry it out.
Training data and sources
Fine-tuned with QLoRA (rank 16; the released weights are the average of 2 runs with different seeds) on examples a teacher model (Gemma 4 31B, Apache-2.0) wrote from the documents below: question-answer pairs, corrections of false premises, multi-turn facilitation sessions, plus tool calls and general IT answers produced by the base model. The examples are reformulations, not the documents themselves. Formulas, rating scales and tables that the ANSSI documents only give as figures were transcribed by the teacher from the page images first, and the generated formulas were checked against them. About 60,000 training examples, one epoch on a single RTX 3090.
- Contient des informations publiques de l'ANSSI (Agence nationale de la sรฉcuritรฉ des systรจmes d'information), rรฉutilisรฉes selon la Licence Ouverte / Etalab, avec l'autorisation de l'ANSSI (21 octobre 2026) pour les documents qui ne portent pas de licence.
- ENISA reports are reused under CC BY 4.0; ยฉ European Union Agency for Cybersecurity (ENISA).
- NIST publications are works of the US Government, not subject to copyright in the United States.
- MITRE ATT&CKยฎ and CAPECโข are used under MITRE's licence (see
NOTICE-MITRE.txt). "ยฉ 2026 The MITRE Corporation. This work is reproduced and distributed with the permission of The MITRE Corporation."
Club EBIOS pages (48), used as practitioner guidance under CC BY 4.0 (site default) or the Creative Commons licence stated in the file
- https://club-ebios.org/site/a-qui-sadresse-cette-nouvelle-methode-ebios-risk-manager/
- https://club-ebios.org/site/a-quoi-la-pyramide-du-management-du-risque-sert-elle/
- https://club-ebios.org/site/a-quoi-servent-les-fiches-methodes-qui-accompagnent-le-guide-ebios-rm/
- https://club-ebios.org/site/approche-flash-de-la-methode-ebios-risk-manager/
- https://club-ebios.org/site/wp-content/uploads/productions/2021_COLLEGE_EBIOS_demarche_flash_guide_utilisation_v1.pdf
- https://club-ebios.org/site/avez-vous-des-exemples-de-niveaux-de-motivation-pour-decrire-les-sources-de-risque-a-latelier-2/
- https://club-ebios.org/site/comment-eviter-lexplosion-combinatoire-dune-etude/
- https://club-ebios.org/site/comment-faire-une-feros-avec-ebios-risk-manager/
- https://club-ebios.org/site/comment-prendre-en-compte-la-protection-de-la-vie-privee-dans-une-etude-ebios-risk-manager/
- https://club-ebios.org/site/comment-prendre-en-compte-le-non-intentionnel-quand-on-est-loin-davoir-adopte-les-bonnes-pratiques-diso-27001/
- https://club-ebios.org/site/comment-traiter-les-risques-atelier-5-lies-a-une-non-conformite-reglementaire-sans-passer-par-les-ateliers-2-3-et-4-qui-permettent-justement-didentifier-et-dapprecier-les-dits-ris/
- https://club-ebios.org/site/comment-utiliser-des-echelles-dimpacts-heterogenes/
- https://club-ebios.org/site/comment-utiliser-ebios-risk-manager-pour-mener-un-pia/
- https://club-ebios.org/site/wp-content/uploads/productions/ClubEBIOS-InfographiePIA-2020-06-17.pdf
- https://club-ebios.org/site/conception-scenario-operationnel/
- https://club-ebios.org/site/wp-content/uploads/productions/ClubEBIOS-GuideMethodologique-Atelier4-V1.1.pdf
- https://club-ebios.org/site/concretement-qui-deroule-la-methode-rssi-ou-risk-manager/
- https://club-ebios.org/site/dans-la-fiche-methode-n-8-relative-a-levaluation-de-la-vraisemblance-des-scenarios-operationnels-dans-latelier-4-que-signifient-les-chiffres-en-italique-et-entre-parentheses-d/
- https://club-ebios.org/site/dans-latelier-2-du-guide-comment-est-evaluee-la-pertinence-des-couples-source-de-risque-sr-objectif-vise-ov-dans-le-tableau-page-37/
- https://club-ebios.org/site/dans-latelier-3-du-guide-on-evalue-le-niveau-de-menace-de-chaque-partie-prenante-de-lecosysteme-dans-la-representation-radar-qui-est-proposee-que-representent-la-taille-et-la-coul/
- https://club-ebios.org/site/ebios-risk-manager-bilan-et-propositions-dameliorations/
- https://club-ebios.org/site/wp-content/uploads/productions/majEBIOSRM/ClubEBIOS-EBIOSRiskManager-BilanEtPropositionsAmeliorations.pdf
- https://club-ebios.org/site/ebios-risk-manager-pour-analyser-un-si-comment-ne-pas-sy-perdre-comment-aborder-la-demarche/
- https://club-ebios.org/site/ebios-rm-comment-ca-marche/
- https://club-ebios.org/site/ebios-rm-est-elle-adaptee-pour-demontrer-une-conformite-reglementaire/
- https://club-ebios.org/site/exemple-detude-des-risques-menee-avec-ebios-risk-manager/
- https://club-ebios.org/site/wp-content/uploads/productions/ClubEBIOS-Exemple_etude_des_risques.pdf
- https://club-ebios.org/site/guide-atelier-1-comment-exploiter-les-non-conformites-du-socle/
- https://club-ebios.org/site/wp-content/uploads/productions/ClubEBIOS-FicheMethode-Atelier1-ExploitationDesNonConformites-V1.0.pdf
- https://club-ebios.org/site/guide-atelier-3-definition-de-la-gravite-des-scenarios-strategiques/
- https://club-ebios.org/site/wp-content/uploads/productions/ClubEBIOS-FicheMethode-Atelier3-GraviteScenarioStrategique-V1.0.pdf
- https://club-ebios.org/site/jai-deja-realise-des-analyses-de-risques-avec-ebios-dans-sa-version-precedente-2010-comment-reintegrer-le-travail-deja-effectue/
- https://club-ebios.org/site/le-critere-de-tracabilite-est-il-utile/
- https://club-ebios.org/site/les-menaces-accidentelles-environnementales-et-les-risques-lies-a-une-non-conformite-dun-referentiel-reglementaire-ex-ii901-ne-peuvent-ils-pas-etre-traites-par-la-methode-ebios-rm/
- https://club-ebios.org/site/les-mesures-peuvent-elles-modifier-la-gravite/
- https://club-ebios.org/site/lien-ebiosrm-iso27005/
- https://club-ebios.org/site/wp-content/uploads/productions/Club%20EBIOS%20-%20EBIOS%20Risk%20Manager%20-%20M%C3%A9mento%20-%202020-04-03.pdf
- https://club-ebios.org/site/wp-content/uploads/productions/Club%20EBIOS%20-%20EBIOS%20Risk%20Manager%20-%20M%C3%A9mento%20-%202020-04-03.pdf
- https://club-ebios.org/site/pour-une-tpe-pme-qui-na-pas-de-personne-dediee-au-management-des-risques-quelles-sont-les-personnes-qui-doivent-etre-autour-de-la-table-dans-les-ateliers/
- https://club-ebios.org/site/pourquoi-une-nouvelle-methode-ebios/
- https://club-ebios.org/site/que-peut-on-considerer-comme-valeurs-metiers-ex-biens-essentiels/
- https://club-ebios.org/site/quelles-sont-les-etapes-pour-deployer-une-demarche-ebios-risk-manager-dans-une-grande-entreprise/
- https://club-ebios.org/site/quelles-sont-les-valeurs-de-la-methode-ebios-risk-manager/
- https://club-ebios.org/site/quest-ce-que-le-label-ebios-risk-manager/
- https://club-ebios.org/site/rapport-danalyse-modele-de-rapport-danalyse-de-risques-ebios-risk-manager/
- https://club-ebios.org/site/un-socle-pour-la-protection-de-la-vie-privee/
- https://club-ebios.org/site/une-autre-methode-devaluation-de-la-vraisemblance/
- https://club-ebios.org/site/wp-content/uploads/productions/ClubEBIOS-Une-autre-m%C3%A9thode-pour-l-%C3%A9valuation-de-la-vraisemblance.pdf
Feedback
Report wrong answers or problems in the CISO Assistant issues, with the question, the answer and the expected one.
Licence
Model weights: Apache-2.0, as the base model. Source documents keep their own licences, listed above.
- Downloads last month
- 52
4-bit
Model tree for intuitem/Paul-Gen2-14B-MLX-4bit
Base model
mistralai/Ministral-3-14B-Base-2512