Text Generation
GGUF
imatrix
conversational
Jan-nano-gguf / README.md
jan-hq's picture
Update README.md
d6d76c0 verified
metadata
quantized_by: Menlo
pipeline_tag: text-generation
base_model: Menlo/Jan-nano
base_model_relation: quantized
license: apache-2.0

Jan Nano

Note: Jan-Nano is a non-thinking model.

Authors: Alan Dao, Bach Vu Dinh

image/png

Overview

Jan Nano is a fine-tuned language model built on top of the Qwen3 architecture. Developed as part of the Jan ecosystem, it balances compact size and extended context length, making it ideal for efficient, high-quality text generation in local or embedded environments.

Features

  • Tool Use: Excellent function calling and tool integration
  • Research: Enhanced research and information processing capabilities
  • Small Model: VRAM efficient for local deployment

Use it with Jan (UI)

  1. Install Jan using Quickstart

Original weight: https://huggingface.co/Menlo/Jan-nano

Recommended Sampling Parameters

  • Temperature: 0.7
  • Top-p: 0.8
  • Top-k: 20
  • Min-p: 0

📄 Citation

@misc{dao2025jannanotechnicalreport,
      title={Jan-nano Technical Report}, 
      author={Alan Dao and Dinh Bach Vu},
      year={2025},
      eprint={2506.22760},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2506.22760}, 
}

Documentation

Setup, Usage & FAQ