Jev_CeNN β€” CUDA-optimized hybrid cellular attention

The model weights, tokenizer, config and all custom Python runtime code are included in this repository. The original research package is NOT required.

Install: pip install torch transformers==4.57.6 safetensors huggingface_hub

Download the load_model.py file or the entire repository, then run:

from load_model import load_model, predict
model, tokenizer = load_model("USERNAME/MODEL", device="cpu")
output = predict("USERNAME/MODEL", state={"speed": 20},
                 question={"type": "choice", "instructions": "Select action",
                           "criteria": {"accelerate": None, "brake": None}})
print(output)

The bundled loader executes bundled runtime.py. Review/pin trusted code before use. The model is a typed-decision encoder, NOT a text-generation model.

W1024 at 512-token input is a quadratic full-context control and does NOT demonstrate a faster or attention-free replacement. Consult training_report.json for actual held-out metrics.

Optional GPU acceleration uses Triton and falls back to PyTorch on CPU. Install triton>=3.0 for NVIDIA GPU inference. Speed and numerical parity must be measured on the target GPU.

Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
0.4B params
Tensor type
F32
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support