Instructions to use Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
- Pi new
How to use Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit
Run Hermes
hermes
- MLX LM
How to use Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit", "messages": [ {"role": "user", "content": "Hello"} ] }'
MiniMax-M2.7-Abliterated-Heretic-MLX-4bit
This is the 4-bit Apple MLX release of an abliterated version of MiniMaxAI's MiniMax-M2.7.
By applying Heretic's Ablated Refusal Adaptation (ARA), the base refusal behavior was removed at the weight level. The result keeps MiniMax-M2.7's sparse MoE reasoning, long-context instruction following, and general capability profile, but no longer defaults to the original refusal pattern.
Quantization
This build uses layer-aware mixed 4/5-bit MLX quantization. The bulk of the model is quantized to 4-bit, while sensitive projection and output modules are kept at 5-bit treatment for better stability.
- Format: MLX safetensors
- Effective quantization: 4.662 bits per weight
- Runtime:
mlx-lm - Source checkpoint:
Youssofal/MiniMax-M2.7-abliterated-BF16
Methodology & Model Notes
MiniMax-M2.7 is a 229B sparse MoE model with 10B active parameters per token, 62 layers, hybrid attention, 256 local experts with 8 active per token, and a 200K context window.
This release was produced with a direct Heretic ARA run using the fixed parameter set below:
start_layer_index = 30end_layer_index = 51preserve_good_behavior_weight = 0.4512steer_bad_behavior_weight = 0.0037overcorrect_relative_weight = 0.8804neighbor_count = 14
The direct ARA run completed with Refusals: 0/25.
Validation
This 4-bit MLX variant was built from the same validated abliterated BF16 checkpoint as the GGUF and 3-bit MLX releases. It is published as the higher-quality Apple Silicon MLX option for users who want more precision than the 3-bit variant.
Running
from mlx_lm import load, generate
model, tokenizer = load("Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit")
messages = [{"role": "user", "content": "Write a short Python function that reverses a string."}]
prompt = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True,
)
response = generate(model, tokenizer, prompt=prompt, max_tokens=256)
print(response)
Model Architecture
| Spec | Value |
|---|---|
| Total Parameters | 229B sparse MoE |
| Active Parameters | 10B per token |
| Experts | 256 local, 8 per token |
| Layers | 62 |
| Attention | Hybrid: 7 Lightning + 1 softmax per 8-block |
| Context | 200K |
| Base Model | MiniMaxAI/MiniMax-M2.7 |
Related Releases
Disclaimer
This model has had refusal behavior removed at the weight level. It will answer prompts that the base model would normally refuse. You are responsible for how you use it.
Credits
- Base model: MiniMaxAI/MiniMax-M2.7
- BF16 abliterated checkpoint: Youssofal/MiniMax-M2.7-abliterated-BF16
- Refusal removal pipeline: Heretic with the ARA method
- Apple Silicon runtime: mlx-lm
License
This release inherits the base MiniMax-M2.7 license.
NON-COMMERCIAL. Commercial use requires written authorization from MiniMax.
- Downloads last month
- 613
4-bit
Model tree for Youssofal/MiniMax-M2.7-Abliterated-Heretic-MLX-4bit
Base model
MiniMaxAI/MiniMax-M2.7