dropbox-dash
/

Qwen3-32B_gemlite-ao_a16w4_gs_128_pack_32bit

Text Generation

Model card Files Files and versions

mobicham commited on Jun 4

Commit

8da8969

·

verified ·

1 Parent(s): 3d25f39

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -24,7 +24,6 @@ model = AutoModelForCausalLM.from_pretrained(
     model_id,
     torch_dtype=torch.float16,
     device_map='cuda',
-    attn_implementation="sdpa",
 )
 tokenizer = AutoTokenizer.from_pretrained(model_id)

     model_id,
     torch_dtype=torch.float16,
     device_map='cuda',
 )
 tokenizer = AutoTokenizer.from_pretrained(model_id)