我用8卡A6000报错
#8 opened about 1 month ago
by
AlphaLQ
有没有不用vllm的方法
#6 opened about 2 months ago
by
dfg543
请问RTX 4090能跑这个吗?Can RTX 4090 run this?
1
#5 opened about 2 months ago
by
feixusxl
model troughput is so low on H100??? anyone else is facing the same issue? using vllm to deploy
👀
1
3
#4 opened about 2 months ago
by
sanak
出个int4 怎么样
3
#1 opened 2 months ago
by
ZKong