Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
xaskasdf
/
llama-3.1-70b-instruct-gguf
like
0
GGUF
imatrix
conversational
License:
llama3.1
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
64
GGUF
Model size
71B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to add your hardware
1-bit
IQ1_M
18.1 GB
2-bit
IQ2_XXS
20.5 GB
IQ2_S
23.6 GB
Q2_K
27.6 GB
4-bit
Q4_0
41.2 GB
5-bit
Q5_0
49.9 GB
6-bit
Q6_K
59.1 GB
8-bit
Q8_0
76 GB
16-bit
F16
141 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Collection including
xaskasdf/llama-3.1-70b-instruct-gguf
llama-3
Collection
Meta's Llama-3 models in gguf format
•
4 items
•
Updated
Sep 11, 2024