Xenova
/

grok-1-tokenizer

Transformers.js

Model card Files Files and versions

Xenova HF Staff commited on Mar 18, 2024

Commit

fe224b1

·

verified ·

1 Parent(s): d5ffc65

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -7,7 +7,7 @@ tags:
 # Grok-1 Tokenizer
-A 🤗-compatible version of the **Grok-4 tokenizer** (adapted from [xai-org/grok-1](https://github.com/xai-org/grok-1)). This means it can be used with Hugging Face libraries including [Transformers](https://github.com/huggingface/transformers), [Tokenizers](https://github.com/huggingface/tokenizers), and [Transformers.js](https://github.com/xenova/transformers.js).
 ## Example usage:

 # Grok-1 Tokenizer
+A 🤗-compatible version of the **Grok-1 tokenizer** (adapted from [xai-org/grok-1](https://github.com/xai-org/grok-1)). This means it can be used with Hugging Face libraries including [Transformers](https://github.com/huggingface/transformers), [Tokenizers](https://github.com/huggingface/tokenizers), and [Transformers.js](https://github.com/xenova/transformers.js).
 ## Example usage: