SceneWorks
/

qwen-image-tokenizer

Model card Files Files and versions

qwen-image-tokenizer

16.5 MB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

SceneWorks's picture

Add derived Qwen-Image fast tokenizer.json + upstream source (sc-6570)

b017829 verified 5 days ago

.gitattributes

1.57 kB
Add derived Qwen-Image fast tokenizer.json + upstream source (sc-6570) 5 days ago
README.md

2.49 kB
Add derived Qwen-Image fast tokenizer.json + upstream source (sc-6570) 5 days ago
added_tokens.json

605 Bytes
Add derived Qwen-Image fast tokenizer.json + upstream source (sc-6570) 5 days ago
merges.txt

1.67 MB
Add derived Qwen-Image fast tokenizer.json + upstream source (sc-6570) 5 days ago
special_tokens_map.json

613 Bytes
Add derived Qwen-Image fast tokenizer.json + upstream source (sc-6570) 5 days ago
tokenizer.json

11.4 MB
xet

Add derived Qwen-Image fast tokenizer.json + upstream source (sc-6570) 5 days ago
tokenizer_config.json

4.69 kB
Add derived Qwen-Image fast tokenizer.json + upstream source (sc-6570) 5 days ago
vocab.json

3.38 MB
Add derived Qwen-Image fast tokenizer.json + upstream source (sc-6570) 5 days ago