Hugging Face's logo

flexitok
/
maddition_fas_Arab_360

Persian
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_fas_Arab_360

Commit History

Upload maddition_360_v2/flexitok--maddition_fas_Arab_360_overlap.json with huggingface_hub
f60bf5b
verified

gsaltintas commited on

Upload maddition_360_v2/participating_tokenizers.json with huggingface_hub
e0a77d8
verified

gsaltintas commited on

Upload maddition_360_v2/flexitok--maddition_fas_Arab_360.yaml with huggingface_hub
f244cb8
verified

gsaltintas commited on

Upload maddition_360_v2/flexitok--maddition_fas_Arab_360_info.json with huggingface_hub
7135033
verified

gsaltintas commited on

Upload maddition_360_v2/flexitok--maddition_fas_Arab_360_vocab.json with huggingface_hub
b4f54e1
verified

gsaltintas commited on

Upload maddition_360_v2/flexitok--maddition_fas_Arab_360_super_mapping.json with huggingface_hub
de986d3
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_fas_Arab_360_overlap.json with huggingface_hub
288ac79
verified

gsaltintas commited on

Upload maddition_360/participating_tokenizers.json with huggingface_hub
6ac61d8
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_fas_Arab_360.yaml with huggingface_hub
fd3815b
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_fas_Arab_360_info.json with huggingface_hub
91cb3cd
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_fas_Arab_360_vocab.json with huggingface_hub
3f06a66
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_fas_Arab_360_super_mapping.json with huggingface_hub
42c9191
verified

gsaltintas commited on

Upload folder using huggingface_hub
4512b69
verified

gsaltintas commited on

initial commit
0fef59a
verified

gsaltintas commited on