mon_tokenizer / tokenizer.model
janakhpon's picture
feat: simplified mon tokenizer in hf format, updated tags, resolve the legacy issue
e9d0f85
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
a0b3e772c4f414d2540c3f68474d14b037ec00f8e5ac9bce637938d7e82998d3
Pointer size:
131 Bytes
·
Size of remote file:
338 kB
·
Xet hash:
fced95c2ef3f574913694036a75845494bc8f237277bbdef6c8d119d435d8d3d

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.