mon_tokenizer / tokenizer.model

feat: simplified mon tokenizer in hf format, updated tags, resolve the legacy issue

e9d0f85 4 months ago

338 kB

This file is stored with Xet . It is too big to display, but you can still download it.

( Raw pointer file )

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.