LangMAP

company

https://cimeister.github.io/blog/unigramlm/

AI & ML interests

Language Adaptive Tokenization

MultilingualUnigramLM 's models 506

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-hun-langspec-r16k32

Text Generation • Updated May 19 • 1

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-hun-original-r16k32

Text Generation • Updated May 19 • 1

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-fin-langspec-r16k32

Text Generation • Updated May 19 • 2

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-fin-original-r16k32

Text Generation • Updated May 19 • 2

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-tur-langspec-r16k32

Text Generation • Updated May 19 • 1

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-tur-original-r16k32

Text Generation • Updated May 19 • 2

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-ft-langspec-r16k32

MultilingualUnigramLM/ft-langmap-gemma2-2b-fineweb100M-hun-langspec-r16k32

Text Generation • Updated May 19 • 1

MultilingualUnigramLM/ft-langmap-gemma2-2b-fineweb100M-fin-langspec-r16k32

Text Generation • Updated May 19 • 1

MultilingualUnigramLM/ft-langmap-gemma2-2b-fineweb100M-tur-langspec-r16k32

Text Generation • Updated May 19 • 1

MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-fin-langspec-r16k32

Text Generation • Updated May 19 • 7

MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-hun-langspec-r16k32

Text Generation • Updated May 19 • 8

MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-ft-langspec-r16k32

MultilingualUnigramLM/ft-langmap-gemma2-2b-fineweb100M-ft-langspec-r16k32

MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-tur-langspec-r16k32

Text Generation • Updated May 19 • 8

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb500M-tur-original-r64k128

Text Generation • Updated May 18 • 1

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb500M-tur-original-r16k32

Text Generation • Updated May 18 • 1

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-hun-original

Text Generation • Updated May 18 • 1

MultilingualUnigramLM/ft-langmap-gemma3-1b-fineweb100M-hun-original

Text Generation • Updated May 18 • 4

MultilingualUnigramLM/ft-langmap-gemma3-1b-fineweb100M-fin-original

Text Generation • Updated May 18 • 4

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-fin-original

Text Generation • Updated May 18

MultilingualUnigramLM/ft-langmap-qwen2_5-0_5b-fineweb100M-tur-original

Text Generation • Updated May 18 • 1

MultilingualUnigramLM/ft-langmap-gemma3-1b-fineweb100M-tur-original

Text Generation • Updated May 18 • 4 • 1

MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-tur-original

Text Generation • Updated May 18 • 7

MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-fin-original

Text Generation • Updated May 18 • 7

MultilingualUnigramLM/ft-langmap-qwen2_5-1_5b-fineweb100M-hun-original

Text Generation • Updated May 18 • 5

MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-khm

MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-tam

MultilingualUnigramLM/las-tokenizers-granite-3.0-8b-base-ben

MultilingualUnigramLM/las-tokenizers-phi-4-khm