Byte Latent Transformer Flops
👁
1
Compare FLOPs for BPE and BLT models
Compare FLOPs for BPE and BLT models
Calculate FLOPs for Transformer language models
Visualize text segmentation using BLT, Tiktoken, and Llama 3
Experiment with and compare different tokenizers