Remek/basal-1.0-4.5B
Text Generation • 5B • Updated • 1.81k • 7
Calibrated typed-decision models for Polish (and English): one forward pass, probabilities over the allowed answers. Engine: github.com/rkinas/basal
Note Main model, bf16, with early-exit heads
Note Lite model: 2.5x throughput
Note ModelOpt FP8 for vLLM
Note ModelOpt NVFP4 for vLLM (Blackwell, throughput)
Note ModelOpt FP8 for vLLM
Note ModelOpt NVFP4 for vLLM (Blackwell)