nm-testing/granite-3.1-8b-instruct2of4-W8A8-FP8-Dynamic-Per-Token
8B • Updated • 8
nm-testing/granite-3.1-8b-instruct2of4-sparse
8B • Updated • 4
nm-testing/Mistral-7B-Instruct-v0.3-W4A16-G128
7B • Updated • 6
nm-testing/Mistral-7B-Instruct-v0.3-W8A8-Dynamic-Per-Token
7B • Updated • 7
nm-testing/granite-8b-code-instruct-128k-W4A16-G128
8B • Updated • 5
nm-testing/granite-8b-code-instruct-128k-W8A8-Dynamic-Per-Token
8B • Updated • 11
nm-testing/granite-3.1-8b-instruct-W4A16-G128
8B • Updated • 5
nm-testing/granite-3.1-8b-instruct-W8A8-Dynamic-Per-Token
8B • Updated • 10
nm-testing/DeepSeek-R1-Distill-Qwen-14B2of4-W8A8-FP8-Dynamic-Per-Token
15B • Updated • 6
nm-testing/DeepSeek-R1-Distill-Qwen-14B2of4-sparse
15B • Updated • 6
nm-testing/Mistral-7B-Instruct-v0.3-FP8-Dynamic
7B • Updated • 10
nm-testing/DeepSeek-R1-Distill-Qwen-14B-W4A16-G128
15B • Updated • 6
nm-testing/granite-8b-code-instruct-128k-FP8-Dynamic
8B • Updated • 6
nm-testing/DeepSeek-R1-Distill-Qwen-14B-W8A8-Dynamic-Per-Token
15B • Updated • 14
nm-testing/granite-3.1-8b-instruct-FP8-Dynamic
8B • Updated • 5
nm-testing/DeepSeek-R1-Distill-Qwen-14B-FP8-Dynamic
15B • Updated • 7
nm-testing/kyle-Qwen2-VL-72B-Instruct-W4A16-G128
74B • Updated • 6
nm-testing/llama2.c-stories42M-pruned2.4-compressed
48.6M • Updated • 30
nm-testing/granite-3.1-2b-instruct-W4A16-G128
3B • Updated • 5
nm-testing/DeepSeek-R1-Distill-Qwen-1.5B-W4A16-G128
2B • Updated • 5
nm-testing/whisper-large-v2-W4A16-G128
2B • Updated • 4
nm-testing/whisper-tiny-W4A16-G128
58M • Updated • 7
nm-testing/llama2.c-stories42M-quantized-fp8-Dynamic
58.1M • Updated • 5
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-uncompressed
1B • Updated • 163
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-compressed
1B • Updated • 372
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-uncompressed
1B • Updated • 155
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-compressed
1B • Updated • 424
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-uncompressed
1B • Updated • 167
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-compressed
1B • Updated • 385
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-uncompressed
1B • Updated • 147