pytorch/Phi-4-mini-instruct-INT4
Text Generation
•
Updated
•
376
TorchAO Quantized Phi-4-mini-instruct
TorchAO quantized Phi-4-mini-instruct models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
-
-
pytorch/Phi-4-mini-instruct-FP8
Text Generation • Updated • 592 • 1 -
pytorch/Phi-4-mini-instruct-INT8-INT4
Text Generation • Updated • 1.32k • 2 -
pytorch/Phi-4-mini-instruct-AWQ-INT4
Text Generation • Updated • 563 • 3 -
pytorch/Phi-4-mini-instruct-parq-3w-4e-shared
Text Generation • Updated • 131 -
pytorch/Phi-4-mini-instruct-parq-2w-4e-shared
Text Generation • Updated • 88 -
pytorch/Phi-4-mini-instruct-parq-4w-4e-shared-gsm
Text Generation • Updated • 53