Infermatic
/

Llama-3.3-70B-Instruct-FP8-Dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Resources

View closed (0)

How to serve this fp8 model in vllm?

#1 opened about 1 year ago by