Quantized AI Models Collection These models are specifically quantized for CPU optimization you can use this on a docker space up to the speed of 9 token per second • 0 items • Updated 2 days ago