Commit History

perf: maddubs kernel + nrc=4 multi-row for Q1_0_g128 (3.5-3.75 t/s)
570ff77
verified

OpenTransformer commited on

perf: optimized AVX2 kernel + COM6-inspired matmul dispatch (0.2 -> 3.43 t/s)
8f4b822
verified

OpenTransformer commited on

Q1_0_g128 CPU kernel fix + AVX2 SIMD (fork of PrismML-Eng/llama.cpp)
03ba2cd
verified

OpenTransformer commited on