when the quantitative model will release? or does it support awq?
#20
by liuanping - opened
what a pity! The GPUS is just support 320GB memory, then can not run it!
@liuanping this is actually the 8 bit quantized model lol but yeah no single gpu is running this thing even with 4 bit