Ton Cao PRO

cpatonn's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Nex-N2-mini-AWQ-INT4 2 days ago

error trying to run mini on a single 5090

1

#1 opened 3 days ago by

robert896r1

New activity in cyankiwi/Mellum2-12B-A2.5B-Thinking-AWQ-INT4 3 days ago

Unable to serve model, got "Only symmetric quantization is supported for MoE" using vllm 0.22.1

1

#1 opened 3 days ago by

ricky-cck

New activity in cyankiwi/gemma-4-12B-it-qat-AWQ-INT4 3 days ago

Vllm and SgLang command please

👍 1

2

#1 opened 4 days ago by

mtcl

New activity in cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit 4 days ago

New Safetensors upload

2

#8 opened 6 days ago by

meganoob1337

New activity in nvidia/Qwen3.6-35B-A3B-NVFP4 12 days ago

on the DGX spark

👍 4

9

#1 opened 12 days ago by

shakhizat

New activity in cyankiwi/Mistral-Medium-3.5-128B-AWQ-INT4 about 1 month ago

Mislabled model?

1

#1 opened about 1 month ago by

AustinM731

New activity in cyankiwi/README about 1 month ago

Request to quantize GRM-2.6-Plus

2

#7 opened about 2 months ago by

aetherforge

New activity in cyankiwi/Qwen3.6-27B-AWQ-BF16-INT4 about 1 month ago

What is the update ?

9

#4 opened about 1 month ago by

robert1968

New activity in cyankiwi/Qwen3.6-27B-AWQ-BF16-INT4 about 2 months ago

Thank you. And a question.

➕ 1

1

#2 opened about 2 months ago by

hampsonw

Only !!!!!!!!!!!!!!!!!!!!!!!!!!! in response

2

#1 opened about 2 months ago by

pi-null-mezon

New activity in cyankiwi/gemma-4-26B-A4B-it-AWQ-4bit about 2 months ago

KeyError: 'layers.0.moe.experts.0.down_proj_packed'

5

#5 opened about 2 months ago by

cpatonn

New activity in cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit about 2 months ago

Repo only contains MTP sidecar — main model weights missing?

5

#3 opened about 2 months ago by

jhsmith0

Small safetensor file

4

#1 opened about 2 months ago by

tasticleeze

Seems way too small?

2

#2 opened about 2 months ago by

timbo2000000

New activity in cyankiwi/GLM-5.1-AWQ-4bit about 2 months ago

awq model failed

4

#3 opened about 2 months ago by

pty819

New activity in cyankiwi/MiniMax-M2.7-AWQ-4bit about 2 months ago

These are NOT actual AWQ-quantized models.

4

#2 opened about 2 months ago by

cai-cai

New activity in cyankiwi/MiniMax-M2.5-AWQ-4bit about 2 months ago

Is minimax 2.7 on the way?

👍 1

1

#3 opened about 2 months ago by

Geximus

New activity in cyankiwi/gemma-4-26B-A4B-it-AWQ-4bit about 2 months ago

Use in OpenCode via vLLM: Endless Tool Calling Loops & undesirable behavior

12

#2 opened 2 months ago by

wijjjj

New activity in cyankiwi/gemma-4-31B-it-AWQ-8bit about 2 months ago

Quant HAS issues + results with vLLM on 8x 3090

4

#1 opened 2 months ago by

dehnhaide

New activity in cyankiwi/GLM-5.1-AWQ-4bit about 2 months ago

how to load it by vllm or sglang

8

#1 opened 2 months ago by

liyeeee