How to use davidbzyk/QuantQwen2.5-14b-Coder with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("davidbzyk/QuantQwen2.5-14b-Coder", device_map="auto")
