Transformers How to use SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_2.6bpw with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_2.6bpw", dtype="auto") 
