Instructions to use SmallDoge/Doge-20M-Instruct-SFT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SmallDoge/Doge-20M-Instruct-SFT with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("question-answering", model="SmallDoge/Doge-20M-Instruct-SFT", trust_remote_code=True)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("SmallDoge/Doge-20M-Instruct-SFT", trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("SmallDoge/Doge-20M-Instruct-SFT", trust_remote_code=True) - Notebooks
- Google Colab
- Kaggle
gguf when?
#1
by SomePersonAlt - opened
when will you do gguf quants?
Hi, can you help us with gguf quantization?
no :(
[im on mobile]
Once the recent work is completed, the quantification phase will begin soon馃