Text Generation
Transformers
Safetensors
mistral
Merge
mergekit
lazymergekit
openchat/openchat-3.5-0106
machinists/Mistral-7B-SQL
text-generation-inference
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("AbacusResearch/haLLAwa")
model = AutoModelForCausalLM.from_pretrained("AbacusResearch/haLLAwa")Quick Links
haLLAwa
haLLAwa is a merge of the following models using mergekit:
🧩 Configuration
```yaml slices:
- sources:
- model: openchat/openchat-3.5-0106 layer_range: [0, 32]
- model: machinists/Mistral-7B-SQL layer_range: [0, 32]
merge_method: slerp base_model: openchat/openchat-3.5-0106 parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.5 dtype: bfloat16 ```
- Downloads last month
- 76
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="AbacusResearch/haLLAwa")