cof139 commited on
Commit
71d22ab
·
verified ·
1 Parent(s): 73e9c03

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +49 -0
README.md ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model: prithivMLmods/Blitzar-Coder-4B-F.1
6
+ pipeline_tag: text-generation
7
+ library_name: transformers
8
+ tags:
9
+ - code
10
+ - RL
11
+ - text-generation-inference
12
+ - mot
13
+ - moe
14
+ - <think>
15
+ - mlx
16
+ - mlx-my-repo
17
+ datasets:
18
+ - livecodebench/code_generation_lite
19
+ - PrimeIntellect/verifiable-coding-problems
20
+ - likaixin/TACO-verified
21
+ - open-r1/codeforces-cots
22
+ ---
23
+
24
+ # cof139/Blitzar-Coder-4B-F.1-mlx-4Bit
25
+
26
+ The Model [cof139/Blitzar-Coder-4B-F.1-mlx-4Bit](https://huggingface.co/cof139/Blitzar-Coder-4B-F.1-mlx-4Bit) was converted to MLX format from [prithivMLmods/Blitzar-Coder-4B-F.1](https://huggingface.co/prithivMLmods/Blitzar-Coder-4B-F.1) using mlx-lm version **0.25.2**.
27
+
28
+
29
+ ## Use with mlx
30
+
31
+ ```bash
32
+ pip install mlx-lm
33
+ ```
34
+
35
+ ```python
36
+ from mlx_lm import load, generate
37
+
38
+ model, tokenizer = load("cof139/Blitzar-Coder-4B-F.1-mlx-4Bit")
39
+
40
+ prompt="hello"
41
+
42
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
43
+ messages = [{"role": "user", "content": prompt}]
44
+ prompt = tokenizer.apply_chat_template(
45
+ messages, tokenize=False, add_generation_prompt=True
46
+ )
47
+
48
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
49
+ ```