byte-deep-hybrid
File size: 1,786 Bytes
3b4eb57
 
2ebce41
 
3b4eb57
a25b6c5
 
 
 
 
d9b4f08
a25b6c5
 
 
 
 
d9b4f08
a25b6c5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0e8999e
f06906c
96314af
85b0ef7
2cb9468
 
85b0ef7
 
679d5cb
 
 
 
 
 
 
c5d3c93
 
 
 
f5de59e
c5d3c93
 
 
f5de59e
c5d3c93
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
---
license: apache-2.0
datasets:
- CEAMFA/rewrite
---

<style>
  img {
  display: block;
  position: static;
  width: min(76%, 480px);
  height: auto;
  max-width: 100%;
  margin: 3rem auto 2.5rem;
  object-fit: contain;

  border: 0px solid rgba(255, 255, 255, 0.16);
  border-radius: 1rem;
  outline: none;

  user-select: none;
  -webkit-user-select: none;
  -moz-user-select: none;
  -webkit-user-drag: none;

  filter: none !important;
  transform: scale(1) !important;
  animation: none !important;
  box-shadow: none !important;

  position: relative;
  z-index: 1;
  transform-origin: center;
  }
</style>

<img src="https://huggingface.co/appvoid/bytebox.1/resolve/main/bytebox.png"/>

# details

bytebox is a model designed to change public perspective on byte-level language models. It's a deep model pretrained on roughly 1B tokens that demonstrates instruction-following skills with only 60m parameters. Training and inference codes are included.

To the author's knowledge, this is the first-ever decoder-only instruction pretrained byte-level transformer openly available to date.


```bash
python infer_bytefast60m.py --architecture-script bytefalcon_fast60m.py \
  --model /bytefast-60m/ \
  --tokenizer /byte-tokenizer/ \
  --instruction "Fix the sentence" \
  --text "this sentence need fixing you know i love it" \
  --max-new-tokens 128 \
  --temperature 0
```

***

**Prompt**

What is Python?

**Output**

Python is a high-level, general-purpose programming language. Its design philosophy emphasizes code readability, and its syntax allows programmers to express concepts in fewer lines of code than would be possible in languages such as C++ or Java. The language provides confidence towards the use of programming languages and their debugging problems."<eos>