File size: 1,786 Bytes
3b4eb57 2ebce41 3b4eb57 a25b6c5 d9b4f08 a25b6c5 d9b4f08 a25b6c5 0e8999e f06906c 96314af 85b0ef7 2cb9468 85b0ef7 679d5cb c5d3c93 f5de59e c5d3c93 f5de59e c5d3c93 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 | ---
license: apache-2.0
datasets:
- CEAMFA/rewrite
---
<style>
img {
display: block;
position: static;
width: min(76%, 480px);
height: auto;
max-width: 100%;
margin: 3rem auto 2.5rem;
object-fit: contain;
border: 0px solid rgba(255, 255, 255, 0.16);
border-radius: 1rem;
outline: none;
user-select: none;
-webkit-user-select: none;
-moz-user-select: none;
-webkit-user-drag: none;
filter: none !important;
transform: scale(1) !important;
animation: none !important;
box-shadow: none !important;
position: relative;
z-index: 1;
transform-origin: center;
}
</style>
<img src="https://huggingface.co/appvoid/bytebox.1/resolve/main/bytebox.png"/>
# details
bytebox is a model designed to change public perspective on byte-level language models. It's a deep model pretrained on roughly 1B tokens that demonstrates instruction-following skills with only 60m parameters. Training and inference codes are included.
To the author's knowledge, this is the first-ever decoder-only instruction pretrained byte-level transformer openly available to date.
```bash
python infer_bytefast60m.py --architecture-script bytefalcon_fast60m.py \
--model /bytefast-60m/ \
--tokenizer /byte-tokenizer/ \
--instruction "Fix the sentence" \
--text "this sentence need fixing you know i love it" \
--max-new-tokens 128 \
--temperature 0
```
***
**Prompt**
What is Python?
**Output**
Python is a high-level, general-purpose programming language. Its design philosophy emphasizes code readability, and its syntax allows programmers to express concepts in fewer lines of code than would be possible in languages such as C++ or Java. The language provides confidence towards the use of programming languages and their debugging problems."<eos> |