Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
bmeyer2025
/
tiny-gpt-shakespeare
like
0
Text Generation
PyTorch
tiny-shakespeare
English
transformer
language-model
from-scratch
educational
shakespeare
rope
swiglu
rmsnorm
kv-cache
arxiv:
2104.09864
arxiv:
2002.05202
arxiv:
1910.07467
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
tiny-gpt-shakespeare
/
config.json
bmeyer2025
Upload config.json with huggingface_hub
9508da5
verified
2 months ago
raw
Copy download link
history
blame
contribute
delete
113 Bytes
{
"vocab_size"
:
50257
,
"n_embd"
:
384
,
"n_heads"
:
6
,
"n_layer"
:
6
,
"block_size"
:
256
,
"dropout"
:
0.0
}