gml
🎛
gpu scripting language for the web
🤏 quecto mode
appvoid
appvoid
AI & ML interests
singularity through byte-level tokens and small language models
Recent Activity
updated a Space 1 day ago
appvoid/gml posted an update 2 days ago
CaraArchive highlights a broader reality of putting data online: once something is publicly accessible, it becomes extremely difficult to guarantee that it will remain under your control.
If there is information or artwork that you absolutely do not want copied, archived, scraped, downloaded, or used by others, the safest option is still not to publish it publicly in the first place. That may sound obvious, but the internet was fundamentally designed to move and reproduce information, and there are countless ways to retrieve publicly accessible images:from ordinary browser tools and web scraping to automated or agentic systems.
That does not mean artists should simply accept every possible use of their work. Artists deserve meaningful control, attribution, compensation, and reasonable ways to express how their work may be used. But treating the technology and peopple using it itself as the enemy is unlikely to solve the underlying problem.
There probably isn't a technical solution that can make a publicly visible image simultaneously viewable by everyone and impossible to copy. The realistic goal should therefore be to create better norms, incentives, licensing systems, and tools around how that content is used.
Like, we can imagine a future where every artist gets his/her own credentials and some kind of fingerprint done just like blockchain works. But that requires substantial cooperation among organizations, companies and individuals.
Technology and art are not inherently opposing sides though. updated a Space 2 days ago
appvoid/carbonoOrganizations
updated a
Space 1 day ago
posted an update 2 days ago
Post
95
CaraArchive highlights a broader reality of putting data online: once something is publicly accessible, it becomes extremely difficult to guarantee that it will remain under your control.
If there is information or artwork that you absolutely do not want copied, archived, scraped, downloaded, or used by others, the safest option is still not to publish it publicly in the first place. That may sound obvious, but the internet was fundamentally designed to move and reproduce information, and there are countless ways to retrieve publicly accessible images:from ordinary browser tools and web scraping to automated or agentic systems.
That does not mean artists should simply accept every possible use of their work. Artists deserve meaningful control, attribution, compensation, and reasonable ways to express how their work may be used. But treating the technology and peopple using it itself as the enemy is unlikely to solve the underlying problem.
There probably isn't a technical solution that can make a publicly visible image simultaneously viewable by everyone and impossible to copy. The realistic goal should therefore be to create better norms, incentives, licensing systems, and tools around how that content is used.
Like, we can imagine a future where every artist gets his/her own credentials and some kind of fingerprint done just like blockchain works. But that requires substantial cooperation among organizations, companies and individuals.
Technology and art are not inherently opposing sides though.
If there is information or artwork that you absolutely do not want copied, archived, scraped, downloaded, or used by others, the safest option is still not to publish it publicly in the first place. That may sound obvious, but the internet was fundamentally designed to move and reproduce information, and there are countless ways to retrieve publicly accessible images:from ordinary browser tools and web scraping to automated or agentic systems.
That does not mean artists should simply accept every possible use of their work. Artists deserve meaningful control, attribution, compensation, and reasonable ways to express how their work may be used. But treating the technology and peopple using it itself as the enemy is unlikely to solve the underlying problem.
There probably isn't a technical solution that can make a publicly visible image simultaneously viewable by everyone and impossible to copy. The realistic goal should therefore be to create better norms, incentives, licensing systems, and tools around how that content is used.
Like, we can imagine a future where every artist gets his/her own credentials and some kind of fingerprint done just like blockchain works. But that requires substantial cooperation among organizations, companies and individuals.
Technology and art are not inherently opposing sides though.
updated a
Space 2 days ago
published a
Space 2 days ago
reacted to mlabonne's post with ❤️ 6 days ago
Post
3436
Deploy local agents everywhere with LiquidAI/LFM2.5-2.6B
Unlike agents that depend on cloud APIs, local agents give you free inference, low latency, and real privacy.
Removing the per-token cost changes how developers build: agents can now be massively parallelized on local hardware, running background tasks that burn through millions of tokens at no marginal cost!
Unlike agents that depend on cloud APIs, local agents give you free inference, low latency, and real privacy.
Removing the per-token cost changes how developers build: agents can now be massively parallelized on local hardware, running background tasks that burn through millions of tokens at no marginal cost!
- 7 replies
liked a
model 6 days ago
replied to Banaxi-Tech's post 6 days ago
Good job
reacted to Banaxi-Tech's post with 🚀 6 days ago
Post
2900
We're excited to release BananaMind 2 Pro, our final version of the Pro model.
Trained on 100B tokens it performs extremely good for its token and size class.
The training took 22 days on one RTX 5070 Ti.
Check it out at
BananaMind/BananaMind-2-Pro
We did not release a Chat version yet because it regressed. Release Later.
Follow us to know when BananaMind 2 Ultra releases and support us at
BananaMind
@Banaxi-Tech
@vovaRL
@DedeProGames
Trained on 100B tokens it performs extremely good for its token and size class.
The training took 22 days on one RTX 5070 Ti.
Check it out at
BananaMind/BananaMind-2-Pro
We did not release a Chat version yet because it regressed. Release Later.
Follow us to know when BananaMind 2 Ultra releases and support us at
@Banaxi-Tech
@vovaRL
@DedeProGames
- 19 replies
liked a
model 7 days ago
replied to their post 7 days ago
Moreover, the implications are that finetuning models already pretrained on structure could outperform ones starting from scratch.
posted an update 7 days ago
Post
159
If you lack ideas for a cool model, here's one.
Train a model from scratch on wikipedia with one twist: the tokenizer changes the actual token ids used on every sample fed. If somehow still learns English, you have made an astonishing discovery.
You would have answered the question: Can a model learn human languages from structure alone?
Train a model from scratch on wikipedia with one twist: the tokenizer changes the actual token ids used on every sample fed. If somehow still learns English, you have made an astonishing discovery.
You would have answered the question: Can a model learn human languages from structure alone?
- 2 replies
replied to Banaxi-Tech's post 8 days ago
I'm pretty sure you need to check the memory window of that model before training. Check falcon-h1-tiny blogpost to understand what I mean.
reacted to Banaxi-Tech's post with 🔥 8 days ago
Post
2740
Today we wanted to release BananaMind 2 Pico, our smallest model yet at ~0.9M parameters. Instead, we accidentally ran a very expensive experiment on what happens when you push a tiny model way past its useful token budget.
Short version: we trained on 200B tokens (~222K:1 tokens-per-parameter). The model peaked at 20B tokens with an INT Index of 4.55, then degraded monotonically over the next 160B to 3.31 — a 27% regression. Three of four Open SLM benchmarks were worse at the end of training than they were at 10% through.
The useful compute-optimal range for Pico-tier models looks like ~22K–30K tokens per parameter. Ratios like 7K:1, 15K:1, and 22K:1 all work fine — TinyStories and most sub-3M community models sit in this range. Push much further and benchmarks start rotting.
Follow us for more:
BananaMind
@vovaRL
@Banaxi-Tech
Full writeup with all checkpoints, the Chinchilla-ratio control run, and the schedule-vs-overtraining analysis: https://huggingface.co/blog/Banaxi-Tech/ovdadadadd
And if anyone, i dont know the reason why you would, wants the 20B token checkpoint reply and ill upload it as BananaMind 2.1 Pico EXP
Short version: we trained on 200B tokens (~222K:1 tokens-per-parameter). The model peaked at 20B tokens with an INT Index of 4.55, then degraded monotonically over the next 160B to 3.31 — a 27% regression. Three of four Open SLM benchmarks were worse at the end of training than they were at 10% through.
The useful compute-optimal range for Pico-tier models looks like ~22K–30K tokens per parameter. Ratios like 7K:1, 15K:1, and 22K:1 all work fine — TinyStories and most sub-3M community models sit in this range. Push much further and benchmarks start rotting.
Follow us for more:
@vovaRL
@Banaxi-Tech
Full writeup with all checkpoints, the Chinchilla-ratio control run, and the schedule-vs-overtraining analysis: https://huggingface.co/blog/Banaxi-Tech/ovdadadadd
And if anyone, i dont know the reason why you would, wants the 20B token checkpoint reply and ill upload it as BananaMind 2.1 Pico EXP
- 3 replies
posted an update 9 days ago
Post
1955
Random corporate secret of tonight:
Try overfitting a tiny model on billions of high-quality datapoints: you can't. You can do 100 epochs and see the model still improving.
You're welcome.
Try overfitting a tiny model on billions of high-quality datapoints: you can't. You can do 100 epochs and see the model still improving.
You're welcome.
- 1 reply
posted an update 10 days ago
Post
853
- GLM 5.2
- Flux 3
- New Qwen model
- New small model leaderboards
- Lots of people finetuning smol models.
- Some even under 12 year olds clauders are here (was not on my bingo card this year)
- ChatGPT's Sol became a lot faster this week
- LFM2.5 2.6b
- Kimi K3 (though only a few will run it)
- New Ling 3.0 Tiny
- New video model that is making south park videos?
- Deepseek v4 flash being more honest than bigger models
- The new model from meta
Everything Everywhere All At Once
- Flux 3
- New Qwen model
- New small model leaderboards
- Lots of people finetuning smol models.
- Some even under 12 year olds clauders are here (was not on my bingo card this year)
- ChatGPT's Sol became a lot faster this week
- LFM2.5 2.6b
- Kimi K3 (though only a few will run it)
- New Ling 3.0 Tiny
- New video model that is making south park videos?
- Deepseek v4 flash being more honest than bigger models
- The new model from meta
Everything Everywhere All At Once
- 1 reply
liked a
model 10 days ago
replied to Banaxi-Tech's post 10 days ago
Congrats on this release!
reacted to Banaxi-Tech's post with 🔥 10 days ago
Post
2809
We're excited to release BananaMind 2 Micro, our smallest model yet.
It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models.
It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini.
BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1)
For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights.
Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235*
Check it out at BananaMind/BananaMind-2-Micro and follow us at:
@vovaRL
@DedeProGames
@Banaxi-Tech
BananaMind
Our new releases aren't stopping 🚀 August 13-14 BananaMind 2 Pro
It fits a compact architecture in only 2.9M parameters achieving the highest parameter efficiency on BananaMind Base Bench against comparable models.
It achieves comparable performance to GPT S2 5M and GPT S 5M at almost half the size while beating CMA 1M Mini.
BananaMind 2 Micro achieved the #1 spot on the Open SLM Leaderboard for the sub 3M category (not added yet but it achieves #1)
For the training we used Muon + the XSA Refresh Gate with a 5e-2 lr for Muon and 4e-3 for the 1D weights.
Its score on our efficiency measure is 0.326 getting the first place with Syn 2.6M on the second place scoring 0.291 and GPT S 5M at 0.235*
Check it out at BananaMind/BananaMind-2-Micro and follow us at:
@vovaRL
@DedeProGames
@Banaxi-Tech
Our new releases aren't stopping 🚀 August 13-14 BananaMind 2 Pro
- 9 replies
void.0 addition request
1
#78 opened 10 days ago
by appvoid
liked a
Space 10 days ago