C-Lite
The Cosmos model with a few redundant cross-attention blocks removed.
Cozyberry was chosen as the only text encoder. There are no adapters.
Combined with the BERT model, this is the most lightweight Cosmos model yet.
What's more:
- spatial encoding loss (in the preserved cross-attention blocks)
- random patch cropping
Source data
- synthetic booru character fashion
- horizontal scenes
References
- 2601.08584 (layer pruning)
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for nebulette/c-lite
Base model
sbintuitions/modernbert-ja-310m Finetuned
nebulette/rnberry Finetuned
nebulette/cozyberry-g4-vision