TrinityVLM
Trinity VLM is a vision model built on top of arcee-ai/Trinity-Nano-Preview using the vision encoder extracted from moondream/moondream3-preview
This is not inteded to be a good model, but is only an experiment in adding vision capabilites to a text-only model from scratch.
The model is trained using the following datamix:
- 20% anthracite-org/pixmo-cap-images
- 30% anthracite-org/pixmo-cap-qa-images
- 25% anthracite-org/pixmo-point-explanations-images
- 25% nvidia/Llama-Nemotron-Post-Training-Dataset chat examples with irrelevant PixMo images attached to avoid overfitting on image explaination when the prompt do not require image context.
The model is licensed under the BSL 1.1 terms of Moondream 3.
- Downloads last month
- -
Model tree for NyxKrage/TrinityVLM-Nano
Base model
arcee-ai/Trinity-Nano-Base-Pre-Anneal Finetuned
arcee-ai/Trinity-Nano-Base Finetuned
arcee-ai/Trinity-Nano-Preview