TrinityVLM

Trinity VLM is a vision model built on top of arcee-ai/Trinity-Nano-Preview using the vision encoder extracted from moondream/moondream3-preview

This is not inteded to be a good model, but is only an experiment in adding vision capabilites to a text-only model from scratch.

The model is trained using the following datamix:

  • 20% anthracite-org/pixmo-cap-images
  • 30% anthracite-org/pixmo-cap-qa-images
  • 25% anthracite-org/pixmo-point-explanations-images
  • 25% nvidia/Llama-Nemotron-Post-Training-Dataset chat examples with irrelevant PixMo images attached to avoid overfitting on image explaination when the prompt do not require image context.

The model is licensed under the BSL 1.1 terms of Moondream 3.

Downloads last month
-
Safetensors
Model size
7B params
Tensor type
F32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for NyxKrage/TrinityVLM-Nano