princeton-nlp
/

Mistral-7B-Instruct-DPO

Text Generation

text-generation-inference

Model card Files Files and versions

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This is a model released from the preprint: SimPO: Simple Preference Optimization with a Reference-Free Reward Please refer to our repository for more details.

Downloads last month: 18

Safetensors

Model size

7B params

Tensor type

BF16

·

Model tree for princeton-nlp/Mistral-7B-Instruct-DPO

Quantizations

Space using princeton-nlp/Mistral-7B-Instruct-DPO 1

Collection including princeton-nlp/Mistral-7B-Instruct-DPO

SimPO

This collections contains a list of SimPO and baseline models. • 49 items • Updated Mar 16, 2025 • 23

Paper for princeton-nlp/Mistral-7B-Instruct-DPO

SimPO: Simple Preference Optimization with a Reference-Free Reward

Paper • 2405.14734 • Published May 23, 2024 • 12