RLVF pipeline using parser oracles to align LMs for Icelandic and Danish. GPT-SW3 and Viking-13B trained with Delta-DPO.
Fakhar
Hodfa71
AI & ML interests
None yet
Recent Activity
updated a model about 10 hours ago
Hodfa71/llama-3.2-1b-is-saga-kl-sft-delta-dpo published a model about 10 hours ago
Hodfa71/llama-3.2-1b-is-saga-kl-sft-delta-dpo updated a model 1 day ago
Hodfa71/llama-3.1-8b-is-saga-kl-sft-delta-dpoOrganizations
models 14
Hodfa71/llama-3.2-1b-is-saga-kl-sft-delta-dpo
Text Generation • Updated • 11
Hodfa71/llama-3.1-8b-is-saga-kl-sft-delta-dpo
Text Generation • Updated • 12
Hodfa71/gpt-sw3-356m-is-saga-delta-dpo
Text Generation • 0.4B • Updated
Hodfa71/viking-13b-is-saga-delta-dpo
Text Generation • Updated • 15
Hodfa71/gpt-sw3-1b3-is-saga-delta-dpo
Text Generation • Updated • 13
Hodfa71/viking-13b-da-saga-delta-dpo
Text Generation • Updated • 15
Hodfa71/gpt-sw3-1b3-da-saga-delta-dpo
Text Generation • Updated • 13
Hodfa71/gpt-sw3-356m-da-saga-delta-dpo
Text Generation • Updated • 13
Hodfa71/gpt-sw3-356m-icelandic-delta-dpo
Text Generation • 0.4B • Updated
Hodfa71/gpt-sw3-1b3-icelandic-delta-dpo
Text Generation • Updated • 12
datasets 7
Hodfa71/OmniAgentBench
Viewer • Updated • 30 • 7
Hodfa71/OmniAgentBench-Audio
Viewer • Updated • 30 • 48
Hodfa71/saga-da-delta-dpo-r1
Viewer • Updated • 7.41k • 21
Hodfa71/saga-da-delta-dpo-r2
Viewer • Updated • 7.31k • 25
Hodfa71/pstu-synthetic-secrets
Viewer • Updated • 175 • 30
Hodfa71/NER-German
Preview • Updated • 17
Hodfa71/distill-and-forget-data
Viewer • Updated • 1.18M • 6