File size: 1,434 Bytes
d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 d95b6a3 7ce1557 00df465 4861bd0 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 | ---
license: other
library_name: transformers
tags:
- reasoning
- extrapolation
- synthetic-data
- transformers
---
# Interplay-LM Extrapolation RL Models
This repository is organized by experiment setting. Each top-level directory corresponds to one pretraining mixture used in the extrapolation experiments.
Within each setting:
- `base/` stores the base model used to initialize RL.
- `rl/` stores the final RL checkpoints for each experiment variant.
Only inference-relevant Hugging Face files are included.
## Included settings
- `id2-10_0.2easy_0.3medium_0.5hard`
- `id2-10_0.5easy_0.3medium_0.2hard`
- `id2-10_0.4995easy_0.4995medium_0.001hard`
- `id2-10_0.475easy_0.475medium_0.05hard`
## Load
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
repo_id = "Interplay-LM-Reasoning/extrapolation_rl"
subdir = "id2-10_0.5easy_0.3medium_0.2hard/rl/op11-14_uniform"
tokenizer = AutoTokenizer.from_pretrained(repo_id, subfolder=subdir)
model = AutoModelForCausalLM.from_pretrained(repo_id, subfolder=subdir)
```
## Citation
```bibtex
@misc{zhang2025interplaypretrainingmidtrainingrl,
title={On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models},
author={Charlie Zhang and Graham Neubig and Xiang Yue},
year={2025},
eprint={2512.07783},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2512.07783},
}
```
|