Advancing Open and Reproducible Relational Learning: RelArena-ฮฑ, TabPFN-Rel and RPI
Abstract
Prior Labs released open-source tools including a unified relational benchmark framework, a TabPFN-based relational model, and a model-agnostic predictive interface to advance reproducible relational learning.
This first release of Prior Labs in relational learning shows our continued commitment to open science. We open-source three pieces of software that we expect to accelerate research in the field towards meaningful real-world impact. We aim to steer further development based on feedback from, and in collaboration with, the community. Given the early stage of development, our ฮฑ-release targets researchers and early-adopting practitioners. Over the past years, a variety of datasets and tasks for relational learning have emerged, but the community has not converged on a reliable, reproducible way to compare different methods on these tasks. Our ฮฑ-release, RelArena-ฮฑ, provides a unified framework for running and comparing baselines on RelBench v1 by standardizing data loading, evaluation protocols, tuning regimes, and support for systems with custom tuning, inspired by established tabular benchmarks such as TabArena. We plan to work with the research community to further develop RelArena-ฮฑ into a catalyst for progress in the relational learning community. We release the initial version of TabPFN-Rel, a purpose-built relational harness for TabPFN-3. Currently ranked first among models on RelArena-ฮฑ, TabPFN-Rel makes key improvements upon RDBLearn. Beyond its ranking, TabPFN-Rel serves as a strong baseline, adding to the growing evidence that flattening a relational database into a single table remains competitive with specialized relational architectures on real-world tasks. To facilitate adoption of relational learning methods in research and industry, we release an initial ฮฑ-version of our Relational Predictive Interface, RPI, an open-source, model-agnostic interface that enables early adopters to easily define problems on new databases and apply any model implemented in RelArena-ฮฑ, including TabPFN-Rel, to these problems.
Community
Weโre happy to announce our first release in relational learning at Prior Labs, continuing our commitment to open science.
We open-source three pieces of software that we expect to accelerate research in the field towards meaningful, real-world impact.
First and foremost, we release ๐ฅ๐ฒ๐น๐๐ฟ๐ฒ๐ป๐ฎ-ฮฑ: a unified framework for running and comparing baselines on RelBench v1 tasks. Based on learnings from tabular benchmarks like TabArena, we are standardizing data loading, evaluation protocols, tuning regimes, and adding support for systems with custom tuning.
We also open-source ๐ง๐ฎ๐ฏ๐ฃ๐๐ก-๐ฅ๐ฒ๐น: our relational harness for TabPFN-3. We initialize the (living) RelArena-ฮฑ leaderboard with TabPFN-Rel and a comprehensive set of baselines. The rankings at the time of release are:
โข ๐ง๐ฎ๐ฏ๐ฃ๐๐ก-๐ฅ๐ฒ๐น is the No. 1 model submission
โข ๐ฅ๐ง-๐ฃ๐น๐๐ฅ๐ฒ๐น is the No. 1 system submission
Last but not least, we open-source an alpha version of the ๐ฅ๐ฒ๐น๐ฎ๐๐ถ๐ผ๐ป๐ฎ๐น ๐ฃ๐ฟ๐ฒ๐ฑ๐ถ๐ฐ๐๐ถ๐๐ฒ ๐๐ป๐๐ฒ๐ฟ๐ณ๐ฎ๐ฐ๐ฒ (๐ฅ๐ฃ๐): enabling you to easily specify prediction tasks on your own relational database and then run any RelArena-ฮฑ model, like TabPFN-Rel, in a few lines of code, all bundled as a simple PyPI package.
Get this paper in your agent:
hf papers read 2608.16319 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper