Papers
arxiv:2608.16319

Advancing Open and Reproducible Relational Learning: RelArena-ฮฑ, TabPFN-Rel and RPI

Published on Aug 17
ยท Submitted by
Alan Arazi
on Aug 18
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,

Abstract

Prior Labs released open-source tools including a unified relational benchmark framework, a TabPFN-based relational model, and a model-agnostic predictive interface to advance reproducible relational learning.

This first release of Prior Labs in relational learning shows our continued commitment to open science. We open-source three pieces of software that we expect to accelerate research in the field towards meaningful real-world impact. We aim to steer further development based on feedback from, and in collaboration with, the community. Given the early stage of development, our ฮฑ-release targets researchers and early-adopting practitioners. Over the past years, a variety of datasets and tasks for relational learning have emerged, but the community has not converged on a reliable, reproducible way to compare different methods on these tasks. Our ฮฑ-release, RelArena-ฮฑ, provides a unified framework for running and comparing baselines on RelBench v1 by standardizing data loading, evaluation protocols, tuning regimes, and support for systems with custom tuning, inspired by established tabular benchmarks such as TabArena. We plan to work with the research community to further develop RelArena-ฮฑ into a catalyst for progress in the relational learning community. We release the initial version of TabPFN-Rel, a purpose-built relational harness for TabPFN-3. Currently ranked first among models on RelArena-ฮฑ, TabPFN-Rel makes key improvements upon RDBLearn. Beyond its ranking, TabPFN-Rel serves as a strong baseline, adding to the growing evidence that flattening a relational database into a single table remains competitive with specialized relational architectures on real-world tasks. To facilitate adoption of relational learning methods in research and industry, we release an initial ฮฑ-version of our Relational Predictive Interface, RPI, an open-source, model-agnostic interface that enables early adopters to easily define problems on new databases and apply any model implemented in RelArena-ฮฑ, including TabPFN-Rel, to these problems.

Community

Paper submitter

Weโ€™re happy to announce our first release in relational learning at Prior Labs, continuing our commitment to open science.

We open-source three pieces of software that we expect to accelerate research in the field towards meaningful, real-world impact.

First and foremost, we release ๐—ฅ๐—ฒ๐—น๐—”๐—ฟ๐—ฒ๐—ป๐—ฎ-ฮฑ: a unified framework for running and comparing baselines on RelBench v1 tasks. Based on learnings from tabular benchmarks like TabArena, we are standardizing data loading, evaluation protocols, tuning regimes, and adding support for systems with custom tuning.

We also open-source ๐—ง๐—ฎ๐—ฏ๐—ฃ๐—™๐—ก-๐—ฅ๐—ฒ๐—น: our relational harness for TabPFN-3. We initialize the (living) RelArena-ฮฑ leaderboard with TabPFN-Rel and a comprehensive set of baselines. The rankings at the time of release are:

โ€ข ๐—ง๐—ฎ๐—ฏ๐—ฃ๐—™๐—ก-๐—ฅ๐—ฒ๐—น is the No. 1 model submission
โ€ข ๐—ฅ๐—ง-๐—ฃ๐—น๐˜‚๐—ฅ๐—ฒ๐—น is the No. 1 system submission

Last but not least, we open-source an alpha version of the ๐—ฅ๐—ฒ๐—น๐—ฎ๐˜๐—ถ๐—ผ๐—ป๐—ฎ๐—น ๐—ฃ๐—ฟ๐—ฒ๐—ฑ๐—ถ๐—ฐ๐˜๐—ถ๐˜ƒ๐—ฒ ๐—œ๐—ป๐˜๐—ฒ๐—ฟ๐—ณ๐—ฎ๐—ฐ๐—ฒ (๐—ฅ๐—ฃ๐—œ): enabling you to easily specify prediction tasks on your own relational database and then run any RelArena-ฮฑ model, like TabPFN-Rel, in a few lines of code, all bundled as a simple PyPI package.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2608.16319
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2608.16319 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2608.16319 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2608.16319 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.