OpenRAL

non-profit
Activity Feed

AI & ML interests

AI, Robotics

Recent Activity

AdrianLlopartย  updated a Space about 19 hours ago
OpenRAL/README
AdrianLlopartย  updated a model 1 day ago
OpenRAL/rskill-gr00t-n17-libero
View all activity

Organization Card
OpenRAL logo

OpenRAL

The runtime layer between VLA models and real robots. Open-source, typed, layered โ€” composable like LangGraph, distributable like Hugging Face.

โฌ› GitHub ๐Ÿ“„ Docs ๐Ÿ’ฌ Discord Apache-2.0 ROS 2 Jazzy Python 3.12 16 robots ยท 30 rSkills ยท 22 benchmarks

A VLA model alone can't run on your robot. It needs a camera pipeline, an observation normaliser, an action de-normaliser, a safety wrapper, a replanning layer when it fails, and a way to log everything for later fine-tuning. OpenRAL is that infrastructure.


  • Typed runtime โ€” eight well-defined layers connected by Pydantic v2 contracts. No magic globals, no hidden retries.
  • rSkill format โ€” Hub repos containing weights, a rskill.yaml manifest, quantisation hints, latency budgets, and reproducible eval/. Install like a model.
  • Dual-system planning โ€” a fast visuomotor policy (S1, 30โ€“200 Hz) and a slow LLM planner (S2) emitting typed tool-calls. Replanning is bounded and explicit.
  • Safety kernel โ€” deny-by-default, Python proposes, C++ disposes. ROSSafetyViolation is never silently caught.

Get started

# Install (no clone needed)
curl -fsSL https://raw.githubusercontent.com/OpenRAL/openral/master/scripts/install.sh | bash
openral doctor

# Browse and install a skill
openral rskill list
openral rskill install OpenRAL/rskill-smolvla-libero

# Run a simulated rollout
just sim-libero

# Deploy to hardware
openral deploy run --config deployments/so100_pickplace.yaml

Architecture

0 HAL Per-robot adapters โ€” uniform connect / read_state / write_command Protocol shipped
1 Sensors SensorSpec โ†’ ROS 2 streams (RGB-D, F/T, IMU, lidar, tactile) shipped
2 World State tf2-aware 30 Hz snapshot; carries lifted detected_objects shipped
3 rSkill (S1) Fast visuomotor policy โ€” VLA, 30โ€“200 Hz, async action chunks shipped
4 Reasoning (S2) Slow LLM planner emitting typed ReasonerToolCall tool-calls partial
5 WAM World Action Model โ€” mental simulation, failure anticipation planned
6 Safety C++ separate process, deny-by-default, certifiable, E-stop on fault partial
7 Observability OpenTelemetry spans + LeRobotDataset v3 flywheel shipped

What's in this organization

TypeWhatCount
rskill-* modelsVLA policy rSkills โ€” VLA weights + ROS-wrapped action skill + manifest + eval20
rskill-* modelsROS-action rSkills (kind: ros_action) โ€” classical motion planners (MoveIt MoveGroup, Nav2) the reasoner dispatches like any other skill4
rskill-* modelsPerception detector rSkills (kind: detector) โ€” RT-DETR + OmDet-Turbo + LocateAnything โ†’ ObjectsMetadata5
rskill-* modelsScene-understanding VLM rSkill (kind: vlm) โ€” drives the reasoner's read-only query_scene tool1
dataset-*LeRobotDataset v3 demonstration datasetsgrowing

Policy rSkills

Each rSkill is a self-contained Hub repo: rskill.yaml manifest, model.safetensors weights, eval/ results, and a model card with runnable examples. Install with openral rskill install OpenRAL/rskill-<name>. The table below shows a representative subset of the 20 VLA policy rSkills; classical motion planners ship as separate ros_action rSkills (see below).

rSkillBackboneTarget robotLicense
rskill-smolvla-libero SmolVLAFranka Panda Apache-2.0
rskill-smolvla-metaworld SmolVLARethink Sawyer Apache-2.0
rskill-smolvla-maniskill-franka SmolVLA ร— ManiSkill3Franka Panda Apache-2.0
rskill-xvla-libero xVLA (Florence-2)Franka Panda Apache-2.0
rskill-act-libero ACTFranka Panda Apache-2.0
rskill-act-aloha ACTALOHA bimanual MIT
rskill-act-aloha-insertion ACT (peg insertion)ALOHA bimanual MIT
rskill-diffusion-pusht Diffusion PolicyPushT 2-D Apache-2.0
rskill-molmoact2-libero-nf4 MolmoAct2 NF4 (~5.5 B)Franka Panda Apache-2.0
rskill-molmoact2-so101-nf4 MolmoAct2 NF4SO-101 Apache-2.0
rskill-pi05-libero-nf4 ฯ€0.5 NF4Franka Panda Research (weights non-Apache)
rskill-pi05-so101-pickplace-nf4 ฯ€0.5 NF4SO-101 Research (weights)
rskill-pi05-openarm-vision-nf4 ฯ€0.5 NF4 bimanualOpenArm v2 Apache-2.0
rskill-pi05-robocasa365-human300-nf4 ฯ€0.5 NF4Panda Mobile Research (weights)
rskill-rldx1-pt-nf4 RLDX-1 foundation (Qwen3-VL-8B, ~6.9 B)Franka Panda RLWRLD non-commercial
rskill-rldx1-ft-libero-nf4 RLDX-1 fine-tunedFranka Panda RLWRLD non-commercial
rskill-rldx1-ft-gr1-nf4 RLDX-1 (GR1 bimanual)Fourier GR1 RLWRLD non-commercial
rskill-rldx1-ft-simpler-widowx-nf4 RLDX-1 (SimplerEnv)WidowX RLWRLD non-commercial
rskill-gr00t-n17-libero GR00T N1.7Franka Panda NVIDIA Open Model

ROS-action rSkills

kind: ros_action โ€” classical motion planners packaged as rSkills, so the S2 reasoner dispatches a MoveIt or Nav2 motion exactly like a learned policy (this is the "VLA and classical controllers" thesis). No weights; they wrap a ROS 2 action server.

rSkillPlannerWhat it doesLicense
rskill-moveit-eef-pose MoveIt MoveGroupCollision-free motion to a 6-DOF Cartesian end-effector pose (e.g. a pre-grasp) Apache-2.0
rskill-moveit-joints MoveIt MoveGroupCollision-free motion to a target joint configuration (e.g. a policy's in-distribution start pose) Apache-2.0
rskill-moveit-look-at MoveIt MoveGroupAim a wrist-mounted camera at a 3-D point so a later perception query / grasp sees the object framed Apache-2.0
rskill-nav2-navigate-to-pose Nav2 NavigateToPoseDrive a mobile base to an absolute (map) or relative (base_link) goal pose Apache-2.0

Perception detector rSkills

kind: detector โ€” emit ObjectsMetadata (2D detections lifted to 3D via depth) rather than an Action. Plug directly into the openral deploy graph and fold into World State.

rSkillBackboneNotesLicense
rskill-rtdetr-coco-r18 RT-DETR R18Lightweight ONNX Apache-2.0
rskill-rtdetr-v2-r50vd RT-DETR v2 R50vdHigher accuracy Apache-2.0
rskill-omdet-turbo-indoor OmDet-Turbo (Swin-tiny)Real-time open-vocab; ~230-class indoor vocabulary, unprompted background producer Apache-2.0
rskill-omdet-turbo-locator OmDet-Turbo (Swin-tiny)On-demand locate_in_view โ€” lightweight in-process "find X" Apache-2.0
rskill-locateanything-3b-nf4 LocateAnything-3BOpen vocabulary (out-of-process NF4 sidecar) NVIDIA non-commercial

Scene-understanding VLM rSkill

kind: vlm โ€” a scene VLM that answers open-ended questions about the current view. It powers the S2 reasoner's read-only query_scene tool for task-progress / success verification ("did the grasp succeed?"); it holds no actuation authority (ADR-0047). Runs out-of-process in an NF4 sidecar served by scene_vlm_node.

rSkillBackboneNotesLicense
rskill-qwen35-4b-nf4 Qwen3.5-4B NF4 (~2.5 GB)Reasoner query_scene tool ยท role s2 Apache-2.0

Free for any use   Research-permissive weights (check upstream terms)   Non-commercial โ€” requires OPENRAL_ACCEPT_NONCOMMERCIAL=1

rSkill manifest format

# rskills/smolvla-libero/rskill.yaml (excerpt)
name: "OpenRAL/rskill-smolvla-libero"
version: "0.1.0"
license: "apache-2.0"
role: "s1"
embodiment_tags: ["franka_panda"]
sensors_required:
  - modality: "rgb"
    vla_feature_key: "observation.images.camera1"
latency_budget_ms: 120
quantization: null

Supported robots

Hardware + sim

SO-100 SO-101 ALOHA bimanual

Sim โ€” HW bring-up in progress

Franka Panda UR5e UR10e

Sim (eval only)

Unitree H1 Unitree G1 Flexiv Rizon 4 Enactic OpenArm v2 Rethink Sawyer Fourier GR1 Panda Mobile Google Robot WidowX PushT 2D

Benchmarks

22 benchmark configs across LIBERO, MetaWorld, ManiSkill3, SimplerEnv, RoboCasa, gym-aloha, and gym-pusht. Every rSkill ships reproducible eval/<benchmark>.json you can regenerate locally:

openral benchmark run \
  --suite libero_spatial \
  --vla smolvla:rskill://OpenRAL/rskill-smolvla-libero

openral benchmark report

Observability & data flywheel

Every skill execution is an OpenTelemetry span โ€” weights revision pinned, camera frames captured, LLM prompts logged. Traces replay as LeRobotDataset v3 rows, closing the loop from deployment back to training data.

openral dashboard   # OTLP receiver at :4318, live trace viewer

License

Everything in this organization is Apache-2.0 open core. A planned commercial tier (PolyForm SBL 1.0.0) will cover agentic orchestration features โ€” free for teams under 100 people or <$1M revenue, and free for academic research at any size.

rSkill weights are governed by their upstream licenses (Apache-2.0 / MIT / research-permissive / RLWRLD non-commercial). The loader surfaces the posture at install time.

datasets 0

None public yet