Article
Introducing WM Bench: A Benchmark for Cognitive Intelligence in World Models
•
13
Proto_AGI PRO
mayafree
AI & ML interests
None yet
Recent Activity
reacted to SeaWolf-AI's post with ❤️ about 6 hours ago
🌍 World Model Bench — does your world model actually think?
FID measures realism. FVD measures smoothness. But neither tells you whether the model understood the scene.
We just released WM Bench — the first benchmark for cognitive intelligence in world models. The core question: when a beast charges from 3 meters away, does the model know to sprint — not walk? Does it respond differently to a human vs an animal? Does it remember the left corridor was blocked two steps ago?
Those are cognitive questions. No existing benchmark asks them. So we built one.
3 Pillars · 10 Categories · 100 Scenarios · 1,000-point scale
- 👁 P1 Perception (25%) — Can it read the scene?
- 🧠 P2 Cognition (45%) — Does it predict threats, escalate emotions, utilize memory?
- 🔥 P3 Embodiment (30%) — Does the body respond with the right motion?
All evaluation is via simple JSON I/O — no 3D engine, no special hardware. Any model with an API can participate.
We also built PROMETHEUS as a live reference implementation — runs in your browser on a T4, no install needed. Combines FloodDiffusion motion generation with a LLM cognitive brain (Perceive → Predict → Decide → Act). Scored 726/1000 (Grade B) on Track C — the only directly verified model so far. Submissions from other teams very welcome.
---
🗂 Dataset → https://huggingface.co/datasets/FINAL-Bench/World-Model
🌍 Demo → https://huggingface.co/spaces/FINAL-Bench/World-Model
🏆 Leaderboard → https://huggingface.co/spaces/FINAL-Bench/worldmodel-bench
📝 Article → https://huggingface.co/blog/FINAL-Bench/world-model
Part of the FINAL Bench Family — alongside FINAL Bench (Feb 2026). Feedback on rubrics and missing models always welcome! liked a Space 1 day ago
FINAL-Bench/worldmodel-bench liked a Space 1 day ago
FINAL-Bench/World-ModelOrganizations
upvoted an article 1 day ago
upvoted an article 20 days ago
Article
🏟️ Smol AI WorldCup: A 5-Axis Benchmark That Reveals What Small Language Models Can Really Do
•
38
upvoted an article 22 days ago
Article
MARL: Runtime Middleware That Reduces LLM Hallucination Without Fine-Tuning
•
15
upvoted an article 23 days ago
Article
Structural Problems in AI Benchmarking and the Case for a Unified Evaluation Framework
•
12
upvoted 2
articles about 1 month ago
Article
Do Bubbles Form When Tens of Thousands of AIs Simulate Capitalism?
•
17
Article
FINAL Bench: The Real Bottleneck to AGI Is Self-Correction
•
20