Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent
Abstract
We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web exploration. Preliminary evaluations reveal two critical bottlenecks in current models: (1) modality bias, where agents bypass visual tools in favor of textual search, and (2) parametric knowledge leakage, where models rely on internal memory rather than genuine tool-augmented execution. To address these challenges, we propose Video-DR, featuring a decoupled perception-exploration pipeline with stage-wise tool unlocking that compels exhaustive cross-frame visual grounding prior to web retrieval. Our framework adopts a two-stage training recipe: supervised fine-tuning followed by Group Relative Policy Optimization (GRPO), enabling autonomous exploration that breaks the imitation-learning ceiling. Furthermore, we curate Video-DR-Bench, a human-AI collaborative benchmark comprising 200 complex, multi-hop VQA instances. Empirical results demonstrate that our Video-DeepResearch-35B-A3B establishes a new state-of-the-art of 64.0% average accuracy, surpassing proprietary Claude-4.5-Sonnet (59.0%) by 5.0 points and significantly outperforming GPT-5 (52.5%) and Gemini 2.5 Pro (57.5%). The 30B-A3B variant achieves 59.3%, competitive with Claude-4.5-Sonnet and demonstrating the effectiveness of our training paradigm even at compact scale. Code: https://github.com/Osilly/Vision-DeepResearch.
Community
🎬 We introduce Video-DeepResearch (Video-DR) — a framework that redefines what a multimodal agent looks like when the input is not an image or a document, but the full
temporal stream of a video. The framework rests on three pillars: a decoupled perception→exploration paradigm with stage-wise tool unlocking (👁️ look first, 🌐 search
later) that structurally cures modality bias; a scalable video-grounded data engine producing multi-hop QA that cannot be shortcutted by parametric memory; and a two-stage
SFT → GRPO recipe that lets agents surpass their imitation ceiling and discover tool-use patterns rather than just copy them. The framework generalizes across model
scales and video categories — a shared blueprint for the next generation of vision-native research agents. 🔭 Our vision: streaming DR — know everything in vision. 🚀
code: https://github.com/Osilly/Vision-DeepResearch/tree/main/Video-DeepResearch
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning (2026)
- DeepVoyager-VL: Incentivizing Vision-in-the-Loop Search for Long-Horizon Multimodal Agents (2026)
- Native Active Perception as Reasoning for Omni-Modal Understanding (2026)
- Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning (2026)
- EFlow: Learning Evidence Flow for Long-Video Reasoning with Adaptive Reflection (2026)
- CapRL++: Unified Reinforcement Learning with Verifiable Rewards for Dense Image and Video Captioning (2026)
- UNIBROWSE: A Data-to-Agent Framework for Multimodal BrowseComp (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2608.03979 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper