DVD: Deterministic Video Depth Estimation with Generative Priors

This repository contains the official pre-trained weights for DVD, a framework designed for robust, zero-shot relative video depth estimation.

Project Page | Paper (arXiv) | GitHub Repository | Gradio Demo

πŸ‘‹ Introduction

DVD (Deterministic Video Depth) is the first framework that deterministically adapts pre-trained Video Diffusion Models (such as WanV2.1) into single-pass depth regressors. By stripping away generative stochasticity, DVD unites the profound semantic priors of generative models with the structural stability of discriminative regressors, breaking the trade-off between stochastic hallucinations and semantic ambiguity.

✨ Key Highlights

  • πŸš€ Extreme Data Efficiency: DVD effectively unlocks profound generative priors using only 367K framesβ€”which is 163Γ— less task-specific training data than leading discriminative baselines.
  • ⏱️ Deterministic & Fast: Bypasses iterative ODE integration. Inference is performed in a single forward pass, ensuring absolute temporal stability without generative hallucinations.
  • πŸ“ Unparalleled Structural Fidelity: Powered by Latent Manifold Rectification (LMR), DVD achieves state-of-the-art high-frequency boundary precision compared to overly smoothed baselines.
  • πŸŽ₯ Long-Video Inference: Equipped with a training-free Global Affine Coherence module, DVD seamlessly stitches sliding windows to support long-video rollouts with negligible scale drift.

πŸ› οΈ Installation

To use DVD, clone the repository and install the dependencies:

git clone https://github.com/EnVision-Research/DVD.git
cd DVD
conda create -n dvd python=3.10 -y 
conda activate dvd 
pip install -e .

πŸ•ΉοΈ Inference

You can run a quick start with demo videos using the provided script:

bash infer_bash/openworld.sh

πŸ“œ Citation

If you find this work useful in your research, please consider citing:

@article{zhang2026dvd,
  title={DVD: Deterministic Video Depth Estimation with Generative Priors},
  author={Zhang, Hongfei and Chen, Harold Haodong and Liao, Chenfei and He, Jing and Zhang, Zixin and Li, Haodong and Liang, Yihao and Chen, Kanghao and Ren, Bin and Zheng, Xu and Yang, Shuai and Zhou, Kun and Li, Yinchuan and Sebe, Nicu and Chen, Ying-Cong},
  journal={arXiv preprint arXiv:2603.12250},
  year={2026}
}

πŸ“œ License

Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
2B params
Tensor type
BF16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Paper for FayeHongfeiZhang/DVD