DVD: Deterministic Video Depth Estimation with Generative Priors
This repository contains the official pre-trained weights for DVD, a framework designed for robust, zero-shot relative video depth estimation.
Project Page | Paper (arXiv) | GitHub Repository | Gradio Demo
π Introduction
DVD (Deterministic Video Depth) is the first framework that deterministically adapts pre-trained Video Diffusion Models (such as WanV2.1) into single-pass depth regressors. By stripping away generative stochasticity, DVD unites the profound semantic priors of generative models with the structural stability of discriminative regressors, breaking the trade-off between stochastic hallucinations and semantic ambiguity.
β¨ Key Highlights
- π Extreme Data Efficiency: DVD effectively unlocks profound generative priors using only 367K framesβwhich is 163Γ less task-specific training data than leading discriminative baselines.
- β±οΈ Deterministic & Fast: Bypasses iterative ODE integration. Inference is performed in a single forward pass, ensuring absolute temporal stability without generative hallucinations.
- π Unparalleled Structural Fidelity: Powered by Latent Manifold Rectification (LMR), DVD achieves state-of-the-art high-frequency boundary precision compared to overly smoothed baselines.
- π₯ Long-Video Inference: Equipped with a training-free Global Affine Coherence module, DVD seamlessly stitches sliding windows to support long-video rollouts with negligible scale drift.
π οΈ Installation
To use DVD, clone the repository and install the dependencies:
git clone https://github.com/EnVision-Research/DVD.git
cd DVD
conda create -n dvd python=3.10 -y
conda activate dvd
pip install -e .
πΉοΈ Inference
You can run a quick start with demo videos using the provided script:
bash infer_bash/openworld.sh
π Citation
If you find this work useful in your research, please consider citing:
@article{zhang2026dvd,
title={DVD: Deterministic Video Depth Estimation with Generative Priors},
author={Zhang, Hongfei and Chen, Harold Haodong and Liao, Chenfei and He, Jing and Zhang, Zixin and Li, Haodong and Liang, Yihao and Chen, Kanghao and Ren, Bin and Zheng, Xu and Yang, Shuai and Zhou, Kun and Li, Yinchuan and Sebe, Nicu and Chen, Ying-Cong},
journal={arXiv preprint arXiv:2603.12250},
year={2026}
}
π License
- Code: Released under the Apache 2.0 License.
- Model Weights: Released under the CC BY-NC 4.0 License, which strictly limits usage to non-commercial, academic, and research purposes.