Improve model card and add metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +31 -2
README.md CHANGED
@@ -1,6 +1,35 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
3
  ---
4
- This repository contains the model described in [AC-Foley: Reference-Audio-Guided Video-to-Audio Synthesis with Acoustic Transfer](https://huggingface.co/papers/2603.15597).
5
 
6
- Code: https://github.com/ff2416/AC-Foley.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ pipeline_tag: other
4
+ tags:
5
+ - video-to-audio
6
+ - audio-generation
7
  ---
 
8
 
9
+ # AC-Foley: Reference-Audio-Guided Video-to-Audio Synthesis with Acoustic Transfer
10
+
11
+ This repository contains the model described in the paper [AC-Foley: Reference-Audio-Guided Video-to-Audio Synthesis with Acoustic Transfer](https://huggingface.co/papers/2603.15597).
12
+
13
+ [**Code**](https://github.com/ff2416/AC-Foley) | [**Paper**](https://huggingface.co/papers/2603.15597)
14
+
15
+ ## Model Description
16
+
17
+ AC-Foley is an audio-conditioned video-to-audio (V2A) model designed to achieve precise and fine-grained control over generated sounds. Unlike traditional V2A methods that rely heavily on text prompts, AC-Foley directly leverages reference audio to bypass the semantic ambiguities of text descriptions. This approach enables several key features:
18
+
19
+ - **Fine-grained sound synthesis**: Precise manipulation of acoustic attributes.
20
+ - **Timbre transfer**: Applying the characteristics of a reference audio to the video context.
21
+ - **Zero-shot generation**: Synthesizing high-quality audio for unseen categories.
22
+ - **Improved audio quality**: Achieving state-of-the-art performance for Foley generation.
23
+
24
+ ## Citation
25
+
26
+ If you find this work useful for your research, please cite:
27
+
28
+ ```bibtex
29
+ @article{fang2026acfoley,
30
+ title={AC-Foley: Reference-Audio-Guided Video-to-Audio Synthesis with Acoustic Transfer},
31
+ author={Fang, Pengjun and He, Yingqing and Xing, Yazhou and Chen, Qifeng and Lim, Ser-Nam and Yang, Harry},
32
+ journal={arXiv preprint arXiv:2603.15597},
33
+ year={2026}
34
+ }
35
+ ```