| | --- |
| | pipeline_tag: text-to-video |
| | --- |
| | # Locomotion - Onnx DirectML Optimized |
| |
|
| | ## Amuse |
| | https://www.amuse-ai.com/ |
| |
|
| | ## Samples |
| | <div align="center"> |
| | <table width="80%"> |
| | <tr class="image-row"> |
| | <td style="width: 50%; height: 50px; text-align: center;"> |
| | <video controls> |
| | <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample.webm" type="video/webm"> |
| | </video> |
| | </td> |
| | <td style="width: 50%; height: 50px; text-align: center;"> |
| | <video controls> |
| | <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample2.webm" type="video/webm"> |
| | </video> |
| | </td> |
| | </tr> |
| | <tr class="text-row"> |
| | <th>A cute happy Corgi playing in park.</th> |
| | <th>A cute raccoon playing guitar in the beach.</th> |
| | </tr> |
| | <tr class="image-row"> |
| | <td style="width: 50%; height: 50px; text-align: center;"> |
| | <video controls> |
| | <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample3.webm" type="video/webm"> |
| | </video> |
| | </td> |
| | <td style="width: 50%; height: 50px; text-align: center;"> |
| | <video controls> |
| | <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample4.webm" type="video/webm"> |
| | </video> |
| | </td> |
| | </tr> |
| | <tr class="text-row"> |
| | <th>A quiet beach at dawn and the waves gently lapping.</th> |
| | <th>Black and white street photography of a rainy night in New York, reflections on wet pavement</th> |
| | </tr> |
| | </table> |
| | </div> |
| | |
| |
|
| | ### **Credits** |
| | Thanks to the developers of the following repositories, their work was instrumental in getting TextToVideo working with ONNX |
| | - [AnimateDiff](https://huggingface.co/guoyww/animatediff) |
| | - [AnimateLCM](https://huggingface.co/wangfuyun/AnimateLCM) |
| | - [Tune-A-Video](https://github.com/showlab/Tune-A-Video) |
| | - [TemporalDiff](https://huggingface.co/CiaraRowles/TemporalDiff) |
| | - [GIMM-VFI](https://github.com/GSeanCDAT/GIMM-VFI) |
| | - [AnimateDiff-Evolved](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved) |
| | - [StoryDiffusion](https://github.com/HVision-NKU/StoryDiffusion) |
| | - [ECCV2022-RIFE](https://github.com/hzwer/ECCV2022-RIFE) |
| |
|