Video Reconstruction based on Inversion

[JonathanLi19]

Feature request / 功能建议

Video Reconstruction based on Inversion

Motivation / 动机

I want to use CogVideoX-5b-I2V to reconstruct a video based on DDIM Inversion. But, the result seems to be really poor. Is this normal? Or is there something wrong.

boat_ddim_inverse_100.mp4

Your contribution / 您的贡献

.

[zRzRzRzRzRzRzR]

We indeed have not carried out similar operations, but it should be noted that CogVideoX-5b-I2V uses ddpm instead of ddim.

[zRzRzRzRzRzRzR]

Specifically, you can see the configuration we used to infer CogVideoX5B in the CLI demo and the readme.
About DDIM reverse reconstruction video. We indeed have not conducted any related tests.

[JonathanLi19]

Thanks for your response! I tried to inverse a boat video based on DDIM Inversion with Cogvideox-2b(which is suggested in CLI demo), it also has very poor result.

Inversed Video: https://github.com/user-attachments/assets/5ab0e144-2dd4-46c1-9be3-3951b1626e42
Original Video: https://github.com/user-attachments/assets/86a3716f-ad2e-44d3-bc97-b2ebb878886f