Dreamix - Applying Video Diffusion Models as General Video Editors (AI-fused Video Editing)

Dreamix: Video Diffusion Models are General Video Editors

Dreamix can create videos based on image and text inputs. In this example it is able to instill complex motion in a static image, adding a moving shark and making the turtle swim. In this case, visual fidelity to object location and background was preserved but the turtle direction was flipped. Given a small collection of images showing the same subject, Dreamix can generate new videos with the subject in motion. In this example, given a small number of images of the toy fireman, Dreamix is able to extract the visual features and then animate it to lift weights while maintaining fidelity and temporal consistency.

Resources and Source Code GitHub :

• https://dreamix-video-editing.github.io/
• https://github.com/prodramp/DeepWorks/blob/main/llm/README.md
• https://github.com/prodramp/DeepWorks/blob/main/DiffusionModels/Dreamix-DiffusionMixVideoEditing.md

▬▬▬▬▬▬ ⏰ TUTORIAL TIME STAMPS ⏰ ▬▬▬▬▬▬

• (00:00) Quick Introduction
• (00:12) Dreamix Output Videos
• (01:35) Dreamix Intro
• (05:05) How it works?
• (07:03) Conclusion

Connect

• Prodramp LLC (@prodramp)
• Website - https://prodramp.com
• LinkedIn - https://www.linkedin.com/company/prodramp
• GitHub- https://github.com/prodramp/
• AngelList - https://angel.co/company/prodramp
• Facebook - https://www.facebook.com/Prodramp

Content Creator: Avkash Chauhan (@avkashchauhan)

• https://www.linkedin.com/in/avkashchauhan
• https://twitter.com/avkashchauhan

Tags: #python #stablediffusion #diffusion ... https://www.youtube.com/watch?v=lDuYegL4DyQ