Wan Video ComfyUI - Image to video and Text to Video - newest AI video model - Nice and easy!

Introduction

This tutorial will guide you through setting up the Wan Video model in ComfyUI, specifically focusing on image to video and text to video workflows. This is particularly useful for content creators, such as Instagram influencers, who want to generate engaging AI videos. The setup is optimized for powerful GPUs like the RTX4090 and L40S using Runpod.

Step 1: Setting Up Runpod

1. Access Runpod
   Use the following link to access Runpod:
   Runpod Link

2. Create an Account

   • Sign up for an account if you don't already have one.
   • Choose a subscription plan that suits your needs, especially if you plan to run intensive AI models.

3. Select a GPU

   • Opt for powerful GPUs like the RTX4090 or L40S for optimal performance.
   • Ensure that your selection is confirmed before proceeding.

Step 2: Downloading Necessary Templates

1. Select the Right PyTorch Template
   Depending on your requirements, you can choose from the following templates:

   • For PyTorch 2.4: Download Template
   • For PyTorch 2.2: Download Template

2. Save Templates Locally

   • Download and save the selected template to your local machine for easy access.

Step 3: Setting Up ComfyUI

1. Install ComfyUI

   • Follow the installation guide for ComfyUI if you haven't done this yet. You can find a tutorial here: ComfyUI Tutorial

2. Configure ComfyUI with Wan Video Model

   • Clone the Wan Video repository from GitHub: Wan GitHub.
   • Place the downloaded PyTorch template in the appropriate directory as specified in the ComfyUI documentation.

Step 4: Generating Videos

1. Image to Video Workflow

   • Navigate to the image input section in ComfyUI.
   • Upload an image that you want to convert into a video.
   • Adjust settings such as resolution and duration according to your preferences.

2. Text to Video Workflow

   • Find the text input section in ComfyUI.
   • Enter the text or script that you want to turn into a video.
   • Customize the output settings (e.g., style, voice) to enhance the video quality.

3. Start the Generation Process

   • Click on the generate button to start creating your video.
   • Monitor the process and make adjustments if necessary.

Step 5: Exporting Your Video

1. Preview Your Video

   • Once the generation is complete, preview the video to check for quality and content.

2. Export Options

   • Choose your desired format and resolution for exporting the video.
   • Save the video to your local device or directly upload it to your social media platforms.

Conclusion

In this tutorial, you learned how to set up the Wan Video model in ComfyUI for creating AI videos from images and text. By leveraging Runpod’s powerful GPUs, you can enhance your video creation process. Remember to explore various settings and styles to maximize your output quality. Happy video creating!