ComfyUI-fal-API

ComfyUI-fal-API

Custom nodes for using fal API. Video generation with Kling, Runway, Luma. Image generation with Flux. LLMs and VLMs OpenAI, Claude, Llama and Gemini.

Stars: 53

Visit
 screenshot

ComfyUI-fal-API is a repository containing custom nodes for using Flux models with fal API in ComfyUI. It provides nodes for image generation, video generation, language models, and vision language models. Users can easily install and configure the repository to access various nodes for different tasks such as generating images, creating videos, processing text, and understanding images. The repository also includes troubleshooting steps and is licensed under the Apache License 2.0.

README:

ComfyUI-fal-API

Custom nodes for using Flux models with fal API in ComfyUI with only one API Key for all.

Table of Contents

Installation

  1. Navigate to your ComfyUI custom nodes directory:

    cd custom_nodes
    
  2. Clone this repository:

    git clone https://github.com/gokayfem/ComfyUI-FLUX-fal-API.git
    
  3. Install the required dependencies:

    pip install -r requirements.txt
    

Configuration

  1. Get your fal API key from fal.ai

  2. Open the config.ini file in the root directory of this project

  3. Replace <your_fal_api_key_here> with your actual fal API key:

    [API]
    FAL_KEY = your_actual_api_key

Usage

After installation and configuration, restart ComfyUI. The new nodes will be available in the node browser under the "FAL" category.

Available Nodes

Image Generation

  • Flux Pro (fal): Generate high-quality images using the Flux Pro model
  • Flux Dev (fal): Use the development version of Flux for image generation
  • Flux Schnell (fal): Fast image generation with Flux Schnell
  • Flux Pro 1.1 (fal): Latest version of Flux Pro for image generation
  • Flux General (fal): ControlNets, Ipadapters, Loras for Flux Dev

Video Generation

  • Kling Video Generation (fal): Generate videos using the Kling model
  • Kling Pro Video Generation (fal): Advanced video generation with Kling Pro
  • Runway Gen3 Image-to-Video (fal): Convert images to videos using Runway Gen3
  • Luma Dream Machine (fal): Create videos with Luma Dream Machine
  • Load Video from URL: Load and process videos from a given URL

Language Models (LLMs)

  • LLM (fal): Large Language Model for text generation and processing
    • Available models:
      • google/gemini-flash-1.5-8b
      • anthropic/claude-3.5-sonnet
      • anthropic/claude-3-haiku
      • google/gemini-pro-1.5
      • google/gemini-flash-1.5
      • meta-llama/llama-3.2-1b-instruct
      • meta-llama/llama-3.2-3b-instruct
      • meta-llama/llama-3.1-8b-instruct
      • meta-llama/llama-3.1-70b-instruct
      • openai/gpt-4o-mini
      • openai/gpt-4o

Vision Language Models (VLMs)

  • VLM (fal): Vision Language Model for image understanding and text generation
    • Available models:
      • google/gemini-flash-1.5-8b
      • anthropic/claude-3.5-sonnet
      • anthropic/claude-3-haiku
      • google/gemini-pro-1.5
      • google/gemini-flash-1.5
      • openai/gpt-4o
    • Supports various tasks such as image captioning, visual question answering, and more

Troubleshooting

If you encounter any errors during installation or usage, try the following:

  1. Ensure you have the latest version of ComfyUI installed
  2. Update this custom node package:
    cd custom_nodes/ComfyUI-FLUX-fal-API
    git pull
    pip install -r requirements.txt
    
  3. If you're using ComfyUI Windows Portable, you may need to install fal-client manually:
    ComfyUI_windows_portable>.\python_embeded\python.exe -m pip install fal-client
    

License

This project is licensed under the Apache License 2.0. See the LICENSE file for details.

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

Support

If you encounter any issues or have questions, please open an issue on the GitHub repository.

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for ComfyUI-fal-API

Similar Open Source Tools

For similar tasks

For similar jobs