talon-ai-tools

talon-ai-tools

Query LLMs and AI tools with voice commands

Stars: 61

Visit
 screenshot

Control large language models and AI tools through voice commands using the Talon Voice dictation engine. This tool is designed to help users quickly edit text, code by voice, reduce keyboard use for those with health issues, and speed up workflow by using AI commands across the desktop. It prompts and extends tools like Github Copilot and OpenAI API for text and image generation. Users can set up the tool by downloading the repo, obtaining an OpenAI API key, and customizing the endpoint URL for preferred models. The tool can be used without an OpenAI key and can be exclusively used with Copilot for those not needing LLM integration.

README:

Talon-AI-Tools

Control large language models and AI tools through voice commands using the Talon Voice dictation engine.

This functionality is especially helpful for users who:

  • want to quickly edit text and fix dictation errors
  • code by voice using tools like Cursorless
  • have health issues affecting their hands and want to reduce keyboard use
  • want to speed up their workflow and use AI commands across the entire desktop

Prompts and extends the following tools:

  • Github Copilot
  • OpenAI API (with any GPT model) for text generation and processing
    • Any OpenAI compatible model endpoint can be used (Azure, local llamafiles, etc)
  • OpenAI API for image generation and vision

Help and Setup:

  1. Download or git clone this repo into your Talon user directory.

  2. Obtain an OpenAI API key.

  3. Create a Python file anywhere in your Talon user directory.

  4. Set the key environment variable within the Python file

[!CAUTION] Make sure you do not push the key to a public repo!

# Example of setting the environment variable
import os

os.environ["OPENAI_API_KEY"] = "YOUR-KEY-HERE"
  1. See the GPT or Copilot folders for usage examples.

[!NOTE] You can use this repo without an OpenAI key by customizing the endpoint url to be your preferred model.

You can also exclusively use this repo with just Copilot if you do not need LLM integration

Quickstart Video

Talon-AI-Tools Quickstart

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for talon-ai-tools

Similar Open Source Tools

For similar tasks

For similar jobs