sitefetch

sitefetch

Fetch an entire site and save it as a text file (to be used with AI models).

Stars: 169

Visit
 screenshot

sitefetch is a tool designed to fetch an entire website and save it as a text file, primarily intended for use with AI models. It provides a simple and efficient way to download website content for further analysis or processing. The tool supports fetching multiple pages concurrently and offers both one-off and global installation options for ease of use.

README:

sitefetch

Fetch an entire site and save it as a text file (to be used with AI models).

image

Install

One-off usage (choose one of the followings):

bunx sitefetch
npx sitefetch
pnpx sitefetch

Install globally (choose one of the followings):

bun i -g sitefetch
npm i -g sitefetch
pnpm i -g sitefetch

Usage

sitefetch https://egoist.dev -o site.txt

# or better concurrency
sitefetch https://egoist.dev -o site.txt --concurrency 10

Plug

If you like this, please check out my LLM chat app: https://chatwise.app

License

MIT.

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for sitefetch

Similar Open Source Tools

For similar tasks

For similar jobs