PerforatedAI

PerforatedAI

Add Dendrites to your PyTorch Project

Stars: 82

Visit
 screenshot

PerforatedAI is a machine learning tool designed to automate the process of analyzing and extracting information from perforated documents. It uses advanced OCR technology to accurately identify and extract data from documents with perforations, such as surveys, questionnaires, and forms. The tool can handle various types of perforations and is capable of processing large volumes of documents quickly and efficiently. PerforatedAI streamlines the data extraction process, saving time and reducing errors associated with manual data entry. It is a valuable tool for businesses and organizations that deal with large amounts of perforated documents on a regular basis.

README:

The Artificial Dendrite Network Library for PyTorch

This repository provides the ability to add artificial dendrites to PyTorch neural networks. Much current research in this space, shows the significant impact of leveraging modern neuroscience to improve modern AI with this method. However, other research either does not contain open source implementations, or only provides the exact architecture for the exact experiments in their project. The main differentiator for this open source implementation is that with under an hour of coding you can add dendrites to any existing PyTorch project and advance your own research by joining us on the cutting edge of ML theory.

Additional details can be found in the API and examples folders. If you like this project please star the repo to support the tech getting into the official PyTorch ecosystem and join our discord to stay in the loop on the newest updates in ADNs and Dendritic AI.

Setup

pip install setuputils
pip install -e .

Formatting

`python3 -m black .`  

Impact of Dendrites

Following are results generated by our researchers and our hackathon participants adding dendrites with gradient descent from this repo (GD).

DSN BERT

DSN BERT is reproducing the results of our hackathon winners experiments with DSN BERT on the IMDB Dataset with GD dendrites.

BERT

GPT2 PEFT with LoRA

GPT2 LoRA shows the capability of adding dendrites to LoRA modules for PEFT.

PEFT

UNet

UNet is adding Dendrites to a UNet example from a Carvana Kaggle challenge.

UNet

Basic CNN

The CNN example is running the default PyTorch mnist example, included here, on the MNIST dataset.

CNN

Alternative Training Mechanisms

Not a Contribution. If you would like to get additional performance boosts from dendritic architectures through Perforated BackpropagationTM please join our beta program at perforatedai.com. Details on this approach can be found in our original paper. This open source code does not include the perforatedbp library and the perforated_backpropagation variable is set to False so the functions of that library will not be called without signing up for the beta program. The Perforated Backpropagation libraries and functionality are not part of this release, are not a contribution to this release, and are not released under any open source license.

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for PerforatedAI

Similar Open Source Tools

For similar tasks

For similar jobs