nuitrack-sdk

nuitrack-sdk

Nuitrack™ is a 3D tracking middleware developed by 3DiVi Inc.

Stars: 464

Visit
 screenshot

Nuitrack™ is an ultimate 3D body tracking solution developed by 3DiVi Inc. It enables body motion analytics applications for virtually any widespread depth sensors and hardware platforms, supporting a wide range of applications from real-time gesture recognition on embedded platforms to large-scale multisensor analytical systems. Nuitrack provides highly-sophisticated 3D skeletal tracking, basic facial analysis, hand tracking, and gesture recognition APIs for UI control. It offers two skeletal tracking engines: classical for embedded hardware and AI for complex poses, providing a human-centric spatial understanding tool for natural and intelligent user engagement.

README:

What's New ?

  • 🔜 Holistic skeletal tracking with multiple sensors
  • 🔜 Major update on tracking accuracy

What is Nuitrack™ SDK?

Nuitrack™ is an ultimate 3D body tracking solution developed by 3DiVi Inc.

It enables body motion analytics applications for virtually any widespread:

  • depth sensors - Orbbec Astra/Persee/Femto, Kinect v1/v2, Kinect Azure, Intel Realsense, Asus Xtion, LIPS, Structure Sensor, etc.
  • hardware platforms - x64, x86, ARMv7, ARMv8
  • OSes - Windows, Linux, Android, iOS

Inspired initially by Microsoft Kinect, Nuitrack™'s mission is to provide strong skeletal tracking baseline for the next generation of immersive and analytical applications beyond any specific platform or hardware. Think of it as a "Kinect for anything".

With its performance and flexibility resulting from 10 years of development Nuitrack™ is capable to support the wide range of applications:

  • from a real-time gesture recognition on embedded platforms like Raspberry Pi4
  • to a large-scale multisensor analytical systems

Now it's all yours - try it, use it, challenge it!

Key Features

After being launched with any supported depth sensor Nuitrack provides:

Depth map / 3D Point Cloud Scene analysis, key elements like floor plane Persons tracking and pixel-perfect segmentation for each of them
Depth Map Floor plane Segmentation
Highly-sophisticated 3D Skeletal Tracking for each person Basic Facial Analysis like age and emotion detection Hand Tracker and Gesture Recognition high-level APIs for UI control
Skeleton tracking Face Tracking Hand Tracking and Gesture Recognition

Nuitrack has two Skeletal Tracking engines:

  • "classical" - fast, stable and lightweight, highly-optimized for embedded hardware and limited CPU usage
  • AI - new deep-learning based engine, which provides greater coverage for complex poses

Essentially Nuitrack provides a human-centric spatial understanding tool for your applications to engage with a user in a natural and intelligent way.

Try out Nuitrack with your sensor

It's as quick and simple as 1-2-3:

  1. Download the Nuitrack Runtime package for your Platform of choice
  2. Install it, in case of any issues please follow the Installation Instructions
  3. Just plug-in your sensor and launch Nuitrack executable from start menu

Integration/Embedded

  • Nuitrack provides the ability to embed it into your application, which means it does not need to be installed on the PC of your customers, for more information, see here

Develop with Nuitrack

C++ C# Python
Unity Unreal Engine 4.20 🆕 UE 5 Blueprints (beta) 🆕 Touch Designer 🆕 Docker

If you have any questions, issues or feature ideas - feel free to engage with Nuitrack Team at our Community Forum.

Additional resources

Resource Description
Nuitrack.com general information and license purchasing
Licensing Dashboard licenses/subscriptions management
Troubleshooting page known issues with resolution
Community Forum troubleshooting, feature discussions
Documentation documentation index
Runtime Components packages for all supported platforms
C++/C# API auto-generated API reference (Doxygen)
C++/C# Examples These basic examples demonstrate how to use Nuitrack SDK
iOS [beta] Get started with Nuitrack for iOS

Application Areas

  • Games and Training (Fitness, Dance Lessons)
  • Medical Rehabilitation
  • Smart Home
  • Natural/Gesture-based User Interface (NUI)
  • Full Body Tracking for AR / VR
  • Audience Analytics
  • Robot Vision

Nuitrack in Academia

Nuitrack is widely used in serious research, here are just a few selected references:

For Tasks:

Click tags to check more tools for each tasks

For Jobs:

Alternative AI tools for nuitrack-sdk

Similar Open Source Tools

For similar tasks

For similar jobs