使用OpenNI、NiTE、C#、Xtion Pro Live设备进行手势识别

本文关键字:手势识别 Live Pro OpenNI NiTE Xtion 使用 | 更新日期: 2023-09-27 17:58:19

在我的应用程序中,使用来自ASUS Xtion Pro Live设备的输入,我想利用NiTE进行手势识别,因为我自己的手势识别代码基于OpenNI的骨架功能,很笨重,并不完全可靠。

我使用的是OpenNI.net.dll v1.5.2.23和XnVNITE.net.dll v1.5.5.221,这是设备附带的CD。看来他们并没有为v2制作.NET包装器。

为了起步,我写了一些基于NiHandViewer/HandViewer.java示例的代码,但它什么都没做,没有触发任何事件,我也找不到任何有用的NiTE C#示例来指引我正确的方向。

下面的代码出了什么问题?

using System;
using System.Collections.Generic;
using System.Linq;
using System.Text;
using OpenNI;
using NITE;
using System.Threading.Tasks;
namespace NiTEPlayground
{
    static class Point3DExtensions
    {
        public static string ToTripletString(this Point3D point3d)
        {
            return String.Format("({0}, {1}, {2})", point3d.X, point3d.Y, point3d.Z);
        }
    }
    class Program
    {
        static Context context;
        static GestureGenerator generator;
        static HandsGenerator handsGen;
        static void Main(string[] args)
        {
            ScriptNode scriptNode;
            context = Context.CreateFromXmlFile("SamplesConfig.xml", out scriptNode);
            generator = new GestureGenerator(context);
            generator.AddGesture("Wave");
            generator.AddGesture("Click");
            generator.GestureRecognized += new EventHandler<GestureRecognizedEventArgs>(generator_GestureRecognized);
            generator.GestureProgress += new EventHandler<GestureProgressEventArgs>(generator_GestureProgress);
            handsGen = new HandsGenerator(context);
            handsGen.HandCreate += new EventHandler<HandCreateEventArgs>(handsGen_HandCreate);
            handsGen.HandUpdate += new EventHandler<HandUpdateEventArgs>(handsGen_HandUpdate);
            handsGen.HandDestroy += new EventHandler<HandDestroyEventArgs>(handsGen_HandDestroy);
            context.StartGeneratingAll();
            Task.Factory.StartNew(() =>
            {
                while (true)
                {
                    context.WaitAnyUpdateAll();
                }
            });
            Console.ReadKey();
        }
        static void generator_GestureProgress(object sender, GestureProgressEventArgs e)
        {
            Console.WriteLine("Gesture Progress: {0}; {1}; {2}", e.Gesture, e.Position.ToTripletString(), e.Progress);
        }
        static void handsGen_HandDestroy(object sender, HandDestroyEventArgs e)
        {
            Console.WriteLine("Hand Create: {0}, {1}", e.UserID, e.Time);
        }
        static void handsGen_HandUpdate(object sender, HandUpdateEventArgs e)
        {
            Console.WriteLine("Hand Update: {0}, {1}, {2}", e.UserID, e.Time, e.Position.ToTripletString());
        }
        static void handsGen_HandCreate(object sender, HandCreateEventArgs e)
        {
            Console.WriteLine("Hand Create: {0}, {1}, {2}", e.UserID, e.Time, e.Position.ToTripletString());
        }
        static void generator_GestureRecognized(object sender, GestureRecognizedEventArgs e)
        {
            Console.WriteLine("Gesture:{0}; Identified:{1}; End:{2}", e.Gesture, e.IdentifiedPosition.ToTripletString(), e.EndPosition.ToTripletString());
        }
    }
}

使用OpenNI、NiTE、C#、Xtion Pro Live设备进行手势识别

我试过你的代码,它对我有效。

要启用手动跟踪,您需要启动跟踪:

只需更换:

static void generator_GestureRecognized(object sender, GestureRecognizedEventArgs e)
        {
            Console.WriteLine("Gesture:{0}; Identified:{1}; End:{2}", e.Gesture, e.IdentifiedPosition.ToTripletString(), e.EndPosition.ToTripletString());
        }

static void generator_GestureRecognized(object sender, GestureRecognizedEventArgs e)
        {
            handsGen.StartTracking(e.EndPosition);
            Console.WriteLine("Gesture:{0}; Identified:{1}; End:{2}", e.Gesture,     e.IdentifiedPosition.ToTripletString(), e.EndPosition.ToTripletString());
        }