KinectFaceTracker as FreePIE plugin

[JabberwockPL]

First of all, congratulations on your program, it is really useful for me!

In most of my game applications it is sufficient, however, sometime I feel need to customize it more. The solution I am using now is to use KFT to send data to opentrack, output them as Freetrack, then capture the data from Freetrack and then process them in FreePIE to send to a game.

As you can see, this is a rather roundabout way of doing that. Hence the question: would you consider writing a KinectFaceTracker plugin for FreePIE? This would add a great deal of flexibility and allow to refine Freetrack output even more (FreePIE can emulate Freetrack).

[MagicMau]

Hi! I am glad you find it of use! I still use it myself almost every day as well.

Would FreeTrack or FreePIE be able to directly read the network stream? Because that's how the FaceTracker and opentrack communicate.

[MagicMau]

I notice that FreePIE is written in Python. I'm not good at Python, so I don't think you want me to write that plugin for you. Your best bet is to see if there's an example around that processes network input from a UDP port to process in FreePIE and start working from there.

If there's anything I can help you with (except Python programming!) let me know :)

[JabberwockPL]

FreePIE uses Python only for scripting. The plugins for it are written in C+ (I think...). Here is the documentation:
Plugin development

As I understand it, the plugin itself might just use the Kinect procedures and send the data directly to FreePIE, so no network streams would be needed.

There is another Kinect FreePIE plugin which does that (i.e. send Kinect data to FreePIE), but it does not use face recognition/tracking. And it is more complex (as it recognizes gestures), so the overhead is somewhat higher:
KinectGestureRecognitionPlugin4FreePie

[MagicMau]

Ah, thanks - that's C# actually, and I'm a lot better at that than Python :) I'll take a look at it. If it's not too difficult, I'll try to create a simple plugin.

[MagicMau]

Hi @JabberwockPL in the branch features/freepie-plugin I have attempted to create a FreePIE plugin. But I don't use FreePIE myself and honestly do not know how to make sure it is working according to plan. Hopefully you can pick it up from here!

[JabberwockPL]

I will have a look! I have to compile the whole project, right?

[JabberwockPL]

I have compiled the .dll. Unfortunately, it just hangs FreePIE...