The Kinect distance sensor as human-machine-interface in audio-visual art projects

excerpt of project thesis

excerpt of project thesis

I finished my project thesis including general information about the Microsoft Kinect sensor device as well as a detailed documentation about it’s application in combination with Pure Data and Gem.

This document might be useful for people working with the Kinect in combination with interactive sound and video installations and performances.

Get the PDF document here!

übersetzen – vertimas | piece for dancer, sound and projection

Greta Grinevičiūtė - dance

For the JAUNA MUZIKA[ref name=”jm”]JAUNA MUZIKA 2012[/ref] 2012 Festival in Vilnius – Lithuania, I’m preparing the piece Übersetzen – vertimas for dancer, sound and projection.

Sunday, April 15th, 2012 – 16.00
LMTA Chamber Hall, Building 2 – Tilto str. 16, Vilnius

Greta Grinevičiūtė – dance
Aira Naginevičiūtė – choreography
Matthias Kronlachner – technology, sound

Continue reading

Live Interfaces

I’ll be presenting my work for the Kinect sensor and Pure Data/Gem at the LIVE INTERFACES: Performance, Art, Music[ref name=”li”]Live Interfaces http://icsrim.org.uk/liveinterfaces/[/ref] conference.

Find the material here:
lipam2012-kronlachner-paper.pdf
lipam2012-kronlachner-poster.pdf

A substantial project report about all Kinect plugins and examples will be available soon.

pd-external: pix_freenect 0.10

(C)2011 Matthias Kronlachner

Version 0.10 of pix_freenect external for Pure Data/Gem now available.
Sourcecode and binary for OSX and Ubuntu 11.10 available at github: https://github.com/kronihias/pix_freenect

Look at this page if you don’t know how to install a Pd-External.

The pix_freenect external can output rgb and depth simultaneously from multiple Kinect sensors.

Features:

  • open specific Kinect sensor by serial number – useful for multiple Kinect installations
  • output registered depthmap -> rgb and depth image are aligned
  • output depthmap directly as 16 bit [mm] values
  • resolution of rgb image can be set to 1280×1024

To get audio streams you can use http://github.com/kronihias/freenect_audio.
Continue reading

Pure Data Workshop – Vilnius, Lithuania

A Pure Data workshop series will be held on Wednesdays starting from September, 26th 2012 at 18:00-19:30.

Location: Lithuanian Academy of Music and Theatre (LMTA), LMTA main building, Gedimino pr. 42, LT-01110 Vilnius, room 306

The course is open for everyone interested and will start from zero. It will cover topics relevant for sound artists, visual artists, composers, engineers, …

Please register per email:  mail (at) matthiaskronlachner.com .

What is Pure Data (Pd)?
Pure Data is a very flexible visual programming environment, developed by Miller Puckette for creating electronic music. It is available for free and many people contribute in extending it’s functionality. Today it is widely used for creating sound, visuals, data, multimedia installations, music composition, signal processing and analysis, … It can be seen as Open-Source alternative to MAX/MSP.
Due to its visual programming nature its usage is very intuitive.
Continue reading

Kinect Headtracking with OSC Support

left: GEM Window, right: head pose estimation by G.Fanellibased on
Real Time Head Pose Estimation from Consumer Depth Cameras by Gabriele Fanelli [ref name=”fanelli”]http://www.vision.ee.ethz.ch/~gfanelli/head_pose/head_forest.html[/ref]

======================================
download source and windows/OSX binaries: https://github.com/kronihias/head-pose-estimation

Application that detects head position from a depth image provided by Microsoft Xbox Kinect Sensor in x,y,z and Euler Angles (pitch, yaw, roll) from multiple persons.

–> needs no calibration!!

Application sends data as OSC[ref name=”osc”]Open Sound Control (OSC) is a message based communication protocol for multimedia systems.[/ref] Message in the format:

/head_pose [User_ID] [x] [y] [z] [pitch] [yaw] [roll]
Continue reading