MusiKraken
MusiKraken
MIDI Controller Construction Kit
Ghost Organ

The Ghost Organ module allows you to play a touchless, keyboard-like MIDI controller in the air.

It is based on tracking your hands in front of the camera. The Ghost Organ uses the 2D image of the camera to check if one of the finger tips is close enough to your wrist, and if it is, it will play the note assigned to that finger.

Because it uses the 2D image, instead of moving your fingers downwards, you need to bend the finger so that the finger tip points towards your wrist. Once the finger tip is moved downwards enough, it will trigger the note, and when it moves up again, the note is stopped. You can change the sensitivity of how much you need to move your finger tip in the settings.

In the settings, you can select the octave and the scale that should be assigned to the fingers of your hands. Once you hold your hands in front of the camera, it will automatically assign the notes of the scale to the fingers, depending on how many hands it sees (1 or 2), and which hand is on which side of the other one.

The Ghost Organ also supports MPE and MIDI 2.0 per-note events via its pressure port. The pressure value depends on how much you move your finger "downwards" (= downwards relative to the camera image and the rotation of your hand). This way you can control multiple pressure (MPE or MIDI 2.0 per-note values) simultaneously, per finger.