Modbox on MagicLeap

Earlier this year Modbox was accepted into MagicLeap’s Independent Creator Program – which came a development grant and 2 headsets.

First test after a few days of development:

Video starts with room scanning to get a mesh of the environment – then some basic tool use. The in-headset experience of the MagicLeap is significantly better than it’s recording quality (something I wish they focused on more).

Moving to the MagicLeap SDK was very straight forward – we’ve been working on a AR version for a while using the ZedMini, and their desktop simulator tools are fantastic (in a lot ways better than anything available for testing VR on desktop).

In the above video I am using two controllers since at that point Modbox required it – currently MagicLeap headsets only come with 1 controller in the box. So making the Modbox UI work with 1 controller was the hardest part of porting:

Since most players would only use 1 controller on MagicLeap I decided to use hand tracking for the other hand. I can only reliably detect the ‘grasp’ gesture, so it’s just used for grabbing stuff in play mode (like using a bow and arrow, sling shot, or picking stuff up).

Latest video showing multiplayer between the MagicLeap version and PC VR: