XR

My thoughts on developing with Magic Leap One for a week

As many of you asked, my Magic Leap review after spending a week with it:

I genuinely love it actually.
Compared to ‘that other AR headset’ I find it more refined in most areas:

Wearing it is very comfortable as it’s so light and well balanced.

Fitting was not as delicate as I expected, you can go through a proper fitting/calibration routine but I generally don’t do this for demos.

It comes with 2 forehead pieces, 5 nose pieces, can do eye calibration and adjust the waveguide planes during calibration.
Maybe you can fit (small) glasses underneath but that’s probably not a good idea (running the risk to scratch the optics).

The increased FoV is welcome and noticeable (especially in the height) and the slightly blocked of sides actually help.

Visual quality is much increased, no more RGB separation (due to the more modern, much flatter waveguides).

Build/deploy cycles are very fast (there is no UWP overhead for example).

“Zero Iteration Mode” allows you to have a complete live Unity scene and access to the profiler in realtime. Haven’t checked if this is available for UE4 yet.

The controller is very nice, navigating the menus works much better than using hand gestures, you always feel like you’re in control.

On a tech level there are lots of welcome features:

More hand gestures and true hand/finger points.
World meshing is better and faster.
Plane detection/extraction (from the world mesh) is very fast and easy.
Raycasting using controller, head direction and eye direction is great. Using the controller feels very intuitive and more precise than just the head direction.
Eye tracking works well (even though I wear contact lenses) and opens up new doors for interaction/storytelling.
Integrated image recognition/tracking means no need for (slow) Vuforia anymore.
The increased compute and GPU power is very very welcome, feels we can actually do things now and not constantly be restricted.
Using UE4 is supported (although the samples aren’t as comprehensive as Unity).

Tracking is good but not perfect.

In comparison HoloLens has slightly better tracking but on that platform if the app falls below 60 fps (and many do due to the lack of CPU/GPU power) tracking quickly gets wobbly.

Magic Leap (the company) seems very responsive and helpful on social media and on their forums.

There are many small OS/driver updates instead of a few large ones per year (at least so far in the pre 1.0 stage).

There is actually warranty in case there is a hardware problem (should be a no-brained but some other companies refuse warranty on developer kits).

The SDK/examples are clean and good (documentation is excellent) it’s not as comprehensive as the massive MRTK community effort though.

At the moment live-streaming is still missing which is a bit tricky when doing demos (should be coming soon though).

At the moment there is no built in multi-device sharing (I hear that is coming as well and of course you can roll your own).

No carrying case, the box comes with handle, I’m using a pelican-case (well different brand, same idea).

I can litterally develop all day, with the powered USB hub it keeps it charge while connected and being used.

It’s also comfortable enough to wear for hours on end and wear it while using Unity / Visual Studio.

 

At the bottom of the line the Magic Leap One is cheaper and offers more features and mostly of higher quality for that price.

 

 

And before you ask, don’t get me wrong I still love my HoloLens 1 and hope Microsoft will soon let us know more about v2, the AR headset wars have finally begun! 🙂

Saturday, September 29th, 2018 Magic Leap, Ranting, XR No Comments

VRLA/FMX talk available online

As some of you may know my VRLA talk video footage got lost….
But thanks to someone from the excellent video crew going out of his way to track it down (in his precious spare time nonetheless!) it is now finally available! 😁

Friday, July 20th, 2018 Talks, XR No Comments

Talks in spring 2018 at FMX and VRLA

It’s official I will be speaking at

FMX: April 24 – 27 in Stuttgart, Germany
https://fmx.de

 
And
 

VRLA: May 4 – 5 in Los Angeles, United States
http://virtualrealityla.com

 
Early bird tickets are already available for both conferences at their respective websites.
 
 
Topic will be “Ahh Screw It…Let’s Use Depth Sensors and VR/AR Equipment in Production”

 

The main vibe of this talk will be inspirational by showing real world examples of using low cost hardware in 3D animation, visual effects, game production.

In the first half we'll explore the use of consumer depth sensors (like Kinect, Orbbec & RealSense).
 Topics include pointlouds (volumetric video) and motion capture.

In the second half we'll look at recording Vive/Rift tracking data and see how it compares to some higher end motion capture equipment.
 As well as how a HoloLens can be used on a highend mocap shoot to help visualize realtime 3D characters on set.

Oh and there may be some 80s & 90s animated gifs :)
Thursday, February 1st, 2018 Highend Mocap, HoloLens, Kinect, Talks, Tools, XR 2 Comments

Collaborative VR experiment with multiple Valve/HTC Vive headsets

Recently we had the opportunity to play with two Valve/HTC Vive headsets and controllers so we opted to experiment a bit for a few days.

Since I strongly believe the Virtual Reality revolution needs a social element in order to become more than just a hype of we implemented the following things to play with:
– multi user collaborative experience
– interaction with virtual objects using Vive’s hand controllers
– implemented using two (networked) machines running Unity
– build it so it works when users share the same physical space (like in this example)
– but also works when users are in different places with access to a (5 Mbps) internet connection

R&D project by:
Jasper Brekelmans……..brekel.com………(pointcloud streaming & Unity integration)
Jeroen de Mooij………….thefirstfloor.nl….(Unity networking & scene design)

Thanks to:
Adriaan Rijkens…….VRheroes.nl
Marald Bes…………AnyMotion.nl
Erwin Kho…………..Zerbamine.nl

 

Tuesday, January 12th, 2016 Ranting, XR 2 Comments