Episode 172 – Shining a light on AR

Michael and Michael are back — and take a long careful look at the newest capabilities that Apple is bringing to light in augmented reality with the new iOS 11 operating system.  Michael R has already downloaded the development framework, and has started bringing into mixed reality the digital test objects, to great effect.  The pictures included in this post are from Michael R’s experiments with the framework thus far, and it is quite amazing to see the fidelity of the objects, as well as the recognition by the software of the planes, shadows & angles of placement.  There much to be very excited about here, and once the digital augmented reality experience is not through the screen of an iPhone, but in a more natural way (dare I even bring up the possibility of contact lenses again?) — then, then we are really onto something.  Until that point, this version of augmented reality is an interesting step in the right direction, but the consumption cannot be via holding a phone at arm’s length or wearing a ski goggle-esque contraption that distances the person from the reality they are looking to more deeply engage with.

Robots are not just for vacuuming your floor — they are also quite useful for teaching ballroom dancing, and in determining the skill level of the human student, the artificial intelligence can quickly adapt the lessons to be challenging for whatever level the student is at.  And speaking of  AI, the recent Microsoft acquisition Maluuba has crushed Ms. Pac-Man using a new method called Hybrid Reward Architecture to more effectively manage the very difficult problem of balancing the multiple rewards (and threats) in a game like Ms. Pac-Man to achieve the maximum score.

Staying on the Microsoft theme a moment longer, the team discuss Minecraft as a platform, his where multiple operating systems and devices are now converging on a common Minecraft environment.

Binky has loomed large in the news this past week — what started as a joke has turned into something more.  In this app, you can experience all the joy of social media likes & shares but not have anyone ever see your posts.  Michael M is reminded of Ian Bogost’s Cow Clicker social media game.

Selected links 

Apple ARkit — https://developer.apple.com/arkit/

Apple ARkit WWDC video — https://developer.apple.com/videos/play/wwdc2017/602/ 

Ballroom dancing robot — https://twitter.com/qz/status/874061192196534272

Ms PacMan — http://time.com/4819067/microsoft-pac-man-maluuba/

Maluuba — http://www.maluuba.com

Hybrid Reward Architecture for Reinforcement Learning — https://arxiv.org/pdf/1706.04208.pdf

Minecraft — http://www.businessinsider.com/minecraft-unites-all-platforms-2017-6

Binky — https://techcrunch.com/2017/06/10/binky/

Cow Clicker — https://cowclicker.com

BikeSphere — http://bgr.com/2017/06/14/bikesphere-michelin-safety/

Play