Episode 175 – Killing the iPhone

Augmented reality and self-driving automobiles.  Two great topics that really get Michael and Michael’s engines revving!  Staring off with the Mashable articles, one of which inspired the episode name with it’s similar name, the pair talk about ways for holographic projection can be used for augmented reality without glasses.  The first example is the Hydrogen phone by the high end video camera manufacturer Red, which projects the holographic image up from the phone.  A second example from the Future Interfaces Group at Carnegie Mellon University is an augmented reality projector that fits into a lightbulb socket and projects down from the ceiling onto a desktop, and sensors connected to the projector allow the user to manipulate the user interface, dock user interfaces onto real objects like computers and books, resize them and much more.  The video above shows what they have accomplished — pretty amazing.  The namesake for this episode deals with more of the glasses-driven approach for how the next generation of augmented reality could replace the iPhone, and while this is plausible, the article does point out that the referenced patent indicates a reliance on a computer (read as a phone) that the glasses connect to.

The automotive section of this episode deals with self driving vehicles, such a the Dutch startup Amber — whose business model focuses on mobility as a service, where transportation is ready for you when you need it to be because of the predictive analytic models and the self driving vehicles optimizing traffic patterns to have a vehicle near you when you need it.  Continuing on the machine learning of fleets of self driving vehicles, the pair discuss an NPR article that focuses Alphabet’s Waymo used a fleet of Googlers driving around on their bicycles to create a model to predict how unpredictable bicyclists behave and better avoid accidents.

Things are about to get amazing.

Selected links 

Mashable article:  The world’s first glasses-free holographic phone is coming, and it’s not from Apple —   http://mashable.com/2017/07/06/red-hydrogen-holographic-phone

Red Hydrogen Phone — http://www.red.com/hydrogen

BGR article: This augmented reality projector just needs a lightbulb socket — http://bgr.com/2017/07/12/augmented-reality-projector/

BGR article: This is how Apple might ‘kill’ the iPhone — http://bgr.com/2017/07/27/iphone-ar-glasses-apple/

Venture Beat article: Amber: The Dutch self-driving startup that could beat Uber, Tesla, and Google to mass market — https://venturebeat.com/2017/07/09/amber-the-dutch-self-driving-startup-that-could-beat-uber-tesla-and-google-to-mass-market/

Amber — https://www.ambermobility.com

Mashable article: BMW and other carmakers team up to take on Waze and Google Maps —  http://mashable.com/2017/07/26/here-connected-car-real-time-traffic-service

NPR article: Bikes May Have To Talk To Self-Driving Cars For Safety’s Sake — http://www.npr.org/sections/alltechconsidered/2017/07/24/537746346/bikes-may-have-to-talk-to-self-driving-cars-for-safetys-sake

Way — https://waymo.com

What are the co-hosts playing these days?

Michael R — Futurama game — https://itunes.apple.com/us/app/futurama-worlds-of-tomorrow/id1207472130?mt=8

Michael M — Neko Atsume — https://en.wikipedia.org/wiki/Neko_Atsume

Play

Episode 172 – Shining a light on AR

Michael and Michael are back — and take a long careful look at the newest capabilities that Apple is bringing to light in augmented reality with the new iOS 11 operating system.  Michael R has already downloaded the development framework, and has started bringing into mixed reality the digital test objects, to great effect.  The pictures included in this post are from Michael R’s experiments with the framework thus far, and it is quite amazing to see the fidelity of the objects, as well as the recognition by the software of the planes, shadows & angles of placement.  There much to be very excited about here, and once the digital augmented reality experience is not through the screen of an iPhone, but in a more natural way (dare I even bring up the possibility of contact lenses again?) — then, then we are really onto something.  Until that point, this version of augmented reality is an interesting step in the right direction, but the consumption cannot be via holding a phone at arm’s length or wearing a ski goggle-esque contraption that distances the person from the reality they are looking to more deeply engage with.

Robots are not just for vacuuming your floor — they are also quite useful for teaching ballroom dancing, and in determining the skill level of the human student, the artificial intelligence can quickly adapt the lessons to be challenging for whatever level the student is at.  And speaking of  AI, the recent Microsoft acquisition Maluuba has crushed Ms. Pac-Man using a new method called Hybrid Reward Architecture to more effectively manage the very difficult problem of balancing the multiple rewards (and threats) in a game like Ms. Pac-Man to achieve the maximum score.

Staying on the Microsoft theme a moment longer, the team discuss Minecraft as a platform, his where multiple operating systems and devices are now converging on a common Minecraft environment.

Binky has loomed large in the news this past week — what started as a joke has turned into something more.  In this app, you can experience all the joy of social media likes & shares but not have anyone ever see your posts.  Michael M is reminded of Ian Bogost’s Cow Clicker social media game.

Selected links 

Apple ARkit — https://developer.apple.com/arkit/

Apple ARkit WWDC video — https://developer.apple.com/videos/play/wwdc2017/602/ 

Ballroom dancing robot — https://twitter.com/qz/status/874061192196534272

Ms PacMan — http://time.com/4819067/microsoft-pac-man-maluuba/

Maluuba — http://www.maluuba.com

Hybrid Reward Architecture for Reinforcement Learning — https://arxiv.org/pdf/1706.04208.pdf

Minecraft — http://www.businessinsider.com/minecraft-unites-all-platforms-2017-6

Binky — https://techcrunch.com/2017/06/10/binky/

Cow Clicker — https://cowclicker.com

BikeSphere — http://bgr.com/2017/06/14/bikesphere-michelin-safety/

Play

Episode 170 – Holographic Whiteboard Penguins

 

Michael and Michael kick off this episode with holographic dragons demoed by the folks at Microsoft Research.  Beside the amazing ability to project monoscopic holograms within the frame of a normal set of eyeglasses, another really exciting aspect of this innovation is the ability to use the processor to correct for astigmatism or other eyesight issues.

Moving from one collaborative display means to another, Michael & Michael talk about Google’s recently announced Jamboard and Michael R shares his experiences with the Ricoh interactive whiteboards.  Mural is another example of a collaboration solution that allows for multiple people to interact on the same board together, and this spurred a discussion on other ways to accomplish in software what the Google & Ricoh hardware  can do.

Michael & Michael both joined Pinguin to see what they could learn about this new chat system, and naturally, after the article said that the #podcasts room was empty, that was precisely the first place they went.  It wasn’t empty by the time they got there, and Michael M used the opportunity to do some marketing for this podcast.

The CNN Money article about John Oliver’s efforts to encourage his viewers to comment on the FCC proceeding 17-108 Restoring Internet Freedom caught the team’s attention, and highlighted how such requests for public comment can be spammed — FCC McFCCFace anyone?   And how in a strange circular logic, evidence that someone had loaded voter addresses and spammed the public comments with messages in favor of the new FCC regulations could be used to undermine the validity of nearly 3m public comments (at the time of this posting).

Michael and Michael close out this episode by imagining what video games could be created using the plot lines of movies.  While neither Michael is a big horror movie fan, they did come up with some interesting ideas.

Selected links 

Engadget article: Microsoft’s true holographic display fits in your glasses — https://www.engadget.com/2017/05/20/microsoft-holographic-display-in-glasses/

Google’s Jamboard — https://gsuite.google.com/products/jamboard/

Ricoh’s interactive whiteboards — https://www.ricoh-usa.com/en/products/pl/equipment-interactive-whiteboards/_/N-1w

Mural — http://mural.ly

TechCrunch article:  Pinguin is a public chat room for nerd(ier) people — https://techcrunch.com/2017/05/10/pinguin-is-a-public-chat-room-for-nerdier-people

CNN Money article:  John Oliver tackles net neutrality again, encourages viewers to ‘go FCC yourself’ — http://money.cnn.com/2017/05/08/media/john-oliver-net-neutrality/index.html

Go FCC Yourself — www.gofccyourself.com

Slashfilm article: Hack ’n Slash: 20 Horror Movies That Should Be Video Games — http://www.slashfilm.com/horror-movies-that-should-be-video-games/

Play

Episode 164 – Addictive AR

 

 

 

Michael and Michael start this episode off with an excellent roundup of how technology gets that dopamine drip going with an article from The Guardian that focuses on the newly published book by Adam Alter, Irresistible.  Starting with the psychological and cultural affinity with liking content, and proceeding quickly to the linkages between gambling and games, the article walks the path to augmented reality and virtual reality — what makes an experience repeatable and desirable to come back to again and again.

Turning their attention to augmented reality, Michael and Michael imagine the the future of not only designing 3D spaces with the Microsoft Hololens, but also how the perspective of the user of such technology is afforded the chance to see directly what could not be physically possible.  Not everyone can have a front row seat in the operating (or other) theater, but with AR & VR you can — and this begins to open up whole new worlds of possibility.

Michael M shares his experience from an Uber ride in New York this past week, where the car was outfitted with a Mobileye device that watches for speed limits, distance between the driver’s car and those ahead, as well as lane departure warnings.  This aftermarket option provides visual and audio alerts to the driver, and sparked a conversation on the nature of event data recording in automotive black boxes.

The team rounded out the episode with the Sony Xperia Touch Projector, which turns any surface into an interactive environment, prompting Michael R to break out his Magic Cube virtual laser keyboard.  Only a matter of time before the sharks with lasers appear…

selected links 

The Guardian article:  How Technology Gets Us Hooked — https://www.theguardian.com/technology/2017/feb/28/how-technology-gets-us-hooked

Irresistible by Adam Alter — http://adamalterauthor.com/irresistible/

Mashable article:  Why I Flooded Instagram With Likes — http://mashable.com/2014/02/14/lovematically-instagram/

Microsoft Devices Blog:  Stryker chooses Microsoft Hololens to bring operating room design into the future with 3D — https://blogs.windows.com/devices/?p=259304?ocid=newsletter_ema_omc_hol_Stryker

Techcrunch article:  Mobileye outfits 4,500 for-hire cars in NYC with collision avoidance tech — https://techcrunch.com/2017/02/17/mobileye-outfits-4500-for-hire-cars-in-nyc-with-collision-avoidance-tech/
Mobileye features YouTube — https://www.youtube.com/watch?v=HXpiyLUEOOY

Event data recorder — https://en.wikipedia.org/wiki/Event_data_recorder

A Car’s Black Box — http://www.consumerreports.org/cro/magazine/2014/09/how-your-car-is-tracking-you/index.htm

Wired article:  Sony’s Xperia XZ Premium screen is so high-quality it’s better than most people’s TVs  — https://techcrunch.com/2017/02/17/mobileye-outfits-4500-for-hire-cars-in-nyc-with-collision-avoidance-tech/

Magic Cube virtual laser keyboard — http://www.virtual-laser-devices.com/Magic%20Cube_Final.pdf

Play

Episode 161 – Virtual Audio Reality

We will control the horizontal. We will control the vertical. — intro from the 1960s US television show, The Outer Limits

We will control the audio. After many episodes discussing virtual reality and augmented reality, Michael and Michael place their focus for this show on the auditory. Not just 3D sound, but positional sound — location based sound. Sound that makes you look.

The binaural sound demo from the BBC starts off the conversation (be sure to have your headphones or earbuds at the ready for this), demonstrating how audio engineers crafted a head that looks like a villager from Minecraft to contain two microphones embedded in replica ears so as to capture sound in audio stereoscopicy, to combine with visual input from virtual or augmented reality to draw the person really into the experience.

Even on it’s own, the virtual barbershop example, which is completely devoid of video gives a compelling and immersive experience of being in a barbershop for a hair cut, down to the snip-snip of the scissors above your ears.

A little pre-show research turned up several auditory games, the first discovered via a link to the AppleVis podcast team’s review of Ear Monsters. Vanished and Blindside are a couple other examples of auditory games.

This fascinating conversation led, naturally, to music, and groups such as Yes, The Who, Art of Noise and more came into auditory focus. Give us a listen — check out the links — make your ears happy. Ours sure are!

Show Links
Binaural Sound demo from BBC — https://www.youtube.com/watch?v=51za5u3LtEc&feature=youtu.be
Virtual Barber Shop — https://www.youtube.com/watch?v=IUDTlvagjJA

AppleVis review of Ear Monsters — http://www.applevis.com/apps/ios/games/ear-monsters-3d-audio-game
Ear Games (makers of Ear Monsters) — http://www.eargames.com/
Vanished audio only game — https://www.engadget.com/2013/09/29/audio-only-horror-game-vanished-out-now-on-ios/

Blindside audio game — http://blindsidegame.com/

Leave It by Yes — https://itunes.apple.com/us/album/90125-deluxe-edition/id1082025269 Apple, or https://play.google.com/store/music/album?id=Bdrje6xvsqlxg53zycriukmkcwm&tid=song-Twhiy3dtg2ka23jfcujfteke24e&hl=en Google
Leave it by Yes music video — https://www.youtube.com/watch?v=8-hJFoSgXfM
Yes’ 90125 album — https://en.wikipedia.org/wiki/90125
Tevor Horn — https://en.wikipedia.org/wiki/Trevor_Horn

SCTV’s 3-D House of Beef — https://www.youtube.com/watch?v=iEnCKEfSgUM

Baba O’Reilly by The Who — https://www.youtube.com/watch?v=8c1hYO_BYHY

Play

Episode 160 – 3D OBD


src = obdii.com

Car? Whar? Over thar!

Michael & Michael get together to talk about one of the original examples of augmented reality, the Head Up Display (HUD) for cars, and explore the example of the Hudway Glass, an ingeniously simple Kickstarter product that allows a user to place their phone on the dash and have the phone’s display reflected back to the driver. Michael R remembers an app with this kind of capability from way back when called V-Cockpit.

Keeping with the pretty clever car theme, the pair then move to the innovation that Ford is bringing to the market for Ford and Lincoln cars: an OBD II module that plugs into your Ford car, and because of the software in your car and this additional module, you can remote start your car, download your car’s performance data, even use the 4G LTE modem as a wireless hotspot to connect your WiFi devices in the car. Michael R noted that while the OBD II port has been a standard part of every car since 1996, each manufacturer has their own proprietary software so a universal version to provide all the connected car capabilities is not highly likely. Even so, Michael R has the OBDLink MX tool for translating error codes and warning lights, along with engine diagnostics. Enabling connected car data sharing opens up more possibilities, and the insurance marketplace is one of them, as evidenced by Progressive Insurance’s Snapshot offering.

Wrapping up this short show, Michael and Michael agree that 3D TV is not the wave of the future anymore, and the article points toward the idea of VR and TV merging at some time. While certainly possible, we’ve seen other examples of holographic TV, and from Neal Stephenson’s novels, concepts of immersive storytelling where people become the actors themselves.

selected links
Hudway Glass — https://hudwayglass.com

V-Cockpit GPS app — https://itunes.apple.com/us/app/v-cockpit-gps/id303482803?mt=8

Haptic Socks – https://tampub.uta.fi/handle/10024/97672

TechCrunch article: Ford’s new SmartLink OBD accessory adds connected features to other cars — https://techcrunch.com/2017/01/26/fords-new-smartlink-odb-accessory-adds-connected-features-to-older-cars/

OBDLink MX — https://www.amazon.com/ScanTool-OBDLink-MX-Wi-Fi-Diagnostic/dp/B00OCYXTYY/ref=sr_1_22?ie=UTF8&qid=1485538594&sr=8-22&keywords=obd+ii+wifi

Progressive Insurance Snapshot — https://www.progressive.com/auto/snapshot/

Postscapes roundup of connected car enablement devices — http://www.postscapes.com/connected-car-devices/

TechCrunch article: 3D TVs are Dead — https://techcrunch.com/2017/01/25/3d-tvs-are-dead/

Neal Stephenson’s Cyberpunk novel “the Diamond Age” on the concept of “ractors” – people who play roles in a virtual reality experience — https://en.wikipedia.org/wiki/The_Diamond_Age

Play

Episode 159 – Virtually Secure

Michael R and Michael M, go deep on virtual assistants and the security storm around WhatsApp in the news recently. We also look at how an old virtual world shopping experience may be coming to life in virtual reality.

The duo start with the Facebook/Oculus tour of the White House and think about whether movies and television shows have the layout and rooms of the building right.  Michael and Michael quickly then turn to Amazon’s focus on virtual reality shopping experiences stemming from articles from TechCrunch and Variety.  Michael R shares his experiences in developing just this kind of experience for Sears 10 years ago.

Then things get even more interesting with holographic personifications of artificial intelligences — where the Gatebox anime character looms large — or rather hovers in a coffee machine style enclosure, and interacts with the user via voice and text chat.   While speech commands are picking up steam, it is still has a social hurdle to climb.  It is embarrassing or just feels weird to talk to inanimate objects, even though the author of the Digital Trends article makes the valid connection that talking to devices is like talking to a pet, and pets do sometimes listen…

The show wraps up with an interesting discussion on the security news related to WhatsApp.  We hope you enjoy!

Show Links:
Virtual White House – http://www.usatoday.com/story/tech/columnist/baig/2017/01/13/obamas-lead-white-house-tour-virtually-help-oculus/96532192/
The West Wing http://www.imdb.com/title/tt0200276/

Amazon possibly working on VR Shopping Experience https://techcrunch.com/2017/01/19/amazon-job-posting-suggests-plans-to-bring-shopping-experiences-into-vr/
Google Daydream View https://store.google.com/product/daydream_view
Oculus Rift https://www.oculus.com
Samsung Gear VR http://www.samsung.com/global/galaxy/gear-vr/
Bridge AR/VR headset https://bridge.occipital.com
Sears VR Shopping Experience – now 10 years old https://www.youtube.com/watch?v=0ABxTr8sL3U&feature=youtu.be

Variety article — Amazon VR Shopping app http://variety.com/2017/digital/news/amazon-vr-shopping-app-1201962695/

AI Assistants are like Pets http://www.digitaltrends.com/mobile/talk-to-ai-assistants-like-your-pets/
Gatebox Home AR Powered Holographic Robot http://arstechnica.com/information-technology/2016/12/the-anime-girlfriend-experience-gateboxs-ai-powered-holographic-home-robot/
Gatebox story http://gatebox.ai/story/
Gatebox https://gateboxlab.stores.jp/items/57ea607100d331404d002d77

Twitch See Bots Chat https://www.twitch.tv/seebotschat

Security Researchers call for Guardian to retract false WhatsApp backdoor story https://techcrunch.com/2017/01/20/security-researchers-call-for-guardian-to-retract-false-whatsapp-backdoor-story/?ncid=rss
SecurityNow! Transcript Episode 595 -What’s up with WhatsApp? https://www.grc.com/sn/sn-595.txt

Play

Episode 158 – 2017 Kickoff

We kick off 2017 with a short show.  Michael M. and Phaedra discuss an augmented reality app launched in conjunction with the recently released movie “Hidden Figures”, review Smart Canes and have a lively discussion about the challenges surrounding video capture and the importance of thorough testing from the Kotaku article — a good reminder for everyone involved in technology development.

The augmented reality app (App StoreGoogle Play) has the user go to specific geographic locations, such as on the University of North Carolina campus to unlock content related to the stories and accomplishments of STEM leaders.  Michael gave this a try, and the picture above shows the statue of Katherine Johnson superimposed on the phone screen in front of the Bell Tower at UNC.

Show Links:
Hidden Figures – http://www.imdb.com/title/tt4846340/
AR and Hidden Figures – http://wraltechwire.com/-hidden-figures-ibm-augmented-reality-project-links-in-3-triangle-universities-/16402395/
Smart Canes and Wheelchairs – https://techcrunch.com/2017/01/05/smart-canes-and-wheelchairs-among-tech-empowering-the-disabled-at-ces/
Racist Video Game – http://www.kotaku.co.uk/2017/01/12/how-we-accidentally-made-a-racist-videogame

Play

Episode 155 – Holiday Potluck


Gearing up for the festive season, Michael and Michael serve up a veritable smorgasbord of holiday potluck delights.

Starting with well, um, leftovers from last week, Fitbit has indeed acquired the technology, software assets and intellectual property of Pebble and many of the people from Pebble will be joining Fitbit to continue their work on wearable technology. This brings up an interesting point on the nature of cloud services and the integration with physical devices — that one without the other does not work, as products and services are becoming more and more intertwined.

Moving on to appetizers, Cortana now has more capabilities in Windows 10 that allow for someone to issue a voice command to shut down the system — not just the system owner — and Pantone has announced the color of the year for 2017, a fresh vibrant green called Greenery (15-0343 TCX), expressing hope and optimism to rejuvenate, revitalize and unite.

Stopping at the main dish area, where we find all the news that’s fit to virtually experience — Michael and Michael explore how virtual reality can help the ‘reader’ become more immersed in a news story, by virtually being there and interacting. BMW is using augmented reality with their Visor for BMW Mottorad concept vehicle. And finally, how the Occipital Bridge has been just announced with the blended / mixed reality experience allowing for an iPhone 6, 6s or 7 to be coupled with a camera and Occipital’s software to provide a full virtual reality experience that you have to see to believe. And you can get one now, if you act fast!

Rounding out with dessert, Michael R shares the 3D printing test he’s done of a dragon’s head door knocker. This is something amazing — can’t wait to see the full size print!

selected links

MacRumors article: Fitbit acquisition of Pebble — http://www.macrumors.com/2016/12/08/pebble-fitbit-buyout-customer-refunds/

BGR article: New voice commands for Cortana — http://bgr.com/2016/12/08/cortana-shut-down-microsoft-windows-10/

iEEE article — VR immersion for news stories — http://theinstitute.ieee.org/technology-topics/consumer-electronics/virtual-reality-can-immerse-people-in-news-stories-and-prepare-them-for-natural-disasters

Switchpoint 2016 conference in Saxapahaw, NC — https://event.switchpointideas.com/2016

Games at Work e134 with discussion on Switchpoint — http://gamesatwork.biz/2016/03/20/episode-134-swords-and-virtual-realities/

New York Times Virtual Reality viewer — http://www.nytimes.com/marketing/nytvr/index.html

Mashable article: BMW Mottorad Concept motorcycle with augmented reality Visor — http://mashable.com/2016/10/12/bmw-motorrad/#aXY19b9M_iqz

Occipital Bridge mixed reality viewer — https://bridge.occipital.com

Play

Episode 153 – Chicken and Mushrooms

solarroof
Michael and Michael get together to cook up an episode chock-full-o tasty post Thanksgiving treats — starting off with the promise of solar, with the example of the American Samoa island of Ta’u and the new solar roof tiles made available from the Tesla/SolarCity team. The Google Project Sunroof site is still up & running, so you can check your own roof to see how suitable it may be for solar.

Alexa has teamed up with Allrecepies to help out in the kitchen, providing step by step guidance on how to cook delicious dishes. The video shows an example of how Alexa can use the Allrecepies API to suggest what can be done with a set of ingredients in the fridge. While we won’t spoil the surprise, the answer has something to do with chicken and mushrooms.

A news report from Marketplace highlighted the work done by Alibaba to create virtual reality shopping experiences for Chinese consumers in stores like Macy’s and Target. This reminded Michael and Michael of the work they had done years ago, and discussed most recently in episode 148 (http://gamesatwork.biz/2016/10/02/episode-148-painting-with-digital-and-physical-ink/). Michael R’s video on his work on the virtual Sears store is in the show notes below. One of the pair’s patents outlines how a virtual store could be created dynamically based on the shopper’s preferences.

Rounding out the show with a little Star Trek goodness, are the Propel Star Wars Battle Quads, and an IFTTT mashup using the Force Band by Sphereo. We are in for a very happy holiday season.

Drop us a line with your ideas and thoughts about digital convergence on Twitter or Facebook!

show links
SolarCity Roof
Google Project Sunroof
Island of Ta’u goes 100% solar

Alexa, what can I make with chicken & mushrooms?
Allrecepies

mobile & enterprise are keys to VR & AR scale

VR shopping

MyVirtual Model
Tag Along Shopping Patent
Sears Second Life Walkthrough

Star Wars laser battle quadcopters
Use the force… to make coffee

Play