Episode 178 – L33T Learning Siri

 

Just say no to enabling autonomous bots & drones with the ability to apply lethal force.  Following on last week’s episode 177, Michael & Michael start off with a continuation of the discussion on the Pandora’s Box of armed robots.

Moving on to a happier topic, while still staying on the machine learning concept, the pair talks about how Siri and other voice interactive systems have been improved with deep learning.  Not just recorded scripts, but actual intelligence, and more natural interaction is apparent when you listen to how far things have come since the earliest days of Siri — listen to the examples from the Apple Machine Learning Journal article, and we think you’ll agree.

Understanding that you’re talking with a bot vs a human is important to help avoid the uncanny valley where the interaction becomes weird vs expected — perhaps this is why Michael R preferred the Australian accent reminiscent of J.A.R.V.I.S, and how in Star Trek and other science fiction, interaction with the computer was prefaced with “computer!” before issuing a request.

Feedback loops getting faster & faster, which is really evident in machine learning examples applied to games.  When the machine — the program — is experimenting with the game to learn, and figure out what is rewarded, what is not rewarded, and determine a heuristic model for playing the game, which for a human is for fun and for the machine learning example is to maximize the outcome.  The example from the O’Reilly article was particularly intriguing to Michael M who wondered why the AI playing the game did not scoop up each and every present while playing the game.  Michael R made the interesting point that if the machine learning algorithms assume that there’s an infinite number of presents ahead, it makes more sense to quickly move forward and grab the presents because there are more ahead of you than behind.  The screenshot above is from a machine learning model playing Super Mario Kart, where it is easy to see how machine learning quickly gets better and better with successive plays of the game.

Closing out this episode, Michael and Michael include David Ma’s videos of food imagined in the style of  famous directors, a funny song about waffles and a discussion on Zork.  Hope you enjoy these tasty treats!

Selected links 

last week’s show, E177 — What could possibly go wrong? — http://gamesatwork.biz/2017/08/31/episode-177-what-could-possibly-go-wrong/

An open letter to the United Nations Convention on Certain Conventional Weapons — https://futureoflife.org/autonomous-weapons-open-letter-2017

We don’t have long to act — https://qz.com/1058280/we-do-not-have-long-to-act-teslas-tsla-elon-musk-and-others-warn-the-un-about-autonomous-weapons

Six Colors article:  Deep Learning Improves Siri’s voice — https://sixcolors.com/link/2017/08/deep-learning-improves-siris-voice/

Apple’s Machine Learning Journal:  Deep Learning for Siri’s Voice: On-device Deep Mixture Density Networks for Hybrid Unit Selection Synthesis — https://machinelearning.apple.com/2017/08/06/siri-voices.html

Uncanny Valley — https://en.wikipedia.org/wiki/Uncanny_valley

J.A.R.V.I.S. — https://en.wikipedia.org/wiki/Edwin_Jarvis#J.A.R.V.I.S.

O’Reilly article:  Bringing gaming to life with AI and deep learning — https://www.oreilly.com/ideas/bringing-gaming-to-life-with-ai-and-deep-learning

YouTube:  Super MarI/O Kart Commentary — https://www.youtube.com/watch?v=S9Y_I9vY8Qw

Food by Favorite Directors (Sort Of) — https://www.subtraction.com/2017/08/14/food-by-famous-directors-sort-of/

YouTube:  What if Alfonso Cuaron made pancakes?  — https://www.youtube.com/watch?v=6_hpJHNt4IE

Do You Like Waffles?  By Parry Gripp — https://itunes.apple.com/us/album/do-you-like-waffles/id468568946?i=468568983

MIT Technology Review — The Enduring Legacy of Zork — https://www.technologyreview.com/s/608670/the-enduring-legacy-of-zork/

MIT Technology Review article:  Siri for Business — https://www.technologyreview.com/s/600990/siri-for-business/

Play

Episode 155 – Holiday Potluck


Gearing up for the festive season, Michael and Michael serve up a veritable smorgasbord of holiday potluck delights.

Starting with well, um, leftovers from last week, Fitbit has indeed acquired the technology, software assets and intellectual property of Pebble and many of the people from Pebble will be joining Fitbit to continue their work on wearable technology. This brings up an interesting point on the nature of cloud services and the integration with physical devices — that one without the other does not work, as products and services are becoming more and more intertwined.

Moving on to appetizers, Cortana now has more capabilities in Windows 10 that allow for someone to issue a voice command to shut down the system — not just the system owner — and Pantone has announced the color of the year for 2017, a fresh vibrant green called Greenery (15-0343 TCX), expressing hope and optimism to rejuvenate, revitalize and unite.

Stopping at the main dish area, where we find all the news that’s fit to virtually experience — Michael and Michael explore how virtual reality can help the ‘reader’ become more immersed in a news story, by virtually being there and interacting. BMW is using augmented reality with their Visor for BMW Mottorad concept vehicle. And finally, how the Occipital Bridge has been just announced with the blended / mixed reality experience allowing for an iPhone 6, 6s or 7 to be coupled with a camera and Occipital’s software to provide a full virtual reality experience that you have to see to believe. And you can get one now, if you act fast!

Rounding out with dessert, Michael R shares the 3D printing test he’s done of a dragon’s head door knocker. This is something amazing — can’t wait to see the full size print!

selected links

MacRumors article: Fitbit acquisition of Pebble — http://www.macrumors.com/2016/12/08/pebble-fitbit-buyout-customer-refunds/

BGR article: New voice commands for Cortana — http://bgr.com/2016/12/08/cortana-shut-down-microsoft-windows-10/

iEEE article — VR immersion for news stories — http://theinstitute.ieee.org/technology-topics/consumer-electronics/virtual-reality-can-immerse-people-in-news-stories-and-prepare-them-for-natural-disasters

Switchpoint 2016 conference in Saxapahaw, NC — https://event.switchpointideas.com/2016

Games at Work e134 with discussion on Switchpoint — http://gamesatwork.biz/2016/03/20/episode-134-swords-and-virtual-realities/

New York Times Virtual Reality viewer — http://www.nytimes.com/marketing/nytvr/index.html

Mashable article: BMW Mottorad Concept motorcycle with augmented reality Visor — http://mashable.com/2016/10/12/bmw-motorrad/#aXY19b9M_iqz

Occipital Bridge mixed reality viewer — https://bridge.occipital.com

Play

Episode 145 – Can you hear me now?


This week we look at how voice technology is improving and enabling new kinds of interactions at work and within games. We look at how microphone technology is impacting the adoption of smaller voice assistants. We explore the accuracy of text transcription verses typing. We think through our own use of voice technology and digital assistants. And we add new features to our website, text-based, thanks to Twitter’s new DM button.

We also change our whatcha playing segment to look at what are we exploring. And we end the show with a challenge to our listeners. We’d love to hear your experiences based on this challenge.

Show Links:
The Advancement of Voice Technology and Microphones
Chirp Episode
Stanford speech recognition study
IBM ViaVoice Transcription demo 2001
Twitter’s new message button
Duke Nukem – again?

Things we are into:
Michael M. – Newton hunting
IBM’s Pen based ThinkPad
Michael R: Mr. Robot – Apple and Mr. Robot – Android

Play