Entertainment Enablement - Part II

The Entertainment Enablement session at SMPTE 2018 presented a wide spectrum of technologies that could enhance time spent in the driverless cars of the future.

The stage of the Entertainment Enablement session held at 4:14 during the Symposium on the Monday before the SMPTE 2018 Annual Technical Conference & Exhibition was filled with a panel of visionaries under the leadership of session chair, Michael DeValue. They had all peered into the future of driverless cars, and found a world of promise, prosperity ad maybe a bit of whimsy.

Masao Eriguchi, deputy general manager of the product planning dept. at the AI Robotics Business Group of Sony, lead off by telling the audience the car of the future could be thought of as an iPhone on wheels with passenger seats.

He went on to describe a concept car, the SC-1, built by Sony that, believe it or not, actually exists.

Sony's SC-1 concept cart. When you look at it, the 4K screens look back at you.

Sony's SC-1 concept cart. When you look at it, the 4K screens look back at you.

It’s basically a driverless golf cart with five 4K screens in place of windows, looking out as well as in. The driver looks at the road ahead via high resolution video, and if there is danger ahead, the car is capable of warning him/her by putting images of explosions in their path.

In addition, if a young girl walks by the side of the cart, the side screen will show her advertising that the autonomous circuitry thinks may be of interest to her.

The cart can drive itself, park itself, and basically operate without human interference.

The audience greeted the SC-1 with a bit of laughter.

Then Mauricio Aracena, standardization manager of media at Ericsson, discussed how the impending 5G networks are going to expand the possibilities of entertainment inside driverless cars. This could be combined with satellite media delivery or other digital inputs, since the 5G signal is robust enough to be sliced into multiple purposes.

“We may have different parts of the spectrum for different uses,” Aracena said. “5G is not just about high quality broadcasting, it is actually a whole new platform.”

Jay Turcot, director of applied AI at Affectiva got emotional over the subject. That is, he speculated that the car of the future would be able to sense the emotions of the passengers with biometric sensors.

"Emotions really affect every aspect of our lives,” he said. “Yet when we think of AI, we think of it as sterile. But what if technology could identify your emotional state? That is what Affectiva has been dealing with. We call it ‘automotive AI’”.

Turcot called it the first multi-modal in-cabin sensing AI that identifies, from face and voice, complex and nuanced emotional and cognitive states of drivers and passengers.

If passengers are angry, the car can sense it. If they are sleepy, the car can ask if it should take over the wheel. Tucot painted a not-so-brave new world for the emotionally untethered driverless car.

Yet Affectiva’s emotion-sensing technology has been on the market since 2011 and is already being used by 1,400 brands to evaluate customer responses to their products.

Finally, Marcus Kuehne, strategy lead immersive technologies at Audi AG, took to the stage to talk about the entertainment possibilities we could enjoy in our autonomous cars. “In the western hemisphere, every driver spends approximately one hour in the car,” he said. “We need to consider how this can be turned into entertainment. And not just movies or music. Consider how large the gaming industry has become and you can see a whole new way we can spend our time while something else drives our car.”

We’ve come a long way, Kuehne reminded us. Not long ago, we were content to have a mono radio in our cars. Then came tape, and maybe a sophisticated sound system.

“Now some cars have connectivity that can rival a home theater,” he said. “There is voice recognition, heads up displays, and a lot more to come.”

He referred to this as the first steps toward AI.

“In 10 to 20 years we will have autonomous cars with a high potential for immersive entertainment experiences,” Kuehne said. “Panasonic and VW are already moving toward it. What will come next is only limited by our imagination. After all, we have at least an hour a day to invest in it.”

After the panel, I asked Kuehne if he could expand on how long this is all going to take for the readers of the SMPTE newsletter and The Broadcast Bridge.

“Today drivers are focused on driving,” he said, “but imagine what else we could do with that time. It all depends on big players like Google and Facebook coming into the field with immersive technologies. But they will have to be able to compete with the revenue chain that is today occupied by smart devices like cell phones or iPads.”

You might also like...

HDR & WCG For Broadcast: Part 3 - Achieving Simultaneous HDR-SDR Workflows

Welcome to Part 3 of ‘HDR & WCG For Broadcast’ - a major 10 article exploration of the science and practical applications of all aspects of High Dynamic Range and Wide Color Gamut for broadcast production. Part 3 discusses the creative challenges of HDR…

The Resolution Revolution

We can now capture video in much higher resolutions than we can transmit, distribute and display. But should we?

Microphones: Part 3 - Human Auditory System

To get the best out of a microphone it is important to understand how it differs from the human ear.

HDR Picture Fundamentals: Camera Technology

Understanding the terminology and technical theory of camera sensors & lenses is a key element of specifying systems to meet the consumer desire for High Dynamic Range.

Demands On Production With HDR & WCG

The adoption of HDR requires adjustments in workflow that place different requirements on both people and technology, especially when multiple formats are required simultaneously.