Forget about stuck control buttons, counter-intuitive switches and even inaccurate voice assistance: Mercedes-Benz is now working on a concept car in which you could change radio stations, dim lights or control navigation simply by thinking about it.
The automotive giant presented the idea at the International Motor Show in Germany. Mercedes proposes to use brain-computer interface (BCI) technology to connect human brains to their cars, so that drivers can trigger functions in the vehicle without having to speak or touch anything.
BCIs are systems that can translate brain activity, which is measured thanks to the electrical impulses that happen when we think, into signals that software can understand.
The technology is pretty much an extension of what doctors have been doing for decades with electroencephalograms (EEGs), which monitor the electrical activity in the brain as way of detecting nerve problems. The difference between the systems is that BCIs then feed those signals into an algorithm that converts them into computer commands – meaning that a user, in principle, could control a computer with the power of their thoughts.
Mercedes has integrated a BCI platform developed by neurotechnology startup NextMind into a concept car called Vision AVTR that was presented at the show. Attendees were able to test the technology, which comes in the form of a brain-sensing wearable that can be fitted onto the head with an adjustable headband.
Electrodes on the headband record the user’s brain activity and establish a direct connection to the vehicle after a one-minute calibration. To optimize the generation of brain signals, different functions on the car’s dashboard are tagged with recognizable, graphic light signals, which stimulate neuronal activity.
The BCI device constantly measures the user’s brain waves, and can recognize on which light points the passenger is focusing their full attention – in other words, those that trigger the most neuronal activity. This is then analyzed by NextMind’s algorithms, which transform the neural signals into a command, such as to select a parking space or switching the car to night mode.
“NextMind’s groundbreaking technology opens new possibilities for user interaction and engagement by instantly translating brain signals from the user’s visual cortex into computer commands,” said Sid Kouider, NextMind founder and CEO.
The Vision AVTR is only a concept car, which means that Mercedes is still far from deploying BCI into its commercial vehicles. Introduced for the first time last year, the Vision AVTR rather reflects Mercedes’s engineers’ vision of the distant future, and displays technologies that are still nascent.
For example, the vehicle has no steering wheel, but a central console that launches upon recognizing the passenger’s heart rate and breathing. Raising the hand projects a menu selection onto the palm of the hand, so that users can select certain functions; the outside world is shown in 3D graphics inside the car, and includes the environment’s magnetic fields or ultraviolet light.
“The Vision AVTR (…) is exactly the right concept to test and further develop BCI applications,” said Markus Schäfer, the COO of Mercedes-Benz Cars. “This concept vehicle impressively depicts the future of mobility.”
It remains that, while acknowledging that…