Tesla is Creating a Voice Assistant to Replace Voice Commands [Example of Voice]

By Not a Tesla App Staff
Tesla is working on a voice assistant
Tesla is working on a voice assistant

It looks like Tesla may soon be replacing its archaic voice commands with something much more useful — a voice assistant.

Greentheonly, who often takes deep dives into Tesla software by decompiling the firmware and looking for changes, has now found the early integration of a voice assistant.

Voice Assistant Already Available in China

Tesla has already replaced its voice commands in China with a voice assistant that can not only control certain aspects of the vehicle using more natural language but can also answer common knowledge questions such as the current weather, stock quotes and more (video below).

Available Only on AMD?

Correction: Tesla’s voice assistant in China is only available on vehicles with AMD processors (MCU 3), and unfortunately not on older Intel-based (MCU 2) cars. If Tesla is utilizing the same core technologies in its upcoming voice assistant for other regions, we may see the same limitation.

Intel vehicles in China still use the voice command system we’re familiar with today.

Tesla Creating Own Assistant

According to Green's findings, it looks like Tesla may be rolling its own solution instead of integrating something like Amazon Alexa like Rivian has. Tesla created their own solution in China by using some of their own technology and several existing software solutions. However, some of them are only available in China so they don’t scale to support additional regions.

Grōk

The first thought that comes to mind is Tesla leaning on AI efforts by Grōk and xAI, which could help it support common knowledge questions and search the web for answers. However, that only gets Tesla partly there, as Alexa and Google Assistant already support a large ecosystem, one that may not be available if Tesla creates their own voice assistant. With Tesla’s solution, a driver may be limited to what devices they can control through the voice assistant, at least initially. Either way, just a more natural way to activate certain vehicle solutions will be an improvement over what’s available today. The ability to ask the assistant common questions will be the icing on top.

Wake Word

According to Green, the source code hinted at the voice assistant using a wake word, which would replace the need to press the scroll wheel on the steering wheel. Tesla has begun to use the left scroll wheel button for additional things lately such as wiper controls and a multi-function mode, so this may fit in with their plan.

It’s fun to speculate what the wake word would be or whether Tesla would add the ability to create your own. It could be something as simple as ‘Hey, Tesla’, ‘Grok’, or something more humorous as Tesla has a knack for. Unfortunately, there weren't any hints on what the actual wake word would be, but being able to set a destination, play a specific song or ask the assistant for the weather will be a much-needed improvement.

Supported Models

It's not clear which models Tesla would support a voice assistant, but with the release of software v12 with update 2024.14.3, Tesla is starting to leave more features out of older Intel-based vehicles. While a voice assistant may not necessarily be computationally heavy, it may depend on Tesla's implementation and whether voice commands are transcribed on device or carried over the internet for transcription.

Voice Model

In the software, there are references to Microsoft's text-to-speech technology and specifically to a voice named “Jenny Neutral.”

The “Jenny Neutral” voice seems like an acceptable voice, bringing a natural-sounding voice to Tesla's voice assistant, although it doesn't differ much from what you find on other assistants. You can view an example of Microsoft’s “Jenny Neutral” voice in the video below.

Tesla has been more mindful lately about adding information for unreleased features to its software to help prevent leaks, so by the time something like this is found by Green, it usually doesn't take long before it becomes available, although this could also make for an exciting Christmas present.

Rivian to Add Google Cast and Native YouTube App, Will Tesla Respond?

By Not a Tesla App Staff

Coming to Rivian vehicles over a software update is Google Cast and YouTube support, which will allow for seamless, high-quality content streaming to Rivian vehicles.

This is a big step forward for Rivian’s software integration, especially compared to Tesla, which has yet to integrate native apps or release the long-rumored Tesla native app store.

Google Cast

Google Cast is Google’s version of Apple AirPlay which is supported in a variety of audio and video streaming apps such as Netflix, Disney+, YouTube, and more. By using a supported app, a user will be able to cast content directly to Rivian’s main 15.6” center screen.

Like Casting to a TV or Smart Device at home, this will allow you to play, pause, or skip back and forth using the vehicle’s touchscreen. Google Casting automatically pauses when the vehicle shifts into Drive.

Native YouTube App

Alongside Google Cast, Rivian is also bringing a native YouTube app to vehicles, enabling users to access YouTube’s video and music library from anywhere with a data connection. These features will be integrated right into Rivian’s vehicle operating system, which means they will receive regular software updates, and not be reliant on browser-based capabilities.

Similar to casting content, YouTube content will also automatically pause when the vehicle is shifted into Drive.

Tesla Equivalents

For the time being, there is no way to AirPlay or Cast video from a phone or tablet to Tesla’s front or rear screens. However, for some apps such as YouTube, you can send the video URL to the vehicle and have it open the YouTube app to that video.

To do this, open the YouTube app and find a video. Once you’d like to share it with the vehicle you can tap on share. You’ll then need to share it with the Tesla app which will then send it to your vehicle. On iPhones this requires you to scroll to the right and tap on More, which brings up the native sharing screen and has the Tesla app.

However, this is far more limited than including AirPlay or Google Cast support which will work for practically and video, even personal videos in your photo library.

Elon Musk mentioned back in 2016 that Tesla would add mirroring of phone apps to the center screen, but that has yet to materialize. More recently Musk mentioned a native X App coming to Tesla vehicles.

Tesla Theater

Tesla Theater allows users to stream videos from various platforms, including YouTube, but these are web-based applications, with no native applications available. This leaves some marked limitations on usability.

Tesla most recently announced in their 2024.14 update that the browser will be able to be expanded to full-screen mode when parked, enabling more access to streaming services on the web. Meanwhile, Google Cast and Apple Airplay continue to remain highly requested features.

Tesla FSD V12.4 - Features and Release Date

By Not a Tesla App Staff

The greatly anticipated FSD v12.4 is around the corner, with Elon Musk mentioning that it will be going to employees this weekend, with limited external testers next week.

Several significant improvements are coming with V12.4, which is being compared to the leap in performance that was previously seen between V12 and V11.

Improved Comfort and Reduced Interventions

There are quite a few improvements expected with V12.4, which Musk has said will be focused on user comfort by reducing hard accelerations and sudden braking. According to Musk, FSD v12.4 is also expected to have a 5-10x improvement in time between user interventions, which means that Tesla is rapidly approaching its goal for the Robotaxi announcement on August 8, 2024.

Steering Wheel Nag Removal

FSD V12.4 is expected to eliminate the steering wheel nag, as Musk confirmed its removal last week. The camera-based driver monitoring system will be taking over, providing a hands-free experience. These improvements will most likely benefit owners who have cabin cameras with infrared lights the most, while Tesla may continue to use steering wheel nag as a fallback mechanism.

Driverless Autopark

The second key feature that may be included in v12.4 will be Banish Autopark, previously known as Reverse Summon, allowing you to choose a parking spot, exit the vehicle and have the car park itself. Whether this feature makes it in v12.4 is yet to be seen, but Musk has mentioned that parking without a driver is coming soon.

Automatically Seek Parking Spot at Destination

Finally, your Tesla will now traverse a parking lot and automatically enter Autopark mode when arriving at a destination, according to a post from Musk.

Eligibility and Branch

Tesla recently added FSD v12.3.6 to the 2024.14 branch with updates 2024.14.5 and 2024.14.6. This makes it very likely that Tesla’s next FSD version will also be based on 2024.14, meaning that it will be available to any vehicle on 2024.14.x.

For users on update 2024.3.25, this means that they’ll receive all of the features included in updates 2024.8 and 2024.14, which should make it a massive update.

Release Date

Musk has mentioned that FSD V12.4 is going out to employee vehicles for internal testing this weekend, with external testing starting next week. The rollouts typically go slower than predicted but looks like we may see this begin shipping to customers by the end of the month.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

More Tesla News

Subscribe

Subscribe to our weekly newsletter.

Sponsors

Find out how to become a sponsor and have your site listed here.

Although we share official Tesla release notes, we are not affiliated with Tesla Motors. We are Tesla fans and supporters.

Latest Tesla Update

Confirmed by Elon

Take a look at features that Elon Musk has said will be coming soon.

Subscribe

Subscribe to our weekly newsletter.