Category: Infotainment

Apple wants to take over every last screen with CarPlay

Apple

Apple

View the 11 images of this gallery on the original article

A next-gen version of Apple CarPlay is making waves in the automotive space at Apple’s WWDC 2022 event today. It’s far more than just a minor update to the regular, old screen projection on the infotainment display. No, today Apple proposed a system that would take over every screen in the car, instrument cluster included.

As shown, Apple software would power literally every last part of the car's user interface. By contrast, today's Apple CarPlay can take over your infotainment system’s display, but that’s where the experience ends. The gauge cluster (if it’s fully digital) and any other ancillary screens are all powered by OEM-designed software. In Apple’s example of the next-gen system, the instrument cluster essentially becomes an Apple CarPlay-powered instrument cluster, using Apple-designed gauges, widgets and more. The look you end up seeing on the cluster is highly customizable with various Apple-designed gauges, layouts and more. But, it would be a unified and consistent experience across every vehicle capable of running this version of Apple CarPlay. In theory, the gauge set of a Porsche could be made to look exactly like that of a Nissan, should both companies decide to support this level of integration.

How does this work? Apple says that “your iPhone communicates with your vehicle’s realtime systems in an on-device, privacy friendly way.” Yes, that is extremely vague, but there’s no additional information as of now. At the very least, it seems like the iPhone will continue to require the same wired or wireless connection to the car to make the system run. But again, that’s not made crystal clear here.

Skip to 40:28 in the video above to see the section on Apple CarPlay.

The integration goes deeper into the infotainment system, too. Instead of having to exit out of CarPlay to tune the radio or adjust the climate control (in cars without physical climate controls), you’d be able to do both within the Apple CarPlay software. This really would be a true Apple takeover of your everyday vital car functions. You’d be able to customize the display with widgets such as the calendar app, music app and more, allowing you to move them between the central infotainment display and gauge cluster as you wish. 

So, when is it coming? And what cars will be able to run this software? Apple doesn’t have clear answers to either of these, but it did flash some brands up onto the screen and say that they’re “excited to bring this new vision of CarPlay to customers.” Those include Land Rover, Mercedes-Benz, Porsche, Nissan, Ford, Lincoln, Audi, Jaguar, Acura, Volvo, Honda, Infiniti, Polestar and Renault. 

As of now, Apple says it’s going to start to announce specific vehicles that will support it “late next year.” Basically, don’t expect this to hit cars anytime soon, as the first vehicles announced will be toward the end of 2023.

Related video:

Volvo’s next-generation cars will feature gaming-derived graphics

View the 4 images of this gallery on the original article

Volvo joined forces with Epic Games, the company that created the Fortnite franchise, to give its next-generation cars a faster infotainment system with vastly improved graphics. Using technology gleaned from the world of gaming promises to unlock a long list of new features.

Don't expect to see a Fortnite-themed display in the XC90's replacement; the partnership isn't going that far. Volvo explained that it will use the Unreal Engine, a real-time 3D creation tool developed for industries outside of the gaming world, to develop the digital interface it will program into future additions to its range. This technology will allow it to deliver richer colors, sharper renderings and new 3D animations.

Good graphics aren't worth much if the software is annoying to use, so Volvo will power its next infotainment system with the third-generation Snapdragon Cockpit Platforms designed by Qualcomm. We're told that the end result is a system that's over twice as fast as the one Volvo currently uses, and whose graphic generation and processing capacities are up to 10 times faster. Volvo hasn't released a video of the software in action yet, but we won't have to wait long to see it: the feature will debut in a new flagship model due out by the end of 2022.

This isn't the first time that Volvo has enlisted the help of a technology company to design an infotainment system. Its current cars (like the C40 Recharge) are fitted with Google's Android Automotive OS infotainment system. And, the worlds of gaming and in-car technology have collided before: Nissan notably asked Polyphony Digital, the company behind the Gran Turismo franchise, to design the GT-R's display.

Android Auto updated: new look, better split-screen functionality

Android Auto users are in line for a fairly sizable update coming soon. Google revealed a totally new look and design for Android Auto at its Google I/O event last week, and the main takeaway is newfound flexibility.

Car makers are not exactly consistent with the various screen sizes and orientations used in vehicles. Many favor a widescreen format, while others prefer a vertically-oriented portrait format, and there are so many others in between. This was problematic for Android Auto previously, because it wasn’t designed to fill the screen perfectly with every possible screen shape. Plus, a fancy split-screen function was only supported for a small number of vehicles. Now, however, Google says it has fixed the issue. Android Auto will now conform to fit whatever size and shape your car’s screen is, be it tall and skinny or short and wide. And, a new split screen function should work on every vehicle.

Beyond the better integration, the Android Auto look itself is refreshed to bring it more in line with the latest Android software you see on phones. The fonts, shapes and general UI should now look more familiar to those with Android phones running stock Android software.

The aforementioned split-screen mode gets a new design for this version of Android Auto, too. Google says that the data it has collected on how people use Android Auto shows that folks primarily use it for navigation, media and communication. Therefore, the split-screen view now consists of three tiles for those three things. This means that you can see your nav, current media and any missed communications (texts, phone calls) all in one place at all times. Of course, you can also just enlarge any one of those if you prefer to keep the focus on one particular app, like navigation.

Google’s final announced change for this new Android Auto is better Assistant integration. The car will proactively suggest replies to text messages from friends, or allow you to quickly share an arrival time with a person of your choice. It’ll even recommend music options.

All of these changes are slated to roll out “in the coming months,” so if you’re an Android Auto user, keep a lookout for a new look and new features hitting your car’s infotainment system this summer.

Related video:

What are Apple CarPlay and Android Auto? FAQs answered

James Riswick

There’s good reason why Apple CarPlay and Google’s Android Auto are putting the nail in the coffin of automakers’ own smartphone platforms: They work. Prior to the platforms’ rollouts, automakers struggled to marry their in-car touchscreens and knob-and-display infotainment systems with smartphones. Such media player interfaces were and continue to be confusing, frustrating or glitchy.

Enter CarPlay and Android Auto, which use software to largely mirror what’s on a driver’s device – in a streamlined and relatively safe auto-centric way – on a car’s infotainment screen. They include the apps and interfaces owners of the devices already know and appear the same on every in-dash display – whether in a Bentley or a Buick.

What type of phone do you need for Apple CarPlay and Android Auto?

CarPlay is compatible with the iPhone 5 going forward, without needing a separate app. Android Auto, on the other hand, requires downloading an app for devices with Android 9 or below, while devices with Android 10 and later don’t require a separate app.

What apps are available for Android Auto and Apple CarPlay?

Both platforms include native apps for familiar features such as phoning, messaging, music, maps, audiobooks and podcasts, and leverage their parent company’s voice assistant for hands-free functionality. They also integrate popular third-party apps for music streaming, messaging services, navigation, parking, shopping, sports and even EV charging.

More than 600 vehicle models now offer CarPlay, and more than 500 are now compatible with Android Auto. The platforms are also available in aftermarket head units, and in 2018, Mazda added CarPlay support to vehicles from 2014 model-year vehicle forward by way of a dealer-installed upgrade for vehicles equipped with the Mazda Connect system.

Some automakers were initially, and until recently, reluctant to allow Apple and Google into their dashboards – Toyota in particular objected to owners’ usage data being shared automatically with Apple and Google.  At the time of this writing, Tesla is the only major automaker that has shunned the platforms and stuck with a proprietary system.

What's the difference between wired and wireless Apple CarPlay and Android Auto?

In most cases, a device needs to be connected to a car’s smartphone-integration USB port. (This port might be labeled as such in your car or designated by a white outline.) But with the introduction of iOS 9 in September 2015, more than 20 automakers now offer wireless CarPlay, while Android had already cut the cord in March 2015. (A handful of automakers offer wireless CarPlay only.)

Wireless CarPlay and Android Auto can’t use a Bluetooth connection, and instead require connecting to a vehicle via Wi-Fi. No, this doesn’t mean they chew through the data allowance for an in-car Wi-Fi hot spot. Since the platforms are data-intensive, they need this more robust connection to the car’s infotainment system.

One downside of wireless Apple CarPlay and Android Auto is a Wi-Fi connection more quickly drains a device’s battery. Of course, you can always plug the device into a USB charge-only port, and if your car has wireless device charging and wireless CarPlay and Android Auto you get the best of both worlds.

Do Apple CarPlay and Android Auto get updated?

In addition to their simplicity and familiarity, one of the biggest advantages of CarPlay and Android Auto over automakers’ smartphone-integration platforms is they’re routinely refreshed through software updates. While a handful of automakers offer over-the-air software updates for their infotainment systems, for all but Tesla it’s not as easy and seamless and having your smartphone update while you sleep, and getting new and enhanced features.

For example, along with adding wireless capability, the iOS 9 update allowed car companies to develop apps that let car occupants operate vehicle-specific features such as climate controls. Subsequent updates added features such as support for third-party navigation apps like Waze and for food ordering and parking services apps.

With the release of iOS 13 in 2019 came one of the biggest changes to CarPlay: a Dashboard feature with a split-screen option that can simultaneously show maps, media info and calendar items. It also added a Settings app that lets users switch between light and dark modes, adjust album art in the Now Playing screen and enable a Do Not Disturb feature.

Last year CarPlay added the availability to unlock a car and start the engine with an iPhone for certain 2021 models. The feature also allows sharing digital “keys” with family or friends and will even work for up to five hours after an iPhone’s battery is dead.

Android Auto has also been consistently updated. Google initially didn’t allow third parties to integrate mapping apps with Android Auto, reserving the platform for its own Google Maps and Waze. But now third-party mapping apps such as Sygic and TomTom AmiGO are available.

In late 2016 Google added the option to run Android Auto as an app on an Android device. In this case, that means via an embedded Android Automotive OS, which so far only a few vehicles run, notably Polestar EVs.

At the beginning of 2018, Google announced the addition of Google Assistant to Android Auto, while in July 2019 the platform got a UI overhaul. Last summer, Android Auto got a major upgrade that added being able to personalize the launch screen directly from your phone, a A-Z quick scrolling feature for lengthy catalogs of songs and contacts list and integration of EV charging, parking and navigation apps.

What limitations do Apple CarPlay and Android Auto have?

Neither system is a complete replacement for a car’s “native” infotainment system. If you want to listen to the radio, be it terrestrial or SiriusXM, you need the car’s interface. Same if you want to change various vehicle functions. Navigation apps such as Google Maps are also reliant on data to be able to search for a new destination and map a route ­– if you’re in an area without service and haven’t pre-downloaded map data (most people don’t even know you can do that), you won’t have a navigation system. That’s one reason why carmakers continue to offer native navigation systems, although some, such as new systems by Mercedes, offer augmented reality directions in the central screen or head-up display that you definitely won’t get with Google Maps.

What Apple CarPlay can do, or can’t do, also depends on the car. Some lock out CarPlay’s ability to look through Playlists in the music app while the car is in motion, for example, requiring you to select something using Siri. Others, however, keep everything available to you at all times.

What's the difference between Android Auto and Android Automotive OS?

We've already described Android Auto, but you're going to increasingly see the term Android Automotive, which is not the same thing. Instead of providing just an interface to control your smartphone through the car's infotainment system, Android Automotive is in fact the entire infotainment system. It is effectively an operating system created by Google that car brands can customize with their specific designs or "skins" that can control everything a car's native system normally would. So, think changing a radio station or customizing drive mode settings. Android Auto is still needed to communicate and control smartphone apps, and although CarPlay was not yet compatible at the time of this writing, it will in the future. You can see more about Android Automotive and its early adoption in the 2022 GMC Yukon below. 

Spotify Car Thing is now available for anyone to buy

The Spotify Car Thing is officially on sale for the masses. Its limited-release trial periods are over, and now anyone can buy it for $89.99.

The little music player’s premise remains the same. It’s meant to bring deep Spotify access to older cars that don’t have today’s convenient Apple CarPlay and Android Auto connectivity features. It features a touchscreen, a dial, preset buttons and voice control. The interface is a car-friendly copy of the Spotify app on your phone with big icons meant to make inputs easier than what you might get tapping away on your smartphone.

Some updates for Car Thing are coming based on Spotify’s learnings in the year-long trial period it’s gone through. For example, it’s developing a Night Mode for the screen, and an “Add to Queue” command is also coming. The latter is key if you and your friends are trying to build a playlist via voice command for a long road trip. We’re a little surprised it didn’t have a night mode to begin, but at least Spotify is integrating it now.

If you want a Car Thing, make sure you have the proper hardware to make it work — you’ll also need to be a Spotify Premium user. It requires a power source (12V outlet or USB outlet), and you also need to be able to connect your phone to the car’s audio system by way of Bluetooth, USB cable or aux cable, since the Car Thing doesn’t hook up to the audio system. If your car is old enough that it doesn’t have any of those, then you’re out of luck — of course, you can always install a newer head unit to gain access to a number of those connectivity options, but that costs even more money.

Those interested in buying can find the Spotify Car Thing listed on Spotify’s official website here

Some Seattle-area Mazdas’ media systems bricked by a radio transmission

Every car forum has threads devoted to broken infotainment systems. As vehicles pile on the tech controlled through infotainment systems, it's inevitable that every automaker will get its time in the spotlight — or the courts — to deal with the innumerable traps hidden in ginormous amounts of code found in the average modern car. Now it's Mazda's turn, but only for certain Mazdas from the 2014 to 2017 model years, and only those in the Seattle area able to pick up National Public Radio station KUOW.

A piece in the Seattle Times explains that something in the HD Radio signal KUOW sends is nearly bricking the infotainment systems in these vehicles. The common thread is that after the inciting incident, the radio will only play KUOW. And, since the screen will only play the Mazda wake-up animation repeatedly, owners have lost access to their navigation, Bluetooth, reversing camera and vehicle information. 

No one believes it's an NPR conspiracy. Yet. The Seattle Times spoke to a few owners, a couple of dealers, Mazda and Xperi, a company making the software HD radio runs on. Mazda fingered the culprit as the station transmitting image files without an extension, say for an album cover, that Mazda's media software tries and fails to process, with tragic results. Mazda didn't say why this issue is only happening on the model years at issue, nor why this specific software can't work around a file extension error, which have existed as long as there have been files.

The story is one of those that might make you shake your head and offer a tragic chuckle for the unfortunate, then look at your car outside and wonder, "How long until you do me like this?" The little snafus seem likelier every day, given that we weren't joking about the amount of software in today's cars. Way back in 2009, the Institute of Electrical and Electronics Engineers wrote, "It takes dozens of microprocessors running 100 million lines of code to get a premium car out of the driveway, and this software is only going to get more complex." That's about four times the amount of code needed to operate the Lockheed Martin F-35 Joint Strike Fighter, almost 70% more than all of the code that runs Facebook. This was before the all-out race for driver convenience features, vehicles becoming digital nodes and the industry's quest to catch up to consumer electronics software cycles. Imagine how many more lines have been compiled in 13 years, and how many more are to come (Level 3 autonomy, anyone?).

Before you do that, though, check out the Seattle Times story. And kudos to Mazda for stepping up take care of affected vehicles while everyone tries to figure out what's happening.

Related Video:

Porsche is developing a system to compose unique music for your drive

Modern day automobiles have done a lot to provide custom experiences for just about every driving scenario, from ambient lighting to suspension settings. Audio has also been included to an extent with better stereos and variable exhaust systems, but Porsche is going a step further. It's working on something called the Soundtrack My Life Project and having the car compose unique music that responds to your driving.

To be clear, this is not just the car selecting certain songs from your playlists or streaming services that fit either laid-back or enthusiastic driving. Instead, Porsche has libraries of original music bits and pieces that will be combined and arranged by an algorithm to match your driving. You pick the style, whether it's electronic, piano or some other genre, and it starts piecing things together. Come to a stop, and the music slows down and becomes less busy; start driving vigorously, and it transitions to more uptempo stuff with more instruments and layers.

It's currently in prototype form, and it only works with Porsche's own original music. So you can't use samples from your own music library, nor can you upload your own original music pieces. And being a prototype, it's not yet available. But during a presentation from Porsche, someone working on the project said that it could be available as soon as next year. Of course, that's subject to change. We're certainly curious to try it out. It could be pretty fun, kind of like the dynamic soundtracks you find in video games that help elevate the gameplay. On the other hand, we could see the novelty wearing off quickly, with people switching back to listening to traditional music instead.

Related Video: