Long time, no see: Catching up with the QNX CAR Platform

By Megan Alink, Director of Marketing Communications for Automotive

It’s a fact — a person simply can’t be in two places at one time. I can’t, you can’t, and the demo team at QNX can’t (especially when they’re brainstorming exciting showcase projects for 2016… but that’s another blog. Note to self.) So what’s a QNX-loving, software-admiring, car aficionado to do when he or she has lost touch and wants to see the latest on the QNX CAR Platform for Infotainment? Video, my friends.

One of the latest additions to our QNX Cam YouTube channel is an update to a video made just over two and a half years ago, in which my colleague, Sheridan Ethier, took viewers on a feature-by-feature walkthrough of the QNX CAR Platform. Now, Sheridan’s back for another tour, so sit back and enjoy a good, old-fashioned catch-up with what’s been going on with our flagship automotive product (with time references, just in case you’re in a bit of a hurry).

Sheridan Ethier hits the road in the QNX reference vehicle based on a modified Jeep Wrangler, running the latest QNX CAR Platform for Infotainment.

We kick things off with a look at one of the most popular elements of an infotainment system — multimedia. Starting around the 01:30 mark, Sheridan shows how the QNX CAR Platform supports a variety of music formats and media sources, from the system’s own multimedia player to a brought-in device. And when your passenger is agitating to switch from the CCR playlist on your MP3 device to Meghan Trainor on her USB music collection, the platform’s fast detection and sync time means you’ll barely miss a head-bob.

The QNX CAR Platform’s native multimedia player — the “juke box” — is just one of many options for enjoying your music.

About five minutes in, we take a look at how the QNX CAR Platform implements voice recognition. Whether you’re seeking out a hot latté, navigating to the nearest airport, or calling a co-worker to say you’ll be a few minutes late, the QNX CAR Platform lets you do what you want to do while doing what you need to do — keeping your hands on the wheel and your eyes on the road. Don’t miss a look at concurrency (previously discussed here by Paul Leroux) during this segment, when Sheridan runs the results of his voice commands (multimedia, navigation, and a hands-free call) smoothly at the same time.

Using voice recognition, users can navigate to a destination by address or point of interest description (such as an airport).

At eight minutes, Sheridan tells us about one of the best examples of the flexibility of the QNX CAR Platform — its support for application environments, including native C/C++, Qt, HTML5, and APK for running Android applications. The platform’s audio management capability makes a cameo appearance when Sheridan switches between the native multimedia player and the Pandora HTML5 app.

Pandora is just one of the HTML5 applications supported by the QNX CAR Platform.

As Sheridan tells us (at approximately 12:00), the ability to project smartphone screens and applications into the vehicle is an important trend in automotive. With technologies like MirrorLink, users can access nearly all of the applications available on their smartphone right from the head unit.

Projection technologies like MirrorLink allow automakers to select which applications will be delivered to the vehicle’s head unit from the user’s connected smartphone. 

Finally, we take a look at two interesting features that differentiate the QNX CAR Platform — last mode persistence (e.g. when the song you were listening to when you turned the car off starts up at the same point when you turn the car back on) and fastboot (which, in the case of QNX CAR, can bring your backup camera to life in 0.8 seconds, far less than the NHTSA-mandated 2 seconds). These features work hand-in-hand to ensure a safer, more enjoyable, more responsive driving experience.

Fastboot in 0.8 seconds means that when you’re ready to reverse, your car is ready to show you the way.

Interested in learning more about the QNX CAR Platform for Infotainment? Check out Paul Leroux’s blog on the architecture of this sophisticated piece of software. To see QNX CAR in action, read Tina Jeffrey’s blog, in which she talks about how the platform was implemented in the reimagined QNX reference vehicle for CES 2015.

Check out the video here:

Beyond the dashboard: discover how QNX touches your everyday life

QNX technology is in cars — lots of them. But it’s also in everything from planes and trains to smart phones, smart buildings, and smart vacuum cleaners. If you're interested, I happen to have an infographic handy...

I was a lost and lonely soul. Friends would cut phone calls short, strangers would move away from me on the bus, and acquaintances at cocktail parties would excuse themselves, promising to come right back — they never came back. I was in denial for a long time, but slowly and painfully, I came to the realization that I had to take ownership of this problem. Because it was my fault.

To by specific, it was my motor mouth. Whenever someone asked what I did for a living, I’d say I worked for QNX. That, of course, wasn’t a problem. But when they asked what QNX did, I would hold forth on microkernel OS architectures, user-space device drivers, resource manager frameworks, and graphical composition managers, not to mention asynchronous messaging, priority inheritance, and time partitioning. After all, who doesn't want to learn more about time partitioning?

Well, as I subsequently learned, there’s a time and place for everything. And while my passion about QNX technology was well-placed, my timing was lousy. People weren’t asking for a deep dive; they just wanted to understand QNX’s role in the scheme of things.

As it turns out, QNX plays a huge role, and in very many things. I’ve been working at QNX Software Systems for 25 years, and I am still gobsmacked by the sheer variety of uses that QNX technology is put to. I'm especially impressed by the crossover effect. For instance, what we learn in nuclear plants helps us offer a better OS for safety systems in cars. And what we learn in smartphones makes us a better platform supplier for companies building infotainment systems.

All of which to say, the next time someone asks me what QNX does, I will avoid the deep dive and show them this infographic instead. Of course, if they subsequently ask *how* QNX does all this, I will have a well-practiced answer. :-)

Did I mention? You can download a high-res JPEG of this infographic from our Flickr account and a PDF version from the QNX website.



Stay tuned for 2015 CES, where we will introduce even more ways QNX can make a difference, especially in how people design and drive cars.

And lest I forget, special thanks to my colleague Varghese at BlackBerry India for conceiving this infographic, and for the QNX employees who provided their invaluable input.

Attending SAE Convergence? Here’s why you should visit booth 513

Cars and beer don’t mix. But discussing cars while having a beer? Now you’re talking. If you’re attending SAE Convergence next week, you owe it to yourself to register for our “Spirits And Eats” event at 7:00 pm Tuesday. It’s the perfect occasion to kick back and enjoy the company of people who, like yourself, are passionate about cars and car electronics. And it isn’t a bad networking opportunity either — you’ll meet folks from a variety of automakers, Tier 1s, and technology suppliers in a relaxed, convivial atmosphere.

But you know what? It isn’t just about the beer. Or the company. It’s also about the Benz. Our digitally modded Mercedes-Benz CLA45 AMG, to be exact. It’s the latest QNX technology concept car, and it’s the perfect vehicle (pun fully intended) for demonstrating how QNX technology can enable next-generation infotainment systems. Highlights include:

• A multi-modal user experience that blends touch, voice, and physical controls
• A secure application environment for Android, HTML5, and OpenGL ES
• Smartphone connectivity options for projecting smartphone apps onto the head unit
• A dynamically reconfigurable digital instrument cluster that displays turn-by-turn directions, notifications of incoming phone calls, and video from front and rear cameras
• Multimedia framework for playback of content from USB sticks, DLNA devices, etc.
• Full-band stereo calling — think phone calls with CD quality audio
• Engine sound enhancement that synchronizes synthesized engine sounds with engine RPM

Here, for example, is the digital cluster:



And here is a closeup of the head unit:



And here’s a shot of the cluster and head unit together:



As for the engine sound enhancement and high-quality hands-free audio, I can’t reproduce these here — you’ll have come see the car and experience them first hand. (Yup, that's an invite.)

If you like what you see, and are interested in what you can hear, visit us at booth #513. And if you'd like to schedule a demo or reserve some time with a QNX representative in advance, we can accommodate that, too. Just send us an email.

The summer road trip of 2017 – Part II

Lynn Gayowski

Our series looking at how in-car technologies will transform your summer road trip continues with part II. 2017 is around the corner, and between now and then, automakers will introduce a bevy of new features that will make for a safer and more enjoyable summer road trip. In our first part, we looked at your road trip soundtrack, navigation, and mobile device connectivity. This week, we look at safety, acoustics, and autonomous cars as we cruise to the last exit for this blog series.

Staying safe
By 2017, we likely won’t have developed the technology to shrink your mechanic down to a size that allows you to perch one on your dashboard like a bobble-head, but many cars will have a “virtual mechanic.” This application will let you check lights, fluids, tire pressure and other system vitals, all through your center stack, digital instrument cluster, or phone – as seen below. The idea of a safety speedometer is hardly new in concept (see the Plymouth safety speedometer from 1939), but its modern implementation in the cars of 2017 in the form of vision systems performing road sign detection might just mean fewer speeding tickets on your road trip, especially as you cruise through unfamiliar areas. 

Staying in touch
Sometimes you want to take a road trip to get away from the world, but sometimes you still want (or need) to stay connected. Whether it’s phone calls, texts, or emails, all of this information will continue to be seamlessly integrated into your car in 2017. Less fumbling, fewer distractions.

And low-quality, stilted speakerphone calls will be a thing of the past with the emerging crop of acoustic technologies. Driving alone on a stretch of road and miss having your loved ones close by? Advanced duplex technology will make it seem as though the person on the other end of your phone conversation is sitting right beside you in the passenger’s seat.  

Another cool development? You won’t have to struggle to use voice recognition technologies because of your noisy in-car cabin (that’s right, serenely quiet cabins will no longer be exclusive to luxury cars). Vehicles will continue to evolve to meet the strictest CAFÉ and emissions standards, while the negative acoustic side-effects from less damping materials will be countered using software to remove unwanted engine sound. And your engine in 2017 might really sound like purring (or growling, if that’s your preference), as signature sounds are enabled by engine sound enhancement software. So not only will you not feel crazy for talking to your car, you’ll also be less frustrated as you do so cruising down the interstate. 

Beyond 2017: Look ma, no hands!
While it won’t happen quite as soon as 2017, autonomous cars will hit the roads in the relatively near future, forever changing the dynamic of the road trip. Will road trips be more accessible for the elderly and others who can’t physically drive long distances? Will the new meaning of "cruise control" make the road trip more or less enjoyable? All of these considerations are up for discussion. One thing is certain: many of the advanced safety systems of today and 2017 are precursors to cars that could drive themselves. One such example of what the future of autonomous driving will look like is the University of Parma’s DEEVA autonomous car project being developed by the Artificial Vision and Intelligent Systems Laboratory (VisLab).  

How is in-car technology playing a role in your current summer road trip? How do you want it to improve your future road trips? Stay tuned to our QNX_Auto Twitter account and Facebook page for weekly discussions throughout the rest of the summer about 2017 has in store for your road trip.

A cool (and connected) cluster

"The more we get connected,
Connected, connected,
The more we get connected,
The happier we’ll be."

Okay, I'll admit it, that's a little over the top. But even if connectivity can't make you happy, it can still breathe a great deal of enjoyment and productivity into your life. And when you build connectivity into devices that have previously stood alone, you open the door to all kinds of exciting possibilities. Case in point: the new digital instrument cluster for the QNX technology concept car.

Here's the cluster at a glance — click to see a bigger version:



Admit it: you'd love to wrap your hands around that steering wheel. I know I would. The Mercedes CLA45 is a sweet ride, and it inspired the QNX concept team to pull out all the stops when designing the new cluster with our partner Rightware, a specialist in UI tools for cars.

Four-point check
Okay, let's hop in and take a closer look. But before we put the car in gear, did your driving instructor ever tell you to do a four-point check? You know, where you make sure your lights, brakes, and other systems are working properly? You do remember to do that, don't you? The cluster makes the task a little easier by checking lights, tire pressures, fluids, and the HVAC system automatically:



Ease off the pedal, buddy
Time to put the car in gear. But before we do, let me tell you about the Plymouth safety speedometer. Designed to curb speeding, it alerted the driver whenever he or she leaned too hard on the gas. In theory, it was a great idea. In practice, it wasn't. You see, the year was 1939. And given the limitations of 1939 technology, the Plymouth safety speedometer couldn't take driving conditions or the local speed limit into account. So the speedometer always displayed warnings at the same speeds, no matter what the speed limit.

Connectivity to the rescue! Some modern navigation systems include information on local speed limits. By connecting the digital instrumental cluster to the navigation system in the car's head unit, the concept team was able to pull this information and display it in real time on the cluster, creating a modern (and much more useful) equivalent of Plymouth's 1939 invention.

Look at the image below. You'll see the local speed limit surrounded by a thick red circle, alerting the driver that they are breaking the limit — the fulfillment of an idea that has been 75 years in the making. Mind you, this isn't the only information that the cluster pulls from the head unit. It can also display turn-by-turn directions, trip information, album art, and other content normally relegated to the center display:



Should you answer?
Oh, hold on, the cluster is alerting us to an incoming call. You can ignore it, or you can answer by pushing a button on the steering wheel. And because this is the QNX technology concept car, it's no ordinary phone call. The car is equipped with QNX Acoustics for Voice, which supports Wideband Plus speech to deliver almost four times the bandwidth of a standard narrowband call. Translation: The person on the far end of call sounds like they're sitting right next to you.



Looking back
Okay, it's been a great drive, but time to head home. And in this case, home is the QNX garage. The garage doors are pretty narrow, and you need to back in carefully, so it's great to know that the cluster also provides a convenient window for the car's rear-view camera:



Meanwhile, in the real world...
Don't make the mistake of thinking this is a Buck Rogers scenario. Because the same combination of QNX and Rightware technology is already powering innovative systems like the Audi virtual cockpit. If you haven't yet seen the Audi system in action, check it out:

Crisper, clearer in-car communication — Roger that

Tina Jeffrey

Over the years, Telematics Detroit has become a premier venue for showing off advancements in automotive infotainment, telematics, apps, cloud connectivity, silicon, and more. If the breadth of QNX technology being demonstrated at the show this week is any indication, the event won’t disappoint. Among the highlights is our next-generation acoustics processing middleware — QNX Acoustics for Voice 3.0 — which has been architected to deliver the highest-quality audio for hands-free and speech recognition systems, enabling the ultimate acoustics experience in the car.

What is QNX Acoustics for Voice?
QNX Acoustics for Voice 3.0 is the successor to the QNX Aviage Acoustics Processing Suite 2.0. The new product includes a set of libraries — standard and premium — that offer automakers ultimate flexibility for voice processing in the harsh audio environment of the car.

The standard library provides a full-featured solution for implementing narrowband and wideband hands-free communications, operating at 8 kHz and 16kHz sample rates, respectively. It also includes innovative new features for performing echo cancellation, noise reduction, adaptive equalization, and automatic gain control. Perhaps the most valuable feature, especially for systems constrained by limited CPU cycles, is the high efficiency mode, which can process wideband and higher-bandwidth speech with substantially less CPU load. The net result: more processing headroom for other tasks.

The premium library includes all the standard library functionality, plus support for Wideband Plus, which expands the frequency range of transmitted speech to 50 Hz - 11 kHz, at a 24kHz sample rate. The introduction of Wideband Plus fulfills the higher voice quality and low noise requirements demanded by the latest smartphone connectivity protocols for telephony, VoIP services, and speech recognition. Let me recap with a table:

Supported capabilities	Standard library	Premium library
Narrowband audio: 300 – 3400Hz (8kHz sample rate)	✔	✔
Wideband audio: 50-7000Hz (16kHz sample rate)	✔	✔
Wideband Plus audio: 50Hz – 11kHz (24kHz sample rate)		✔
High efficiency mode	✔  (Wideband only)	✔
VOIP requirements for new smartphone connectivity protocols		✔
Cloud-based speech recognition requirements for new smartphone connectivity protocols		✔

---

Why is high-quality speech important in the car?
Simply put, it improves the user experience and can benefit passenger safety. Also, new smartphone connectivity protocols require it. Let’s examine two use cases: hands-free voice calling, and speech recognition.

In a voice call, processing a larger bandwidth of speech and eliminating echo and noise from various sources, including wind, road, vents, fans, and tires, dramatically increases speech intelligibility — and the more intelligible the speech, the more natural the flow of conversation. Also, clearer speech has less impact on the driver’s cognitive load, enabling the driver to pay more attention to the task at hand: driving.

Speech recognition systems are becoming a primary way to manage apps and services in the car. Voice commands can initiate phone calls, select media for playback, search for points of interest (POI), and choose a destination.

Technological advancements in pre-processing voice input to remove noise and disturbances helps speech recognizers detect commands more reliably, thereby achieving higher recognition accuracy. Early speech recognition systems, by comparison, were unintuitive and performed poorly. Drivers became so frustrated that they stopped using these systems and resorted to picking up their smartphones, completely eliminating the safety benefits of speech recognition.

QNX Acoustics for Voice 3.0 is a comprehensive automotive voice solution that includes industry-leading echo cancellation, noise reduction, adaptive equalization and automatic gain control.

If you happen to be at Telematics Update in Novi Michigan this week, be sure to drop by our booth to sit in our latest concept car — a specially modified Mercedes-Benz CLA45 AMG — and experience our acoustics technologies first hand.

The QNX sound machine at CES

If you’ve ever had the pleasure of attending the Consumer Electronics Show, you’ll know that it’s a crowded place full of lights and noise. In the automotive North Hall, much of the cacophony comes from the legions of car customizers blasting bass from sedan-sized speakers. This year, QNX has brought a new kind of technology concept car to CES, based on a Kia Soul, that offers some subtler forms of sound artistry. (Sorry, hamster fans—I don’t think we’ll have your favorite mascot in the QNX booth.)


A sound ride: the new QNX technology concept car for acoustics

Let’s start with noise. Everyone likes a booming radio, sometimes. But if that’s the only tool you have to drown out engine noise you’ll go deaf. That’s where Active Noise Control (ANC) comes in. Think of ANC as a more sophisticated version of noise cancelling headphones that you don’t need to wear. Not only does ANC help keep the car’s cabin quiet, but the QNX solution is software based and doesn’t require a dedicated hardware module, saving the OEM and the consumer money.

The best part about ANC is that it helps cars become more fuel efficient. Huh? To keep car interiors quiet, automakers add baffling in the doors and under the floor to help mute engine noise. Dragging around that extra weight costs fuel. So removing the ballast (I mean baffles) lets the automakers make more fuel-efficient cars. And with ANC, which helps eliminate the extra noise caused by this approach, everyone wins.

Beyond wideband
Next up: a new level of call quality. If you’ve had the pleasure of conversing between two newer smartphones (BlackBerry Z10 or Z30, iPhone 5, Nokia Lumina 520, Samsung Galaxy S4, ...) you may have noticed that the call sounded better than what you’re used to. That’s because many newer phones support something called wideband audio (or HD Voice), which transmits more audible frequencies to make the call sound clearer. That’s good, but QNX wants to show what’s possible beyond wideband. So in the QNX technology concept car for acoustics, we’re demoing a new audio feature called full-band stereo calling, which is like having phone calls with CD quality audio. A full-band call has over six times the transmitted frequency range of a standard call, and more than double that of wideband. And as the name suggests, full-band stereo provides two independent channels, adding to the depth and sense of presence, making the call quality something that just has to be experienced.

Sound like a V8, sip like a Volt
Lastly — we get to pump up the volume! The technology concept car for acoustics also sports engine sound enhancement (ESE), which plays synthesized engine sounds over speakers inside the car. With ESE, your engine appears to sound a little more throaty. It may not be obvious, but this is also a fuel saving technology! As carmakers look for creative ways to turn gasoline slurpers into sippers, they’re implementing technologies that dynamically modify engine cylinder firing. Those changes can sometimes make a perfectly powerful engine sound anemic, which negatively impacts customer first impressions. Unfortunately, most people want a car that sounds and performs like it has a huge V8 even if they expect it to sip gas like a Chevy Volt. Both ANC and ESE can help the customer get over their performance anxiety. ESE also lets drivers get in tune with their engine, making it easier to shift by ear.

If you’re up for a little fun, you can also use ESE to make your car sound like something completely different. We’re playing the ESE audio outside the car as well as inside it. The Kia is using QNX ESE audio to masquerade as another car. Tweet us at @QNX_Auto if you can guess what it is!