Crisper, clearer in-car communication — Roger that

Tina Jeffrey

Over the years, Telematics Detroit has become a premier venue for showing off advancements in automotive infotainment, telematics, apps, cloud connectivity, silicon, and more. If the breadth of QNX technology being demonstrated at the show this week is any indication, the event won’t disappoint. Among the highlights is our next-generation acoustics processing middleware — QNX Acoustics for Voice 3.0 — which has been architected to deliver the highest-quality audio for hands-free and speech recognition systems, enabling the ultimate acoustics experience in the car.

What is QNX Acoustics for Voice?
QNX Acoustics for Voice 3.0 is the successor to the QNX Aviage Acoustics Processing Suite 2.0. The new product includes a set of libraries — standard and premium — that offer automakers ultimate flexibility for voice processing in the harsh audio environment of the car.

The standard library provides a full-featured solution for implementing narrowband and wideband hands-free communications, operating at 8 kHz and 16kHz sample rates, respectively. It also includes innovative new features for performing echo cancellation, noise reduction, adaptive equalization, and automatic gain control. Perhaps the most valuable feature, especially for systems constrained by limited CPU cycles, is the high efficiency mode, which can process wideband and higher-bandwidth speech with substantially less CPU load. The net result: more processing headroom for other tasks.

The premium library includes all the standard library functionality, plus support for Wideband Plus, which expands the frequency range of transmitted speech to 50 Hz - 11 kHz, at a 24kHz sample rate. The introduction of Wideband Plus fulfills the higher voice quality and low noise requirements demanded by the latest smartphone connectivity protocols for telephony, VoIP services, and speech recognition. Let me recap with a table:

Supported capabilities	Standard library	Premium library
Narrowband audio: 300 – 3400Hz (8kHz sample rate)	✔	✔
Wideband audio: 50-7000Hz (16kHz sample rate)	✔	✔
Wideband Plus audio: 50Hz – 11kHz (24kHz sample rate)		✔
High efficiency mode	✔  (Wideband only)	✔
VOIP requirements for new smartphone connectivity protocols		✔
Cloud-based speech recognition requirements for new smartphone connectivity protocols		✔

---

Why is high-quality speech important in the car?
Simply put, it improves the user experience and can benefit passenger safety. Also, new smartphone connectivity protocols require it. Let’s examine two use cases: hands-free voice calling, and speech recognition.

In a voice call, processing a larger bandwidth of speech and eliminating echo and noise from various sources, including wind, road, vents, fans, and tires, dramatically increases speech intelligibility — and the more intelligible the speech, the more natural the flow of conversation. Also, clearer speech has less impact on the driver’s cognitive load, enabling the driver to pay more attention to the task at hand: driving.

Speech recognition systems are becoming a primary way to manage apps and services in the car. Voice commands can initiate phone calls, select media for playback, search for points of interest (POI), and choose a destination.

Technological advancements in pre-processing voice input to remove noise and disturbances helps speech recognizers detect commands more reliably, thereby achieving higher recognition accuracy. Early speech recognition systems, by comparison, were unintuitive and performed poorly. Drivers became so frustrated that they stopped using these systems and resorted to picking up their smartphones, completely eliminating the safety benefits of speech recognition.

QNX Acoustics for Voice 3.0 is a comprehensive automotive voice solution that includes industry-leading echo cancellation, noise reduction, adaptive equalization and automatic gain control.

If you happen to be at Telematics Update in Novi Michigan this week, be sure to drop by our booth to sit in our latest concept car — a specially modified Mercedes-Benz CLA45 AMG — and experience our acoustics technologies first hand.

In good company: QNX partner solutions at 2014 CES

Guest post by Peter McCarthy of the QNX global partnerships team

Peter McCarthy

If anyone thinks that creating an infotainment system is easy, they obviously haven’t thought about it hard enough. It is, in fact, a massive undertaking that requires seamless integration of navigation engines, voice technologies, app environments, HMI tools, Internet music services, smartphone connectivity, automotive-hardened processors — the list goes on.

No single company could possibly offer all of these technologies. And even if it could, it still wouldn’t address the needs of automakers and tier one suppliers, who need the power of choice. Any company building an infotainment system needs the flexibility to combine Navigation Engine A with Processor B and Bluetooth Solution C.

Enabling customers to enjoy such choice without worrying about integration issues is something that QNX works very hard at. For evidence, look no further than our latest technology concept car, a modified Mercedes-Benz CLA45 AMG, which debuted this week at our CES booth. The car integrates an array of partner tech, including:

• voice recognition from Nuance
   
• navigation engines from Elektrobit (EB), Kotei Informatics, and HERE
   
• automotive processors from Texas Instruments
   
• MirrorLink smartphone-to-vehicle connectivity from RealVNC
   
• Android Jellybean version of iHeartRadio
   

Meanwhile, the head unit in our reference vehicle, also featured in the QNX booth, integrates several partner apps and holds the distinction of being the world’s first in-vehicle implementation of Qualcomm’s Snapdragon Automotive Solutions. And if that’s not enough, our booth contains demos of a navigation engine from Aisin AW and a digital instrument cluster built with HMI tools from HI Corporation.

Mind you, the action isn’t restricted to the QNX booth. Several partners have also gotten into the act and are demonstrating QNX-based systems in their CES booths and meeting rooms. For instance:

• Elektrobit — Demonstrating a new concept electric vehicle that sports an instrument cluster and infotainment system based on the QNX Neutrino Realtime Operating System.
   
• Freescale — Demonstrating the QNX CAR Platform for Infotainment on its i.MX 6 Applications Processors for Automotive.
   
• Gracenote — Demonstrating how its technology can personalize the in-vehicle music experience, using a system based on the QNX Neutrino OS.
   
• NVIDIA — Demonstrating Audi's newest infotainment system featuring the NVIDIA Tegra processor and the QNX Neutrino OS.
   
• Qualcomm — Demonstrating the QNX CAR Platform on Snapdragon Automotive Solutions.
   
• Red Bend Software — Demonstrating virtualization technology that runs the QNX CAR Platform and a digital instrument cluster on dual displays driven by a single processor.
   
• Texas Instruments — Demonstrating the QNX CAR Platform running on its latest Jacinto processors
  

For the fully skinny on QNX partner technology at CES, I invite you to check out our press release, along with joint announcements that we have issued with Aisin AW, HERE, HI Corporation, and Qualcomm.

---

About Peter
When he isn't talking on oversized mobile phones, Peter McCarthy serves as director of global partnerships at QNX Software Systems, where he is responsible for establishing and fostering partnerships with technology and services companies in all of the company's target industries.

"I want one"

Yesterday, I bemoaned that words and pictures could never capture the unique experience of being in one of the new QNX technology concept cars. But you know what? Video comes a little bit closer.

Of course, it can't capture everything. For instance, it can't reproduce the richness and clarity of the cars' full-band and wideband phone calls, or the sheer auditory relief offered by QNX active noise control software. But it can capture the reaction of someone experiencing these technologies.

For instance, in this video, I love watching how Adam from CrackBerry.com reacts to our latest innovations in automotive acoustics. Especially the part where says "I want one."

Did I mention? The clip also contains footage of our infotainment and digital cluster systems in action. Check it out:



A big thanks to Adam and the CrackBerry team for visiting us at CES.

The wraps are off! First look at the new QNX technology concept car

A quick tour of one of the vehicles that QNX is unveiling at 2014 CES

You know what? Writing this post isn’t easy. All I’ve got are words and pictures, and neither could ever do justice to the user experience offered by the new QNX technology concept car. They cannot, for example, recreate the rich, luminous sound of the car’s full-band and wide-band hands-free calls. Nor can they evoke how the car blends speech recognition with a touch interface and physical controls to make navigation, Internet radio, and other applications wonderfully easy to use.

But on second thought, words and pictures aren’t that bad. Especially when the car — and the in-dash systems that the QNX concept team created for it — are so downright gorgeous. So what are we sitting around for? Time for a tour!

Actually... hold that thought. I just want to mention that, if you visit our Flickr page, you can find full-resolution versions of most of the images I've posted here. Because why settle for low res? Okay, back to the tour.

The car
I've got two things to say here. First, the car is based on a Mercedes-Benz CLA45 AMG. If you guessed the model correctly based on the teaser images we published on the QNX website, I bow in homage to your eagle eye. Second, while we snapped this photo in the QNX garage, don’t think for a minute that the garage is ever this neat and tidy. On any given day, it’s chock full of drill presses, tool boxes, work tables, embedded boards, and QNX engineers joyously modding the world’s coolest cars — exactly the kind of place you expect it to be. And want it to be! But to humor the photographer, we (temporarily) made this corner clutter-free. We're nice that way.



The dash
Let's get behind the wheel, where you can see the car's custom-built digital instrument cluster and infotainment system. The bold design, the clean layout, the super-easy-to-access controls — they all add up to systems you want to interact with. Just as important, the look-and-feel of the instrument cluster and infotainment system are totally different from the corresponding systems in our previous concept car — an excellent illustration of how the QNX platform can help customers create their own branded experiences.



The multi-talented cluster
Time to zoom in on the digital instrument cluster, which helps simplify driving tasks and minimize distraction with an impressive array of features. Turn-by-turn directions pulled from the navigation system? Check. Video feed from front and rear-view cameras? Check. Notifications of incoming phone calls? Check. Alerts of incoming text messages, which you can listen to at the touch of a steering-wheel button? Check.



The Android app support
Automakers want to tap into the talents of the mobile app community, and the QNX CAR Platform for Infotainment helps them do just that, with built-in support for Android, OpenGL ES, and HTML5. In the concept car, for example, you'll find an Android Jellybean version of iHeartRadio, Clear Channel’s digital radio service, running in a secure application container. The QNX CAR Platform takes this same sandboxed approach to running HTML5 apps — perfect for protecting both the HMI and the overall system from unpredictable web content:



Helping you get there in more ways than one
We designed the QNX CAR Platform to give automotive developers the greatest possible choice and flexibility. And that’s exactly what you see when it comes to navigation. For instance, the car supports navigation from Elektrobit:



and from HERE:



and from Kotei Informatics:



If that’s not enough, a demo system in the QNX booth at CES also demonstrates a navigation system from Aisin AW — more on that in an upcoming post.

Pardon me while I barge in
As I alluded earlier, what you can't see in the new concept car is just as important as what you can see. For instance, if you look at this image, you'll see the infotainment system's media player. But what you can't see is new acoustics technology from QNX that lets you "barge in" and issue voice commands even when a song is playing. How cool is that?



When you find yourself in times of trouble...
... don't let it be, but rather, check and see. And to do that, you can use the infotainment system's virtual mechanic, which keeps tabs on your car's health, including fluid levels, brake wear, and, in this case, low tire pressure:



The cloud connection
Hold on, what's this? It looks like a smartphone app with an interface similar to that of the virtual mechanic, above. In fact, it's a lot more than that, and it touches on some cool (and very new) technology that can help cars become fully managed citizens of the cloud. More on that in an upcoming post.



That's it for now. For more details on what QNX is showcasing this week at CES, check out the press releases posted on the QNX website. And stay tuned to this channel for further updates from 2014 CES — including a profile of our very new QNX technology concept car for acoustics.

The ultimate show-me car

The fifth installment in the CES Cars of Fame series. Our inductee for this week: a most bodacious Bentley.

It's one thing to say you can do something. It's another thing to prove it. Which helps explain why we create technology concept cars.

You see, we like to tell people that flexibility and customization form the very DNA of the QNX CAR Platform for Infotainment. Which they do. But in the automotive world, people don't just say "tell me"; they say "show me". And so, we used the platform to transform a Bentley Continental GT into a unique concept car, equipped with features never before seen in a vehicle.

Now here's the thing. This is the same QNX CAR Platform found in the QNX reference vehicle, which I discussed last week. But when you compare the infotainment systems in the two vehicles, the differences are dramatic: different features, different branding, different look-and-feel.

The explanation is simple: The reference vehicle shows what the QNX CAR Platform can do out of the box, while the Bentley demonstrates what the platform lets you do once you add your imagination to mix. One platform, many possibilities.

Enough talk; time to look at the car. And let's start with the exterior, because wow:



The awesome (and full HD) center stack
And now let's move to the interior, where the first thing you see is a gorgeous center stack. This immense touchscreen features a gracefully curved surface, full HD graphics, and TI’s optical touch input technology, which allows a physical control knob to be mounted directly on the screen — a feature that’s cool and useful. The center stack supports a variety of applications, including a 3D navigation system from Elektrobit that makes full use of the display:



At 17 inches, the display is big enough to display other functions, such as the car’s media player or virtual mechanic, and still have plenty of room for navigation:



The awesome (and very configurable) digital instrument cluster
The instrument cluster is implemented entirely in software, though you would hardly know it — the virtual gauges are impressively realistic. More impressive still is the cluster’s ability to morph itself on the fly. Put the car in Drive, and the cluster will display a tach, gas gauge, temperature gauge, and turn-by-turn directions — the cluster pulls these directions from the center stack’s navigation system. Put the car in Reverse, and the cluster will display a video feed from the car’s backup camera. You can also have the cluster display the current weather and current sound track:



The awesome (and just plain fun) web app
The web app works with any web browser and allows the driver to view data that the car publishes to the cloud, such as fluid levels, tire pressure, brake wear, and the current track being played by the infotainment system. It even allows the driver to remotely start or stop the engine, open or close windows, and so on:



The awesome (and nicely integrated) smartphone support
The Bentley also showcases how the QNX CAR Platform enables advanced integration with popular smartphones. For instance, the car can communicate with a smartphone to stream music, or to provide notifications of incoming email, news feeds, and other real-time information — all displayed in a manner appropriate to the automotive context. Here's an example:



The awesome everything else
I’ve only scratched the surface of what the car can do. For instance, it also provides:

• Advanced voice rec — Just say “Hello Bentley,” and the car’s voice recognition system immediately comes to life and begins to interact with you — in a British accent, of course.
   
• Advanced multimedia system — Includes support for Internet radio.
   
• Video conferencing with realistic telepresence — Separate cameras for the driver and passenger provide independent video streams, while fullband voice technology from QNX offers expanded bandwidth for greater telepresence.
   
• LTE connectivity — The car features an LTE radio modem, as well as a Wi-Fi hotspot for devices you bring into the car.

Moving pictures
Okay, time for some video. Here's a fun look at the making of the car:



And here's a run-through of the car's many capabilities, filmed by our friends at TI during 2013 CES:

A Porsche you could talk to

The third installment in the CES Cars of Fame series. Our inductee for this week: a very connected Porsche 911.

Paul Leroux

I have a confession to make. The day before QNX Software Systems unveiled this technology concept at car at 2012 CES, I leaked the news on the On Q blog. Mind you, the leak was unintentional. I had been editing a post that described the car and, instead of hitting Save, I hit Publish by mistake. Dumb, I know.

I immediately took down the post and informed my colleagues of the error. Fortunately, my RSS feed didn't give me away, and the launch, which had been strictly under wraps, went ahead as planned. But boy, did I feel stupid.

Now that I've got that off my chest, let's see what the hubbub was about. The car, based on a Porsche 911 Carrera, came equipped with an array of features built by the QNX concept team, including one-touch smartphone pairing, high-definition hands-free calls, rear-seat entertainment, and a digital instrument cluster.

So, you ready for a tour?

The car
Let's start with the exterior. Because man, what an exterior:



The instrument cluster
Once you got behind the wheel, the first thing you saw was the instrument cluster. But
this was no ordinary cluster. It could dynamically reconfigure itself — in response to voice commands, no less. It could even communicate with the navigation system to display turn-by-turn directions. And it was designed to honor the look-and-feel of the stock 911 cluster:



The head unit
To your right, you could see the head unit. Here is the unit's main screen, from which you could access all of the system's key functions:



And here's another screen, showing the system's media player:



The front-seat control of backseat infotainment
The Porsche also showcased how a head unit could offer front-seat control of backseat entertainment — perfect for when you need to control what your kids are watching or listening to:



The voice recognition
The Porsche was outfitted with cloud-based voice recognition, which let you enter navigation destinations naturally, without having to use artificial grammars. Check out this Engadget clip, taken at an AT&T event in New York City:



The car also included features that neither words nor pictures can capture adequately. But let me try, anyway:

One-touch Bluetooth pairing — Allowed you to pair a phone to the car simply by touching the phone to an NFC reader embedded in the center console; no complicated menus to wade through.

Text-to-speech integration — Could read aloud incoming emails, text messages, and BBM messages.

High-definition voice technology — Used 48KHz full stereo bandwidth for clear, high-fidelity hands-free calls.

The car also ran a variety of apps, including TCS hybrid navigation, Vlingo voice-to-text, Poynt virtual assistant, Weather Network, and streaming Internet radio from Pandora, Nobex, Slacker, and TuneIn.

The point
The point of this car wasn't simply to be cool, but to demonstrate what's possible in next-gen infotainment systems. More specifically, it was designed to showcase the capabilities of the QNX CAR Platform for Infotainment. In fact, it did such a good job on that count that the platform took home the 2012 CES Best of Show award, in the car tech category:

Distracted driving — the stats are alarming

I was driving to work the other day when I heard something on the radio that almost made me drop my smartphone. The Ontario Provincial Police (OPP) announced that, for the first time, deaths attributable to driver distraction outnumber those caused by impaired driving. So far this year, on roads patrolled by the OPP, distraction has led to 47 deaths, while impaired driving has led to 32.

This stat drives home the need for dramatically better head-unit integration of services that drivers would otherwise use their phones to access. This isn't anything new to QNX. We've been working with our partners to provide all the necessary elements to enable this integration through technologies such as HTML5, Qt, iPod out, MirrorLink, and Bluetooth. All these technologies can help create systems that minimize driver distraction but they represent only part of the solution. Pushing buttons on your head unit, combined with smart HMI design, does help, but it's not a panacea.

To truly help drivers keep their eyes on the road we have to minimize the time they spend looking at the infotainment display. Multi-modal HMIs built from the ground up with the assumption that high-quality speech recognition and text-to-speech are available will drastically change the way drivers interact with their infotainment systems. For instance, such HMIs could read your texts and emails aloud to you; they could even let you dictate responses at the appropriate time. But really, the possibilities are endless. And on the topic of talking to your car, we're constantly working with our partners to enrich the speech capabilities of the QNX CAR Platform. But more on that in an upcoming post.

By the way, I wasn't really using my smartphone while I was driving. That's illegal here. Not to mention incredibly dumb.