“What do you mean, I have to learn how not to drive?”

The age of autonomous driving lessons is upon us.

Paul Leroux

What would it be like to ride in an autonomous car? If you were to ask the average Joe, he would likely describe a scenario in which he sips coffee, plays video games, and spends quality time with TSN while the car whisks him to work. The average Jane would, no doubt, provide an equivalent answer. The problem with this scenario is that autonomous doesn’t mean driverless. Until autonomous vehicles become better than humans at handling every potential traffic situation, drivers will have to remain alert much or all of the time, even if their cars do 99.9% of the driving for them.

Otherwise, what happens when a car, faced with a situation it can’t handle, suddenly cedes control to the driver? Or what happens when the car fails to recognize a pedestrian on the road ahead?

Of course, it isn’t easy to maintain a high level of alertness while doing nothing in particular. It takes a certain maturity of mind, or at least a lack of ADD. Which explains why California, a leader in regulations for autonomous vehicles, imposes restrictions on who is allowed to “drive” them. Prerequisites include a near-spotless driving record and more than 10 years without a DUI conviction. Drivers must also complete an autonomous driving program, the length of which depends on the car maker or automotive supplier in question. According to a recent investigation by IEEE Spectrum, Google offers the most comprehensive program — it lasts five weeks and subjects drivers to random checks.

1950s approach to improving driver
alertness. Source: Modern Mechanix blog

In effect, drivers of autonomous cars have to learn how not to drive. And, as another IEEE article suggests, they may even need a special license.

Ample warnings
Could an autonomous car mitigate the attention issue? Definitely. It could, for example, give the driver ample warning before he or she needs to take over. The forward collision alerts and other informational ADAS functions in the latest QNX technology concept car offer a hint as to how such warnings could operate. For the time being, however, it’s hard to imagine an autonomous car that could always anticipate when it needs to cede control. Until then, informational ADAS will serve as an adjunct, not a replacement, for eyes, ears, and old-fashioned attentiveness.

Nonetheless, research suggests that adaptive cruise control and other technologies that enable autonomous or semi-autonomous driving can, when compared to human drivers, do a better job of avoiding accidents and improving traffic flow. To quote my friend Andy Gryc, autonomous cars would be more “polite” to other vehicles and be better equipped to negotiate inter-vehicle space, enabling more cars to use the same length of road.

Fewer accidents, faster travel times. I could live with that.


2015 approach to improving driver alertness: instrument cluster from the QNX reference vehicle.

New to 26262? Have I got a primer for you

Driver error is the #1 problem on our roads — and has been since 1869. In August of that year, a scientist named Mary Ward became the first person to die in an automobile accident, after being thrown from a steam-powered car. Driver error was a factor in Mary’s death and, 145 years later, it remains a problem, contributing to roughly 90% of motor vehicle crashes.

Can ADAS systems mitigate driver error and reduce traffic deaths? The evidence suggests that, yes, they help prevent accidents. That said, ADAS systems can themselves cause harm, if they malfunction. Imagine, for example, an adaptive cruise control system that underestimates the distance of a car up ahead. Which raises the question: how can you trust the safety claims for an ADAS system? And how do you establish that the evidence for those claims is sufficient?

Enter ISO 26262. This standard, introduced in 2011, provides a comprehensive framework for validating the functional safety claims of ADAS systems, digital instrument clusters, and other electrical or electronic systems in production passenger vehicles.

ISO 26262 isn’t for the faint of heart. It’s a rigorous, 10-part standard that recommends tools, techniques, and methodologies for the entire development cycle, from specification to decommissioning. In fact, to develop a deep understanding of 26262 you must first become versed in another standard, IEC 61508, which forms the basis of 26262.

ISO 26262 starts from the premise that no system is 100% safe. Consequently, the system designer must perform a hazard and risk analysis to identify the safety requirements and residual risks of the system being developed. The outcome of that analysis determines the Automotive Safety Integrity Level (ASIL) of the system, as defined by 26262. ASILs range from A to D, where A represents the lowest degree of hazard and D, the highest. The higher the ASIL, the greater the degree of rigor that must be applied to assure the system avoids residual risk.

Having determined the risks (and the ASIL) , the system designer selects an appropriate architecture. The designer must also validate that architecture, using tools and techniques that 26262 either recommends or highly recommends. If the designer believes that a recommended tool or technique isn’t appropriate to the project, he or she must provide a solid rationale for the decision, and must justify why the technique actually used is as good or better than that recommended by 26262.

The designer must also prepare a safety case. True to its name, this document presents the case that the system is sufficiently safe for its intended application and environment. It comprises three main components: 1) a clear statement of what is claimed about the system, 2) the argument that the claim has been met, and 3) the evidence that supports the argument. The safety case should convince not only the 26262 auditor, but also the entire development team, the company’s executives, and, of course, the customer. Of course, no system is safe unless it is deployed and used correctly, so the system designer must also produce a safety manual that sets the constraints within which the product must be deployed.

Achieving 26262 compliance is a major undertaking. That said, any conscientious team working on a safety-critical project would probably apply most of the recommended techniques. The standard was created to ensure that safety isn’t treated as an afterthought during final testing, but as a matter of due diligence in every stage of development.

If you’re a system designer or implementer, where do you start? I would suggest “A Developer’s View of ISO 26262”, an article recently authored by my colleague Chris Hobbs and published in EE Times Automotive Europe. The article provides an introduction to the standard, based on experience of certifying software to ISO 26262, and covers key topics such as ASILs, recommended verification tools and techniques, the safety case, and confidence from use.

I also have two whitepapers that may prove useful: Architectures for ISO 26262 systems with multiple ASIL requirements, written by my colleague Yi Zheng, and Protecting software components from interference in an ISO 26262 system, written by Chris Hobbs and Yi Zheng.

The summer road trip of 2017 — Part I

Lynn Gayowski

Summer is the season for many things — ice cream, outdoor festivals, heat waves, more ice cream, and perhaps best of all, hitting the open road. 2017 is around the corner, and between now and then, automakers will introduce a bevy of new features that will make for a safer and more enjoyable summer road trip. In this two-part series, we’ll take a look at how these technologies will help transform your summer road trip.

Tunes for the road
A road trip without a soundtrack is a road trip I want no part of. I think we can all agree that a Britney Spears playlist is compulsory. Music has always been intimately connected to the driving experience (see the Highway Hi-Fi Phonograph below for proof) and it’ll be even more integrated in the cars of 2017 with fewer limits. 

The media sources that you depend on today — local drives, USB storage devices, smartphones, cloud services — will work seamlessly with your vehicle, allowing you and your passengers to enjoy any genre from any source. Conventionally constrained to your center stack, music meta-data will permeate all the screens of your car, even the instrument cluster.

And for the backseat DJs, they’ll be able to use apps on their mobile devices to control the music playing in the car, which just might make the oft-repeated passenger phrase “Can you skip to the next song? I don’t like this one,” obsolete. Of course, to minimize distraction, the driver will always maintain cabin-wide control of what’s playing, and how loud it’s playing. 

The context-aware cockpit
The road trip of years past was plotted on a paper map and required a navigator in the passenger seat; today’s passengers are relieved of these duties as navigation and route plotting have gone digital. But even with that convenience, having to divert your eyes from the road to the center stack can be a nuisance. The dashboard of 2017 will offer greater convenience with a driver centric-display that could blend navigation and digital cluster information all on one screen. These vehicles will be "context aware" and display different information depending on the environment. For instance, surround-view cameras could detect pedestrians or cyclists and provide a minimalist on-screen alert to minimize driver distraction. Similarly, the system may disable certain functionality when the driver is about to navigate a hairpin turn. If the vehicle “knows” there’s a challenge ahead related to road condition, visibility, local speed limits, traffic, or topographical information, it could display the appropriate context-relevant information to the driver. 

Staying mobile
By 2017, you’ll probably have a new smartphone and, regardless of the platform, it’ll be able to communicate with your car. Projection mode technologies will be commonplace and render your phone’s display and services onto your car’s center stack (one example is QNX-powered Audi’s MMI mobile media application framework). This integration will no doubt get even more advanced in the coming years, and with Apple’s CarPlay and Google’s Android Auto connectivity protocols taking form, your favorite apps will be as at home on your dash as they are in your hand. 

Your phone will also be able to control and monitor your car in new ways via the much-discussed, but sometimes nebulous, cloud. For instance, let’s say you find yourself at a behemoth rest stop and can’t remember the location of your car after indulging in the roadside cuisine. Your phone’s “key fob” app could tell you exactly where your car is — it could even let you check your oil and washer fluid remotely to see if your car is in shape to make it on the next of your leg of your trip. 

How is in-car technology playing a role in your current summer road trip? How do you want it to improve your future road trips? What’s your favorite road trip destination? (My personal favorite is Washington, DC) Stay tuned here for Part II, and to our QNX_Auto Twitter account and Facebook page for weekly discussions on what 2017 has in store for your road trip.

 

Crisper, clearer in-car communication — Roger that

Tina Jeffrey

Over the years, Telematics Detroit has become a premier venue for showing off advancements in automotive infotainment, telematics, apps, cloud connectivity, silicon, and more. If the breadth of QNX technology being demonstrated at the show this week is any indication, the event won’t disappoint. Among the highlights is our next-generation acoustics processing middleware — QNX Acoustics for Voice 3.0 — which has been architected to deliver the highest-quality audio for hands-free and speech recognition systems, enabling the ultimate acoustics experience in the car.

What is QNX Acoustics for Voice?
QNX Acoustics for Voice 3.0 is the successor to the QNX Aviage Acoustics Processing Suite 2.0. The new product includes a set of libraries — standard and premium — that offer automakers ultimate flexibility for voice processing in the harsh audio environment of the car.

The standard library provides a full-featured solution for implementing narrowband and wideband hands-free communications, operating at 8 kHz and 16kHz sample rates, respectively. It also includes innovative new features for performing echo cancellation, noise reduction, adaptive equalization, and automatic gain control. Perhaps the most valuable feature, especially for systems constrained by limited CPU cycles, is the high efficiency mode, which can process wideband and higher-bandwidth speech with substantially less CPU load. The net result: more processing headroom for other tasks.

The premium library includes all the standard library functionality, plus support for Wideband Plus, which expands the frequency range of transmitted speech to 50 Hz - 11 kHz, at a 24kHz sample rate. The introduction of Wideband Plus fulfills the higher voice quality and low noise requirements demanded by the latest smartphone connectivity protocols for telephony, VoIP services, and speech recognition. Let me recap with a table:

Supported capabilities	Standard library	Premium library
Narrowband audio: 300 – 3400Hz (8kHz sample rate)	✔	✔
Wideband audio: 50-7000Hz (16kHz sample rate)	✔	✔
Wideband Plus audio: 50Hz – 11kHz (24kHz sample rate)		✔
High efficiency mode	✔  (Wideband only)	✔
VOIP requirements for new smartphone connectivity protocols		✔
Cloud-based speech recognition requirements for new smartphone connectivity protocols		✔

---

Why is high-quality speech important in the car?
Simply put, it improves the user experience and can benefit passenger safety. Also, new smartphone connectivity protocols require it. Let’s examine two use cases: hands-free voice calling, and speech recognition.

In a voice call, processing a larger bandwidth of speech and eliminating echo and noise from various sources, including wind, road, vents, fans, and tires, dramatically increases speech intelligibility — and the more intelligible the speech, the more natural the flow of conversation. Also, clearer speech has less impact on the driver’s cognitive load, enabling the driver to pay more attention to the task at hand: driving.

Speech recognition systems are becoming a primary way to manage apps and services in the car. Voice commands can initiate phone calls, select media for playback, search for points of interest (POI), and choose a destination.

Technological advancements in pre-processing voice input to remove noise and disturbances helps speech recognizers detect commands more reliably, thereby achieving higher recognition accuracy. Early speech recognition systems, by comparison, were unintuitive and performed poorly. Drivers became so frustrated that they stopped using these systems and resorted to picking up their smartphones, completely eliminating the safety benefits of speech recognition.

QNX Acoustics for Voice 3.0 is a comprehensive automotive voice solution that includes industry-leading echo cancellation, noise reduction, adaptive equalization and automatic gain control.

If you happen to be at Telematics Update in Novi Michigan this week, be sure to drop by our booth to sit in our latest concept car — a specially modified Mercedes-Benz CLA45 AMG — and experience our acoustics technologies first hand.

Using a smaller BOM to make less boom

Don't know about you, but where I live, the price of gas has rocketed through the troposphere and is fast approaching the upper stratosphere. Which is to say, it has gone through the proverbial roof. It was almost $1.40 a liter (over $5 a gallon) the last time I stopped at a pump and is set to climb even higher, now that summer is approaching.

Small wonder that, for many car buyers, fuel economy is top of mind. Automakers are wise to this and have adopted a variety of measures to make their cars sip gas more slowly. For instance, many cars now deactivate cylinders when engine load is light and use fewer sound-damping materials to shed weight — because schlepping fewer pounds means less work, and less work means less gas.

These techniques save gas all right, but at a price: increased engine “boom” noise that can both annoy and fatigue the driver — not to mention everyone else in the vehicle. That's a problem. To address it, automakers use active noise control, or ANC, which plays noise-cancelling signals over speakers in the vehicle cabin. All fine and good, but until now, ANC solutions have used dedicated hardware, which can drive up Bill of Materials (BOM) costs and make it difficult to leverage the latest ANC technologies.

What to do? That's the subject of a recent whitepaper by my inestimable colleague Tina Jeffrey. Tina outlines some design considerations for ANC systems (choosing the right microphones makes a difference, for example) but mostly, she focuses on the advantages of running ANC logic on the processor or DSP of the car's infotainment system — as opposed to on a dedicated ANC module.

The benefits are many, including lower BOM costs, greater design flexibility, better cooperation between various acoustic functions in the car and — here's the one I like — less boom. But why sit there listening to me drone on about this? Download Tina's paper now and get the real deal.




Software-based ANC: a smaller BOM, with less boom.

Frankenstein and the future networked car

So what do Frankenstein and the future networked car have in common, you ask? Simple: both are compelling stories brought to life in Geneva, Switzerland.

In Mary Shelley’s Frankenstein the creature is seen climbing Mont-Salève after having fled Geneva during a lightning storm:

“I thought of pursuing the devil; but it would have been in vain, for another flash discovered him to me hanging among the rocks of the nearly perpendicular ascent of Mont-Salève.”

Mont-Salève, overlooking Geneva
Photo: Benoit Kornmann

Of course, the future networked car is a very different type of story, but compelling nonetheless. The laboratory in this story is the ITU Symposium on The Future Networked Car being held within the Geneva Auto Show on March 5 to 6, where many new ideas will be brought to life by convening leaders and technical experts from the automotive and ICT communities.

The event, organized by the International Telecommunications Union (ITU), will consist of high-level dialogues and several technical sessions; these include a session on integrating nomadic devices in cars, where I will discuss how technology standards can help minimize driver distraction. The dialogues will cover road safety and innovation for the future car, and will feature key leaders such as the presidents of Fédération Internationale de l’Automobile (Jean Todt) and Infiniti (Johan de Nysschen). The technical sessions will explore automated driving, connected car use cases, emergency services, and, of course, nomadic device integration. Speakers for these sessions come from a mix of automakers, tier one suppliers, ICT companies, standards development organizations (SDOs), industry groups, and government agencies.

The symposium also includes a session jointly organized by the ITU and UNECE Inland Transport Committee that deals with the human factors and regulatory issues introduced by automated driving. This session is an encouraging sign that the ITU and UNECE will continue the collaboration they started last June (see my previous post, “UN agencies take major step towards international standards for driver distraction”).

Hope to see you in Geneva!

QNX acoustics technology shortlisted for 2014 embedded AWARD

Okay, first things first. I didn't get the capitalization wrong. The name of the award really is spelled that way. I thought it odd at first, but I'm getting used to it. And besides, who am I to complain? After all, I spend a good part of my life promoting a product whose name is spelled all uppercase, and... where was I? Oh yes, the award!

Every year, the folks who organize the embedded world Exhibition&Conference hold the embedded AWARDs, which honor the most innovative software, hardware, and tools for embedded developers. And this year, the competition judges selected QNX Acoustics for Active Noise Control as a finalist in the software category.

If you aren’t familiar with our ANC solution, allow me to provide an overview — which will also help explain why the embedded AWARD judges are so impressed.

Automakers need to reduce fuel consumption. And to do that, they employ techniques such as variable engine displacement and operating the engine at lower RPM. These techniques may save gas, but they also result in "boom" noise that permeates the car's interior and can lead to driver distraction. And who needs more distraction?

QNX Acoustics for Active Noise Control can integrate 

seamlessly into a vehicle's infotainment system.

To reduce this noise, automakers use ANC, which plays “anti-noise” (sound proportional but inverted to the offending engine tones) over the car's speakers. The problem is, existing ANC systems require dedicated hardware, which adds design complexity, not to mention significant Bill of Materials costs. And who needs more costs?

Enter QNX Acoustics for ANC. Rather than use dedicated hardware, QNX ANC provides a software library that can run on the existing DSP or CPU of the car's head unit or audio system. This approach not only reduces hardware costs, also enables better performance, faster development, and more design flexibility. I could go on, but I will let my colleague Tina Jeffrey provide the full skinny.

Did I mention? This wouldn’t be the first time QNX Software Systems is tapped for an embedded AWARD. It has won two so far, in 2006 and 2004, for innovations in multi-core and power-management technology. It was also a finalist in 2010, for its persistent publish/subscribe messaging. Here's to making it a hat trick.

The QNX sound machine at CES

If you’ve ever had the pleasure of attending the Consumer Electronics Show, you’ll know that it’s a crowded place full of lights and noise. In the automotive North Hall, much of the cacophony comes from the legions of car customizers blasting bass from sedan-sized speakers. This year, QNX has brought a new kind of technology concept car to CES, based on a Kia Soul, that offers some subtler forms of sound artistry. (Sorry, hamster fans—I don’t think we’ll have your favorite mascot in the QNX booth.)


A sound ride: the new QNX technology concept car for acoustics

Let’s start with noise. Everyone likes a booming radio, sometimes. But if that’s the only tool you have to drown out engine noise you’ll go deaf. That’s where Active Noise Control (ANC) comes in. Think of ANC as a more sophisticated version of noise cancelling headphones that you don’t need to wear. Not only does ANC help keep the car’s cabin quiet, but the QNX solution is software based and doesn’t require a dedicated hardware module, saving the OEM and the consumer money.

The best part about ANC is that it helps cars become more fuel efficient. Huh? To keep car interiors quiet, automakers add baffling in the doors and under the floor to help mute engine noise. Dragging around that extra weight costs fuel. So removing the ballast (I mean baffles) lets the automakers make more fuel-efficient cars. And with ANC, which helps eliminate the extra noise caused by this approach, everyone wins.

Beyond wideband
Next up: a new level of call quality. If you’ve had the pleasure of conversing between two newer smartphones (BlackBerry Z10 or Z30, iPhone 5, Nokia Lumina 520, Samsung Galaxy S4, ...) you may have noticed that the call sounded better than what you’re used to. That’s because many newer phones support something called wideband audio (or HD Voice), which transmits more audible frequencies to make the call sound clearer. That’s good, but QNX wants to show what’s possible beyond wideband. So in the QNX technology concept car for acoustics, we’re demoing a new audio feature called full-band stereo calling, which is like having phone calls with CD quality audio. A full-band call has over six times the transmitted frequency range of a standard call, and more than double that of wideband. And as the name suggests, full-band stereo provides two independent channels, adding to the depth and sense of presence, making the call quality something that just has to be experienced.

Sound like a V8, sip like a Volt
Lastly — we get to pump up the volume! The technology concept car for acoustics also sports engine sound enhancement (ESE), which plays synthesized engine sounds over speakers inside the car. With ESE, your engine appears to sound a little more throaty. It may not be obvious, but this is also a fuel saving technology! As carmakers look for creative ways to turn gasoline slurpers into sippers, they’re implementing technologies that dynamically modify engine cylinder firing. Those changes can sometimes make a perfectly powerful engine sound anemic, which negatively impacts customer first impressions. Unfortunately, most people want a car that sounds and performs like it has a huge V8 even if they expect it to sip gas like a Chevy Volt. Both ANC and ESE can help the customer get over their performance anxiety. ESE also lets drivers get in tune with their engine, making it easier to shift by ear.

If you’re up for a little fun, you can also use ESE to make your car sound like something completely different. We’re playing the ESE audio outside the car as well as inside it. The Kia is using QNX ESE audio to masquerade as another car. Tweet us at @QNX_Auto if you can guess what it is!