A behind the scenes look at creating an integrated driving experience

Lynn Gayowski

To quote the timeless lyrics of Britney Spears, “You want a Maserati? You better work.” This is exactly what the QNX team did to get our 2015 technology concept car ready for this year’s CES. And we had the cameras rolling throughout the build process.

The video below not only gives a behind the scenes look at the making of our latest technology concept car based on a Maserati Quattroporte GTS, but it features team members talking about the technology behind the car and what QNX brings to the table (or garage in this case) to enable a customized car in mere months.

Yes, the QNX CAR Platform has cool features and amazing reliability. But another draw for our customers is the platform’s pre-integrated partner technologies. The platform gets silicon, apps, and services working together so OEMs don’t have to solve this problem for themselves. It makes development time shorter and helps the focus to stay on branding the user experience. As Alex — one of the software engineers interviewed — mentions, after seeing what we did in the Maserati, “Just imagine what our customers can do!”

We targeted an integrated driving experience for this vehicle and I think this focus is evident in the finished product. The user interface and ADAS features are intuitive, and let’s be real, gorgeous. Check out this video that summarizes the making of the 2015 QNX technology concept car:



You’ll see many members of the concept team working hard throughout this video, but a shout out as well to all of the developers who contributed to the QNX CAR Platform, QNX operating system, and acoustics technologies that made this amazing vehicle possible. Congratulations to all of you for a job well done!

QNX and Qualcomm Technologies give show goers another stunner at 2015 CES

Guest post By Nilesh Parekh, Director of Product Management at Qualcomm Technologies

Year after year, CES attendees are repeatedly amazed by the advances in automobile infotainment. Not so long ago, it was about having a great stereo in the car and maybe a tiny screen in the center stack with a primitive navigation system. Then came Bluetooth connectivity… multiple multimedia screens… front and rear displays… gaming… 3G and 4G connectivity… Wi-Fi hotspots…

This year, QNX Software Systems and Qualcomm Technologies are bringing you something really special — a “mashup,” you could say, of a Maserati Quattroporte GTS, the QNX OS, the QNX CAR Platform, and the Snapdragon™ Automotive Solutions (SAS) platform, all working together in a show-stopping technology concept car.



The QNX concept team worked closely with Qualcomm Technologies to create an immersive in-vehicle experience using advanced technologies for infotainment, digital instrument clusters, and driver assistance systems. These systems feature high-resolution UIs with multi-touch support, 3D graphics for navigation, and LiDAR-based obstacle detection. And note the side mirrors have been swapped for smart displays that eliminate typical vehicle blind spots and present relevant color-coded overlay information to promote safer driving.

Inner beauty

Admittedly, the car is a thing of beauty. But being in the tech field, I find the real beauty inside the car — deep inside. There, working hand-in-hand with the field-proven QNX OS, is the Snapdragon Automotive Solutions (SAS) platform. The SAS platform manages all infotainment features; it also processes vital vehicle safety information, collected via a myriad of camera, ultrasonic, and LIDAR sensors, and delivers all relevant information to the driver in real time — that’s a lot of computing and processing power.

What’s so special about the SAS platform? First, let me define what it is (put on your tech hats): a highly integrated, thermal-efficient automotive-grade platform that incorporates an optimized combination of CPU, GPU, 4G LTE modem, GPS/GNSS, Bluetooth, and Wi-Fi. What’s special is that it is engineered to not only enhance the driver and passenger experiences with the infotainment features we know today, but it future-proofs the vehicle for next-generation features — some of which haven’t even been dreamt of yet. More important, it allows automakers and tier ones to accelerate development schedules and to focus on creating feature-rich, reliable infotainment and safety systems built with solutions such as the QNX CAR Platform.

Let’s take a closer look at the three areas of this special technology concept car where I think the presence of SAS makes the biggest impact: the instrument cluster, the infotainment system, and the driver assistance system. And keep in mind that this vehicle is more than a showcase of what’s “out there” and possible — it’s a test bed we’ll use to gain relevant experience and knowledge that we can apply to future technologies in real cars.

The all-digital, reconfigurable instrument cluster
The cluster — the go-to information display for drivers — on the technology concept car can cycle through a number of views, providing the driver with relevant data on what’s going on, in, and around the car in real time. Rear-view park assist, current audio track, navigation data, forward-collision warnings, and vehicle data are all examples of information rendered in the cluster:



The infotainment system
You can’t help but notice the 12” portrait touchscreen next to the instrument cluster. The system is built using the QNX CAR Platform for Infotainment — an automotive-hardened software platform built on the QNX OS. The QNX CAR Platform runs on the SAS hardware and implements a sophisticated UI design that supports voice recognition, touch (including tap, swipe, and pinch and zoom on the map), and synchronizes with the rear-seat control system, allowing rear-seat passengers to manage navigation, song selection, and temperature settings.

Here's a photo of the touchscreen in action. As you can see, it's displaying map info, an incoming call, and a "Now Playing" section. If you simply tap the map, which is powered by Elektrobit (EB) street director navigation and works with EB electronic horizon, it will automatically take over two-thirds of the screen:



Driver assistance system
The car's driver assistance system makes use of LIDAR and ultrasonic sensors to detect the presence of obstacles around the vehicle and renders warning information to the driver through the cluster or side-view displays, and also through an obstacle awareness system made up of dashboard LEDs. This system projects color-coded warnings onto the windshield to indicate the location and proximity of the object.

Other highlights include:

• “Always On” rear-view display — The rear-view mirror has been converted into a display that renders a wide-angle perspective of the area behind the car
• Elektrobit electronic horizon — Topographical map data is used to provide curve-speed recommendations and warnings that are displayed in the cluster

If you have the opportunity to see this car at CES, I highly recommend it — it really is an amazing technology concept vehicle that showcases the next-generation of automobile infotainment and safety. It will be located in the Qualcomm booth located in Central Plaza #21A Jan 6-9. If you cannot make it to CES, you can learn more here.

The lost concept car photos

Have you ever rummaged through old boxes in your basement and discovered family photos you had totally forgotten about — or never knew existed? I experienced a moment like that a couple of weeks ago. Except, in this case, no basement was involved. And the box wasn't a box, but a shared drive. And the photos weren't of my family, but of cars. QNX technology concept cars, to be exact.

At least once a year, the QNX concept team retrofits a new vehicle to demonstrate how our technology can help auto companies push the envelope in connectivity, infotainment, and acoustics. And, in every case, we take pictures — sometimes, lots of them. Inevitably, we end up choosing a few images for publicity purposes and filing the others. But as I discovered, the images we don't use are often just as good as the ones we do use. We just don't need all of them!

In any case, stumbling across these photos was great fun. I thought you might enjoy them, too, so here goes...

The Porsche
First up is the QNX technology concept car based on a Porsche 911, which made its debut at 2012 CES. We had originally planned to drive the car back to Ottawa once CES was over — but that was before we spoke to our friends at Texas Instruments, who provided the silicon for the car's instrument cluster and infotainment system. They liked the car so much, they asked if we could bring it to their HQ in Dallas, where the following two photos were taken. All I can say is, Dallas is home to at least one awesome cool photographer. Because rather than curse the crazy lighting, the photographer used it to create some playful compositions:





If you look below, you'll see another shot of the Porsche, taken just before we shipped it off to CES. The image really doesn't belong in this collection, as it appeared once on a partner website. But it's rare nonetheless, so I decided to include it. And besides, it's cool. Literally.



Did you know? The original Porsche 911, which debuted in the early 60s, was dubbed the 901. Problem was, Peugeot had exclusive rights in France to three-digit car names with a 0 in the middle. And so, the 901 became the 911.

---

The Bentley
Next up is the QNX technology concept car based on a Bentley Continental GT. In this image, the driver is interacting with the center stack's main control knob, which was mounted directly on a 17" touchscreen. See the row of icons just above the knob? These represented HVAC, music, navigation, hands-free calling and other system functions. The  system would automatically display these icons as your hand approached the display; you would then turn the knob to choose the function you wanted. (This image was taken by a BlackBerry employee, whose name I have most ungraciously forgotten.)



As with our all concept vehicles, the intent was to showcase the technology that we had built into the car's dashboard and center stack. Which probably explains why the following image of the car's exterior was never published. Pity, as it's quite lovely — a classic case of flare adding flair.



Did you know? Those wheels aren't just for show. The Bentley comes equipped with a 616 hp W12 engine (yup, three banks of cylinders) that can do 0-60 mph in a little over 4 seconds — it took me way longer than that to type this sentence.

---

The Jeep
Next up is the Jeep Wrangler, which serves as the QNX reference vehicle. The Jeep plays a different role than the other vehicles highlighted here: instead of demonstrating how QNX technology can help automotive companies innovate, it shows what the QNX CAR Platform for Infotainment can do right out of the box. In this image, you can see the vehicle's main navigation menu:



Did you know? The original infotainment system in the reference vehicle could post Facebook updates that listed the title and artist of the song currently playing. The system performed this magic in response to simple voice commands.

---

The Vette
The QNX technology concept car based on a Chevrolet Corvette made its debut at SAE Convergence 2010. Among other things, it showed how digital instrument clusters can morph on the fly to provide drivers with context-sensitive information, such as turn-by-turn directions. You can see a slicker, more sophisticated approach to reconfigurable clusters in our most recent technology concept car based on a Mercedes CLA45.



Did you know? We used the Corvette to demonstrate how QNX technology enables automotive companies to create customizable, reskinnable user interfaces. Check out this post on the Corvette's 30-day UI challenge.

---

The Prius
The first QNX-powered technology concept car was a digitally modded Prius — aka the LTE Connected Car. The car was a joint project of several companies, including QNX and Alcatel-Lucent, who wanted to demonstrate how 4G/LTE networks could transform the driving experience with a host of new in-vehicle applications.

Here's the car with a very proud-looking Derek Kuhn, who spearheaded the LTE Connected Car project while serving as a VP at Alcatel-Lucent. Derek subequently joined QNX as VP of sales and marketing:



Did you know? When this car was created, telecom companies had yet to light up their first commercial LTE towers. Also, the car had more infotainment systems than any other QNX technology concept car: two in the front (one for the driver and one for the front-seat passenger) and two in the back.

---

Some things get lost, albeit temporarily. And some you just never see again. Fortunately, all these images belong to the first category. Any favorites?

The QNX sound machine at CES

If you’ve ever had the pleasure of attending the Consumer Electronics Show, you’ll know that it’s a crowded place full of lights and noise. In the automotive North Hall, much of the cacophony comes from the legions of car customizers blasting bass from sedan-sized speakers. This year, QNX has brought a new kind of technology concept car to CES, based on a Kia Soul, that offers some subtler forms of sound artistry. (Sorry, hamster fans—I don’t think we’ll have your favorite mascot in the QNX booth.)


A sound ride: the new QNX technology concept car for acoustics

Let’s start with noise. Everyone likes a booming radio, sometimes. But if that’s the only tool you have to drown out engine noise you’ll go deaf. That’s where Active Noise Control (ANC) comes in. Think of ANC as a more sophisticated version of noise cancelling headphones that you don’t need to wear. Not only does ANC help keep the car’s cabin quiet, but the QNX solution is software based and doesn’t require a dedicated hardware module, saving the OEM and the consumer money.

The best part about ANC is that it helps cars become more fuel efficient. Huh? To keep car interiors quiet, automakers add baffling in the doors and under the floor to help mute engine noise. Dragging around that extra weight costs fuel. So removing the ballast (I mean baffles) lets the automakers make more fuel-efficient cars. And with ANC, which helps eliminate the extra noise caused by this approach, everyone wins.

Beyond wideband
Next up: a new level of call quality. If you’ve had the pleasure of conversing between two newer smartphones (BlackBerry Z10 or Z30, iPhone 5, Nokia Lumina 520, Samsung Galaxy S4, ...) you may have noticed that the call sounded better than what you’re used to. That’s because many newer phones support something called wideband audio (or HD Voice), which transmits more audible frequencies to make the call sound clearer. That’s good, but QNX wants to show what’s possible beyond wideband. So in the QNX technology concept car for acoustics, we’re demoing a new audio feature called full-band stereo calling, which is like having phone calls with CD quality audio. A full-band call has over six times the transmitted frequency range of a standard call, and more than double that of wideband. And as the name suggests, full-band stereo provides two independent channels, adding to the depth and sense of presence, making the call quality something that just has to be experienced.

Sound like a V8, sip like a Volt
Lastly — we get to pump up the volume! The technology concept car for acoustics also sports engine sound enhancement (ESE), which plays synthesized engine sounds over speakers inside the car. With ESE, your engine appears to sound a little more throaty. It may not be obvious, but this is also a fuel saving technology! As carmakers look for creative ways to turn gasoline slurpers into sippers, they’re implementing technologies that dynamically modify engine cylinder firing. Those changes can sometimes make a perfectly powerful engine sound anemic, which negatively impacts customer first impressions. Unfortunately, most people want a car that sounds and performs like it has a huge V8 even if they expect it to sip gas like a Chevy Volt. Both ANC and ESE can help the customer get over their performance anxiety. ESE also lets drivers get in tune with their engine, making it easier to shift by ear.

If you’re up for a little fun, you can also use ESE to make your car sound like something completely different. We’re playing the ESE audio outside the car as well as inside it. The Kia is using QNX ESE audio to masquerade as another car. Tweet us at @QNX_Auto if you can guess what it is!

The ultimate show-me car

The fifth installment in the CES Cars of Fame series. Our inductee for this week: a most bodacious Bentley.

It's one thing to say you can do something. It's another thing to prove it. Which helps explain why we create technology concept cars.

You see, we like to tell people that flexibility and customization form the very DNA of the QNX CAR Platform for Infotainment. Which they do. But in the automotive world, people don't just say "tell me"; they say "show me". And so, we used the platform to transform a Bentley Continental GT into a unique concept car, equipped with features never before seen in a vehicle.

Now here's the thing. This is the same QNX CAR Platform found in the QNX reference vehicle, which I discussed last week. But when you compare the infotainment systems in the two vehicles, the differences are dramatic: different features, different branding, different look-and-feel.

The explanation is simple: The reference vehicle shows what the QNX CAR Platform can do out of the box, while the Bentley demonstrates what the platform lets you do once you add your imagination to mix. One platform, many possibilities.

Enough talk; time to look at the car. And let's start with the exterior, because wow:



The awesome (and full HD) center stack
And now let's move to the interior, where the first thing you see is a gorgeous center stack. This immense touchscreen features a gracefully curved surface, full HD graphics, and TI’s optical touch input technology, which allows a physical control knob to be mounted directly on the screen — a feature that’s cool and useful. The center stack supports a variety of applications, including a 3D navigation system from Elektrobit that makes full use of the display:



At 17 inches, the display is big enough to display other functions, such as the car’s media player or virtual mechanic, and still have plenty of room for navigation:



The awesome (and very configurable) digital instrument cluster
The instrument cluster is implemented entirely in software, though you would hardly know it — the virtual gauges are impressively realistic. More impressive still is the cluster’s ability to morph itself on the fly. Put the car in Drive, and the cluster will display a tach, gas gauge, temperature gauge, and turn-by-turn directions — the cluster pulls these directions from the center stack’s navigation system. Put the car in Reverse, and the cluster will display a video feed from the car’s backup camera. You can also have the cluster display the current weather and current sound track:



The awesome (and just plain fun) web app
The web app works with any web browser and allows the driver to view data that the car publishes to the cloud, such as fluid levels, tire pressure, brake wear, and the current track being played by the infotainment system. It even allows the driver to remotely start or stop the engine, open or close windows, and so on:



The awesome (and nicely integrated) smartphone support
The Bentley also showcases how the QNX CAR Platform enables advanced integration with popular smartphones. For instance, the car can communicate with a smartphone to stream music, or to provide notifications of incoming email, news feeds, and other real-time information — all displayed in a manner appropriate to the automotive context. Here's an example:



The awesome everything else
I’ve only scratched the surface of what the car can do. For instance, it also provides:

• Advanced voice rec — Just say “Hello Bentley,” and the car’s voice recognition system immediately comes to life and begins to interact with you — in a British accent, of course.
   
• Advanced multimedia system — Includes support for Internet radio.
   
• Video conferencing with realistic telepresence — Separate cameras for the driver and passenger provide independent video streams, while fullband voice technology from QNX offers expanded bandwidth for greater telepresence.
   
• LTE connectivity — The car features an LTE radio modem, as well as a Wi-Fi hotspot for devices you bring into the car.

Moving pictures
Okay, time for some video. Here's a fun look at the making of the car:



And here's a run-through of the car's many capabilities, filmed by our friends at TI during 2013 CES:

Is this the most jazzed-up Jeep ever to hit CES?

The fourth installment in the CES Cars of Fame series. Our inductee for this week: a Jeep that gets personal.

Paul Leroux

It might not be as hip as the Prius or as fast as the Porsche. But it's fun, practical, and flexible. Better yet, you can drive it just about anywhere. Which makes it the perfect vehicle to demonstrate the latest features of the QNX CAR Platform for Infotainment.

It's called the QNX reference vehicle, and it's been to CES in Las Vegas, as well as to Detroit, New York City, and lots of places in between. It's our go-to vehicle for whenever we want to hit the road and showcase our latest infotainment technology. It even made a guest appearance at IBM's recent Information On Demand 2013 Big Data conference, where it demonstrated the power of connecting cars to the cloud.

The reference vehicle, which is based on a Jeep Wrangler, serves a different purpose than our technology concept cars. Those vehicles take the QNX CAR Platform as a starting point to demonstrate how the platform can help automakers hit new levels of innovation. The reference vehicle plays a more modest, but equally important, role: to show what our the platform can do out of the box.

For instance, we updated the Jeep recently to show how version 2.1 of the QNX CAR Platform will allow developers to blend a variety of application and HMI technologies on the same display. In this case, the Jeep's head unit is running a mix of native, HTML5, and Android apps on an HMI built with the Qt application framework:



Getting personal
We also use the Jeep to demonstrate the platform's support for customization and personalization. For instance, here is the first demonstration instrument cluster we created specifically for the Jeep:



And here's a more recent version:



These clusters may look very different, but they share the same underlying features, such as the ability to display turn-by-turn directions, weather updates, and other information provided by the head unit.

Keeping with the theme of personalization, the Jeep also demonstrates how the QNX CAR Platform allows developers to create re-skinnable HMIs. Here, for example, is a radio app in one skin:



And here's the same app in a different skin:



This re-skinnability isn't just cool; it also demonstrates how the QNX CAR Platform can help automotive developers create a single underlying code base and re-use it across multiple vehicle lines. Good, that.

Getting complementary
The Jeep is also the perfect vehicle to showcase the ecosystem of complementary apps and services integrated with the QNX CAR Platform, such as the (very cool) street director navigation system from Elektrobit:



To return to the question, is this really the most jazzed-up Jeep to hit CES? Well, it will be making a return trip to CES in just a few weeks, with a whole new software build. So if you're in town, drop by and let us know what you think.

A Porsche you could talk to

The third installment in the CES Cars of Fame series. Our inductee for this week: a very connected Porsche 911.

Paul Leroux

I have a confession to make. The day before QNX Software Systems unveiled this technology concept at car at 2012 CES, I leaked the news on the On Q blog. Mind you, the leak was unintentional. I had been editing a post that described the car and, instead of hitting Save, I hit Publish by mistake. Dumb, I know.

I immediately took down the post and informed my colleagues of the error. Fortunately, my RSS feed didn't give me away, and the launch, which had been strictly under wraps, went ahead as planned. But boy, did I feel stupid.

Now that I've got that off my chest, let's see what the hubbub was about. The car, based on a Porsche 911 Carrera, came equipped with an array of features built by the QNX concept team, including one-touch smartphone pairing, high-definition hands-free calls, rear-seat entertainment, and a digital instrument cluster.

So, you ready for a tour?

The car
Let's start with the exterior. Because man, what an exterior:



The instrument cluster
Once you got behind the wheel, the first thing you saw was the instrument cluster. But
this was no ordinary cluster. It could dynamically reconfigure itself — in response to voice commands, no less. It could even communicate with the navigation system to display turn-by-turn directions. And it was designed to honor the look-and-feel of the stock 911 cluster:



The head unit
To your right, you could see the head unit. Here is the unit's main screen, from which you could access all of the system's key functions:



And here's another screen, showing the system's media player:



The front-seat control of backseat infotainment
The Porsche also showcased how a head unit could offer front-seat control of backseat entertainment — perfect for when you need to control what your kids are watching or listening to:



The voice recognition
The Porsche was outfitted with cloud-based voice recognition, which let you enter navigation destinations naturally, without having to use artificial grammars. Check out this Engadget clip, taken at an AT&T event in New York City:



The car also included features that neither words nor pictures can capture adequately. But let me try, anyway:

One-touch Bluetooth pairing — Allowed you to pair a phone to the car simply by touching the phone to an NFC reader embedded in the center console; no complicated menus to wade through.

Text-to-speech integration — Could read aloud incoming emails, text messages, and BBM messages.

High-definition voice technology — Used 48KHz full stereo bandwidth for clear, high-fidelity hands-free calls.

The car also ran a variety of apps, including TCS hybrid navigation, Vlingo voice-to-text, Poynt virtual assistant, Weather Network, and streaming Internet radio from Pandora, Nobex, Slacker, and TuneIn.

The point
The point of this car wasn't simply to be cool, but to demonstrate what's possible in next-gen infotainment systems. More specifically, it was designed to showcase the capabilities of the QNX CAR Platform for Infotainment. In fact, it did such a good job on that count that the platform took home the 2012 CES Best of Show award, in the car tech category:

Behind the scenes at the QNX concept garage

It seems like every technology concept car QNX produces is bigger and better than the last one, which is just how we like it. That also means each year countless hours are spent dreaming up and implementing ideas. Luckily for us, we’ve got an absolutely amazing concept design team who go above and beyond to create these demos. Luckily for them, the team’s got a cool garage to work in.

Here’s a behind-the-scenes look at where the magic happens.


The garage can be a serene place after a milestone is reached. In this photo, the Jeep and Bentley await transport to the Telematics Detroit conference.


Mike Shane only looks like he’s trying to break into the car. In reality, he’s shining some light on the latest challenge to roll into the garage.


Tyler Elliott works on the remote monitoring demo portion of the Bentley, making sure the windows and locks behave as planned not only in the garage but also on the show floor.


Like most of his colleagues, Alexandre James splits his time in the garage between the computer and the vehicles. Here he helps test the Bentley’s stereo audio capabilities.


The open concept of the garage makes it easy to share challenges and draw upon everyone's expertise. Here Justin Moon, a former member of the concept team, talks with colleagues about the DLP.

True Nguyen, a UX designer “borrowed” from the engineering team to work on the Jeep and Bentley UIs, fits right in with the garage regulars.


James Henderson from Design First moves in and out of the garage as needed. Here he is deep in thought as he works on the new dash that will eventually house the large display.


The garage has a small alcove with couches and whiteboards away from the vehicles; the guys from Crank Software make good use of the space to check in their code.


Mark Rigley, the team’s fearless and passionate leader, toasts everyone’s hard work before each technology concept car makes its maiden voyage out of the garage.


Who says real men don’t drink rosé? After countless hours in the garage, a celebration is always a welcome break.


Another end-of-project tradition – team photo with the concept car.