Driving Excellence in Automotive HMI Design: Storyboard on the NXP i.MX 8 at CES

Whether it’s commuting to and from work, chauffeuring the kids to hockey*, or running errands, we spend countless hours driving on a daily basis. Fortunately for those of us who feel like we live part-time in our cars, technology is evolving at a rapid rate to enhance the driving experience and to allow us to connect with our vehicles more seamlessly and safely.

Storyboard Suite Automotive HMI NXP imx8 CES 2017

If you were at CES last week, you might have noticed a few automotive HMI demos at the show. Every year we see stunning innovation in automotive technology and new features that inspire consumers to hand over their money. (No flying car yet, however.) This year was no exception. CES 2017 showcased the coolest automotive HMI technology from the biggest automakers to small, low-cost suppliers, and everyone in between.

Keeping up with such a fast-growing and ever-changing technology and meeting consumer expectations isn’t an easy feat for automotive HMI design and development teams. Consumer expectations are high. Take a look at your smartphone. Impressive graphics, right? You have a powerful mobile computer that fits in your pocket. It’s a navigation system, audio/video player, and communication device that’s available to you when you need it. We’ve come to expect these same capabilities to be available to us on demand when needed, even in our cars. And we expect them to look great.

So how do teams deliver graphically stunning, connected, responsive, feature-rich automotive HMI experiences? Development teams need a high-performance and reliable processor that can support rich graphics, display to multiple screens, and handle a variety of inputs, such as the NXP i.MX 8. Making high-performance hardware look great and delivering an intuitive user experience is the job of the UI development framework. What consumers see on their car screens is the graphical representation of all of the information and data available to them, from their digital instrument cluster to their in-vehicle infotainment and entertainment displays.

Making Automotive HMIs that meet consumer expectations

It can be challenging for teams to deliver beautiful, user-friendly, and safety-conscious graphical content to a range of automotive displays. They need tools that support the following:

  • Design-centric – Design and user experience are critical to automotive HMIs. To achieve a high-quality design aesthetic and intuitive interaction, it’s critical to keep the designer in control throughout the development process.
  • Collaborative Workflow – Automotive HMIs are often built by teams, not by individuals. The software processes and workflow should support that.
  • Design ChangeIterative design is a reality. From minor tweaks to major updates in artwork, changes can, and should, happen. If it’s painful to iterate the design, it’s more likely that design compromise will occur.
  • Embedded Focus – Hardware for embedded displays has unique capabilities and constraints. The UI development software should have a focus on embedded.

We built Storyboard Suite with these requirements and others in mind. With our vast experience in the embedded marketplace and our focus on making Storyboard Suite feature-rich, yet user-friendly, many companies choose Storyboard for their exciting HMI projects.

Speaking of exciting HMI projects…

NXP showcased a distributed eCockpit and Infotainment at CES 2017 that was built using Storyboard Suite for the i.MX 8.This impressive multi-screen demo was a collaborative effort by NXP and Crank Software and included the following displays:
  • Digital Instrument Cluster
  • Head-up Display
  • In-Vehicle Infotainment
  • Backseat Entertainment

Thanks to the powerful i.MX 8, this demo was able to run four high-resolution screens at frame rates up to 60fps off one processor.

Integrating a mix of 2D and 3D content, the team was able to work collaboratively on the applications using Storyboard’s multi-file support, and seamlessly merge the project files and iterate the design throughout the lifecycle. The 3D models were created with high-fidelity detail to take advantage of the rich GPU capabilities of the i.MX 8.

 

To try Storyboard for your own automotive HMI projects, download a free 30-day trial.

StoryboardTrialBtn

*So Canadian of me

See Storyboard User Interface Demos on your Hardware

Storyboard Suite User Interface Demo Images

When working with any embedded platform it’s helpful to be able to quickly validate its capabilities and performance before investing the time and resources to create and deploy applications. Pre-built and packaged demos make it easy to test drive hardware with applications designed to its specifications.

Over the past several months we’ve been building a demo image library of application user interfaces created in Storyboard for a variety of platforms and hardware. Each demo image is built for a specific target with its unique capabilities, constraints, performance, and screen form factor in mind. The Storyboard user interface demos are packaged with simple instructions for getting the applications up and running on your target quickly.

Browse our library of Storyboard demos for platforms from NXP, STMicroelectronics, Atmel, and more. We will be adding new demos in the coming months, so check back often.

download

Here’s an example of one of the Storyboard demo images, a multi-market demo on the NXP i.MX 6QuadPlus:

Download a free 30-day trial to test drive Storyboard and create your own application UIs.

StoryboardTrialBtn

Adding 3D content to embedded UIs: Importing FBX models into Storyboard

3D elements add movement, dimension, and life to embedded applications. Aesthetics aside, they also enhance user experience and improve findability of information with a visual perspective that 2D graphics lack. As processors and GPUs evolve, embedded applications are becoming richer and 3D content more prevalent.

3d

We developed features for Storyboard Suite and a workflow that supports 3D artists, with the following in mind:

  1. Most designers already have 3D design tools that they are comfortable with and use regularly
  2. Designers want to be able to update their models in their 3D design software and easily re-add them to their project
  3. Designers may want to do minor tweaks to their 3D content in Storyboard after they’ve incorporated it into their application

Import FBX 3D models in Storyboard

With FBX 3D model import functionality, Storyboard allows designers to work in popular 3D design software that they already have familiarity with and can work efficiently in. A widely adopted industry standard, FBX models are imported into Storyboard with animations, textures, lighting, and other properties that make up the 3D model. The model isn’t static after the import. Designers can tweak the animations and make adjustments to fit their application.

Iterate until perfect

Iteration is a major part of UI design, and 3D content is no exception. Using the built-in simulator in Storyboard, designers can test their application with the imported 3D content and determine what changes need to be made to the underlying model. Updated models can be iteratively imported back into the Storyboard project until the team is happy with the final 3D content.

Change lighting and camera angles

When the designer is happy with the 3D model, they might want to make some tweaks and adjustments to things like animations, camera angles, and lighting to adjust how it behaves in the Storyboard application. These properties can be refined directly in Storyboard Designer, making it easy to create a well-integrated 3D/2D user experience.

Meet Ahren, a Crank Software 3D Designer

Ahren is a 3D designer here at Crank, working on Storyboard Suite applications that span automotive, medical, home automation, and other cool markets. Ahren chooses to work in Autodesk 3DS Max because it’s a tool he’s invested a lot of hours in, which means he can work in it efficiently and confidently. Having FBX 3D model support in Storyboard optimizes Ahren’s workflow. “It’s quick and easy to import. I can test the 3D content in Storyboard and update the model as needed. Textures, materials, and animations are all baked into the model which means the behavior is the same in the Storyboard application. I can also tweak lighting and camera angles directly in Storyboard until I am happy with it.”

Learn more about working with FBX 3D models in Storyboard from Fancy Dan in this awesome demo video.

If you aren’t using Storyboard yet, download a free 30-day trial and test-drive the functionality you learned about in this post.

StoryboardTrialBtn

Experience Storyboard GUI Demos at NXP FTF Technology Forum

Storyboard GUIs at NXP FTF Technology Forum

Crank Software will be well-represented at NXP FTF Technology Forum 2016 next week in Austin, Texas, May 16-19. We will be running a hands-on lab again this year, as well as showcasing demo GUIs and Storyboard Suite features and capabilities at the exhibition. If you are going to the show, here’s what you can expect to see.

Exhibition Hall – GUI Design Demos

Visit the Crank Software booths (151 & 154) to check out a wide range of application GUIs designed and developed with Storyboard Suite. We will also be demoing the latest enhancements and features in Storyboard Suite 4.2.

You’ll find innovative Storyboard Suite demos in a number of partner booths at the exhibition as well, including:

Crank Software & NXP booths will be showing Storyboard Suite GUI demos that span automotive, white goods, and lifestyle applications on a variety of NXP iMX family processors. Not to be missed is the impressive Movie Theatre Kiosk, an interactive demo built with Storyboard Suite, running on the high-performance NXP i.MX 6QuadPlus on Linux with OpenGL ES rendering.

Hands-on Learning Opportunity – Storyboard Suite Lab Session

If you’d rather learn by doing rather than watching, we will be teaching a hands-on lab again this year, so make sure you rearrange your busy schedule at the show to attend our session. You’ll get your hands dirty in the 2 hour classroom session, so bring your appetite for learning and try your best to stump the Crank instructor.

Hands-on Lab – The Evolution of Embedded GUI Design: From Photoshop to Crank Storyboard Suite to i.MX Series Hardware in Minutes (FTF-DES-N2034)

When: Tuesday, 4:45 PM
Where: Griffin Hall 5 – Level 2
What: In this session, users will: import design artwork directly into Storyboard Suite; add interactive functionality and rich animations; test in the simulator to quickly refine and update the design; and deploy a functioning application prototype directly to an i.MX platform. After completing this workshop, users will be able to import artwork directly from Photoshop into Storyboard Suite, develop a rich application GUI, and deploy to hardware.

We will be tweeting from the show, so be sure to follow @cranksoftware for updates.
The NXP FTF hastag this year is #NXPFTF.

If you haven’t taken Storyboard Suite for a test drive yet, download a 30-day free evaluation and start designing today.

StoryboardTrialBtn

 

See you at the show!

 

Storyboard Suite Automotive HMI demos at Car HMI USA 2016

Crank Software at Car HMI April 25-26

Over the next few months we will be attending several shows to showcase the latest features and functionality in Storyboard Suite 4.2, as well as a number of innovative, multi-market demos we’ve built that highlight the range of application GUIs that can be designed and developed with Storyboard.

First up is automotive with Car HMI USA 2016 next week in Detroit, April 25-26. If you plan to be at the show visit us to check out some automotive HMI demos we’ve built with Storyboard Suite. You’ll be able to touch and interact with the demos and chat with one of our UI designers about his experience using Storyboard Suite to bring his designs to life.

For examples of HMI applications designed with Storyboard Suite, check out the QNX Bentley Concept Car, the Mississippi State University EcoCAR, and demos we brought to CES 2016 earlier this year, including a digital instrument cluster that was part of the QNX Software Systems interactive command center, which showcased vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) technology.

If you aren’t going to the show, you can always download the 30-day trial and try your hand at making awesome automotive HMIs.

Storyboard Suite Free Trial