Ambarella, an edge AI semiconductor company, has revealed its full autonomous driving (AD) software stack.
The stack is primarily based on deep learning AI processing for all of its modular components, including environmental perception, sensor fusion and vehicle path planning. It was designed in conjunction with the company’s CV3-AD AI domain controller SoC to ensure it runs optimally on the SoC’s CVflow AI engines – minimizing power consumption and the processing load for its on-chip Arm cores. The SoCs also provide optimal processing for vision and radar sensing and fusion, while Ambarella’s stack more broadly offers a flexible implementation model, enabling OEMs to leverage any or all of its modules in combination with their own software.
A key feature of the AI-based software stack highlighted by Ambarella is its deep-learning-based planner, a dynamic vehicle path planning module that enables a more natural driving experience. In developing and refining this functionality, Ambarella leveraged its evolving R&D vehicle fleet which allowed the deep planner module to be trained with data based on a wide variety of real-world scenarios. The latest vehicles in this fleet are equipped with a sensing suite consisting of mono and stereo cameras, as well as Ambarella’s Oculii 4D imaging radar, with the CV3-AD processing the data sent from these sensors. While highlighting this configuration, Ambarella noted that its solutions are flexible to support OEM’s specific sensing suites (including the option for adding LiDAR).
Another feature of the stack highlighted by Ambarella was its requirement of standard-definition maps, eliminating the need for pre-generated HD maps. Here, HD maps are generated in real time using live environmental data fed from the sensing suite. This capability offers support in handling difficult AD scenarios, such as downtown areas in large cities with roundabouts, narrow roads with parked vehicles, heavy traffic, construction, and a high density of pedestrians, cyclists and other vulnerable road users.
The CV3-AD SoCs run Ambarella’s entire AD stack with enhanced power consumption, AI performance per watt, and simplified thermal management. The company said that, because its software and hardware are designed to work optimally together, OEMs can sufficiently integrate additional software to create differentiated features, including those for functional safety.
