On Tuesday, NVIDIA's CEO Jensen Huang introduced the Jetson Orin Nano, a new compact AI computer designed for robotics and on-device AI processing. This small yet powerful device offers a substantial 70 TOPS (INT8) of computing performance and is equipped with advanced features to support large language models (LLMs). The Jetson Orin Nano is priced at $249 and provides 102GB/s of memory bandwidth while operating on a mere 25 watts of power.
Huang showcased the Jetson Orin Nano in a video, highlighting its compact size, which is small enough to fit in the palm of a hand. He emphasized the evolution of NVIDIA's processors, starting with Xavier, and the company's vision for robotics. The Nano is a continuation of this vision, aiming to power a variety of robots, from wheeled to humanoid.
The CEO pointed out that the Jetson Orin Nano is capable of running the same applications as the larger HGX platform, including CUDA and CUDANN, and TensorRT. This versatility makes it suitable for a range of uses, from robots to workstations. Huang expressed excitement for the potential of the Jetson Orin Nano to foster innovation in robotics and AI.
With its ability to run large language models and support for NVIDIA's suite of AI and robotics software, the Jetson Orin Nano is positioned as an accessible yet powerful tool for developers and researchers. Huang's announcement indicates that the device is widely available for purchase, encouraging enthusiasts and professionals alike to explore the capabilities of this new AI computer.
NVIDIA's latest offering reflects the company's ongoing commitment to advancing AI and robotics technology. The Jetson Orin Nano is set to enable a new level of creativity and development in the field, with its high performance, low power consumption, and affordability.