Nvidia introduces Jetson Orin Nano Super, a compact generative AI supercomputer


Nvidia unveiled a new compact artificial intelligence (AI) supercomputer on Tuesday. Dubbed the Jetson Orion Nano Super, it is the successor to the Jetson Orion Nano which was launched in March 2023. The tech giant claimed that the new AI hardware offers better performance, software upgrades and a lower price than its predecessor. The AI ​​Computer is available as a developer kit, and the company said it could be useful to developers, hobbyists, and students who want to learn and create AI-based tools.

nvidia jetson orin nano super launched

In a blog post, Nvidia detailed its latest AI computer. It was also shown in a video by CEO Jensen Huang. The Jetson Orin Nano Super is a palm-sized robotics processor optimized for running AI inference, building large language model (LLM) tools, and even robotics workflows. The price of the AI ​​computer is $249 (approximately Rs 21,150). Notably, the latest processor is priced lower than its predecessor which was priced at $499 (approximately Rs 42,380).

The new AI processor is said to deliver a 1.7x increase in generative AI inference performance. Nvidia claimed it delivered a 70 percent increase in performance, up to 67 8-bit integer tera operations per second (INT8 TOPS) compared to last year’s processor. Additionally, the memory bandwidth is also said to be increased to 102GBps, which is 50 percent more than its predecessor.

Apart from hardware improvements, the tech giant is also adding software updates to the AI ​​supercomputer, which is said to further optimize its performance. Nvidia said it is proficient in creating AI computer retrieval-augmented generation-based chatbots that leverage LLM, building visual AI agents, or deploying AI-powered robots.

The main advantage of the Nvidia Jetson Orin Nano Super compared to other AI PCs is that it can handle foundation models and allows developers to create tools and agents that are diverse and can be used for general purposes.

Along with the developer kit, the company is offering the Jetson Orin Nano 8GB system-on-module (SoM) and a reference carrier board. SOM features an Nvidia Ampere architecture GPU with Tensor cores and a six-core ARM CPU. The processor can also support up to four cameras to work with AI vision models.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *