Nvidia already sells boatloads of computer chips to every major company building ownership artificial intelligence Model but now, at a moment when in public interest Open source And do-it-yourself AI is on the rise, with the company announcing that it will also start offering a “personal AI supercomputer” later this year, starting at $3,000, which anyone can use in their home or office.
Nvidia’s new desktop machine, dubbed the Digit, will go on sale in May and is about the size of a small book. It has an Nvidia “superchip” called the GB10 Grace Blackwell that is optimized to speed up the calculations needed to train and run AI models, and with 128GB of unified memory and up to 4TB of NVMe storage to handle particularly large AI programs. is equipped
Nvidia founder and CEO Jensen Huang announced the new system, along with several other AI offerings, during a keynote here today. CESAn annual confab for the computer industry held in Las Vegas (you can check out the biggest announcements at WIRED CES Live Blog).
“Having an AI supercomputer on the desk of every data scientist, AI researcher and student empowers them to engage and shape the age of AI,” Huang said in a statement released ahead of his keynote.
Nvidia says Digit Machine, which stands for “deep learning GPU intelligence learning system,” will be able to run a single large language model with 200 billion parameters, a rough measure of a model’s complexity and size. To do this today, you’d need to rent space from a cloud provider like AWS or Microsoft, or build a custom system with a handful of chips designed to run AI. If the two machines are connected using a proprietary high-speed interconnect link, Nvidia says they’ll be able to run The most capable An open source Llama model version of META is available, which has 405 billion parameters.
The numbers will make it easier for hobbyists and researchers to experiment with models that come close to the original capabilities OpenAI’s GPT-4 or Google’s Gemini In their offices or basements. But the best versions of those proprietary models, housed inside massive data centers owned by Microsoft and Google, are likely bigger as well as more powerful than anything that numbers can handle.
Nvidia has been one of the biggest beneficiaries The AI boom. Its stock price has skyrocketed in the past few years as tech companies clamor to buy large quantities of the advanced hardware chips it produces, a key ingredient in developing cutting-edge AI. The company has proven adept at optimizing hardware and software for AI, and its product roadmap has become an important indicator of where the industry is expected to go next.
When it is released, the Digit will be the most powerful consumer computing hardware Nvidia has to offer. It already sells a range of chipsets for AI development known as Jetson that start at around $250. These can run small AI models and can either be used like a mini desktop computer or installed on a robot to test various AI programs.