CES 2025, Las Vegas – NVIDIA announced foundation models running locally on NVIDIA RTX AI PCs that help digital humans, content creation, productivity, and development.
These AI foundation models for RTX AI PCs include a new wave of low-code and no-code tools like Anything LLM, ComfyUI, and UI Studio that enable enthusiasts to use AI models in complex workflows via simple graphical user interfaces.
NIM microservices connect to these GUIs will make it effortless to access and deploy the latest generative AI models. NVIDIA AI Blueprints, built on NIM microservices, provide easy-to-use preconfigured reference workflows for digital humans, content creation, and more.
To meet the growing demand from AI developers and enthusiasts, every top PC manufacturer and system builder is watching NIM-ready RTX AI PCs.
“AI is advancing at light speed, from perception AI to generative AI and now agentic AI,” said Jensen Huang, founder and CEO of NVIDIA. “NIM microservices and AI Blueprints give PC developers and enthusiasts the building blocks to explore the magic of AI.”
NVIDIA RTX AI PCs – AI Foundation Models
The company will release a pipeline of NIM microservices for RTX AI PCs from top model developers like Black Forest Labs, Meta, Mistral, and Stability AI. Use cases span large language models (LLMs), vision language models, image generation, speech, embedding models for retrieval-augmented generation (RAG), PDF extraction, and computer vision.
NVIDIA also announced the Llama Neotron family of open models that provide high accuracy on a wide of agentic tasks. The Llama Nemotron Nano model will be offered as a microservice for RTX AI PCs and workstations, and excels at agentic AI tasks like instruction following, function calling, chat, coding,,and math.
NIM microservices include the key components from running AI on PCs and are optimized for deployment across NVIDIA GPUs – whether in RTX PCs and workstations or in the cloud.
Developers and enthusiasts will be able to quickly download, set up, and run these NIM microservices on Windows 11 PCs with Windows Subsystem for Linux (WSL).
NIM microservices running on RTX AI PCs will be compatible with top AI development and agent frameworks, including AI Toolkit for VSCode, Anything LLM, ComfyUI, CrewAI, Flowise AI, LangChain, Langflow, and LM Studio.
AI Blueprints Coming to PC
NIM microservices are also available to PC users through AI Blueprints – reference AI workflows that can run locally on RTX PCs. With these blueprints, developers can create podcasts from documents, generate images guided by 3D scenes, and more.
The blueprint for PDF to podcast extracts text, images, and tables from a PDF to create a podcast script that can be edited by users. It can also generate a full audio recording from the script using voices available in the blueprint or based on a user’s voice sample. Moreover, you can have a real-time conversation with the AI podcast host to learn more about specific topics.
The blueprint uses NIM microservices like Mistral-Nemo-12B-Instruct for language, NVIDIA Riva for text-to-speech and automatic speech recognition, and the NeMo Retriever collection of microservices for PDF extraction.
NVIDIA NIM microservices and AI Blueprints will be available starting in February. NIM-ready RTX AI PCs will be available from Acer, ASUS, Dell, GIGABYTE, HP, Lenovo, MSI, Razer, and Samsung.
To learn more about NIM microservices and AI Blueprint, join NVIDIA at CES.
Photo: NVIDIA
Ram found his love and appreciation for writing in 2015 having started in the gaming and esports sphere for GG Network. He would then transition to focus more on the world of tech which has also began his journey into learning more about this world. That said though, he still has the mentality of "as long as it works" for his personal gadgets.
