NVIDIA continues to spearhead AI tech developement and experiences with its latest announcements at COMPUTEX 2024. The company unveiled Project G-Assist, an AI assistant technology demo designed to provide context-aware help for PC games and apps. The demo showcased the technology’s potential in enhancing gameplay and streamlining creative workflows.
In addition, NVIDIA introduced the first PC-based NVIDIA NIM inference microservices for its ACE digital human platform. These microservices aim to bring high-quality AI inference to devices, enabling natural language understanding, speech synthesis, facial animation, and more.
Nvidia RTX AI Toolkit
NVIDIA also launched the RTX AI Toolkit, a suite of tools and SDKs designed to help developers optimize and deploy large generative AI models on Windows PCs. The toolkit aims to simplify the process of customizing, optimizing, and deploying AI models, making it easier for developers to create AI-powered applications.
New RTX AI PC Laptops
These announcements, along with the introduction of new RTX AI PC laptops from ASUS and MSI, highlight NVIDIA’s commitment to advancing AI capabilities on personal computers. The company’s advancements in AI technology are expected to significantly impact various industries, including gaming, content creation, and software development.
Windows Copilot Runtime to Add GPU Acceleration for Local PC SLMs
Microsoft and NVIDIA are joining forces to enhance Windows applications with generative AI capabilities. Developers will gain access to GPU-accelerated small language models (SLMs) through a simplified API, enabling features like content summarization, generation, and task automation.
Retrieval-augmented generation (RAG) capabilities will further empower SLMs by granting them access to domain-specific information, enhancing their understanding and responsiveness. Developers can leverage RAG APIs to fine-tune SLM behavior and capabilities using application-specific data sources.
NVIDIA RTX GPUs and other AI accelerators will ensure fast and efficient AI processing, delivering a seamless user experience across the Windows ecosystem. The API is set to be released in a developer preview later this year, opening up new possibilities for AI-powered Windows applications.
Nvidia SFF-Ready GeForce Card and Case Guideline
Nvidia has launched it SFF-Ready Enthusiast GeForce Cards guideline in partnership with various graphics cards and case manufacturers. Partner brand products will soon be updated with text labeling graphics cards that meet the guideline as “SFF-Ready Enthusiast GeForce Cards”, and cases as being “Compatible with SFF-Ready Enthusiast GeForce Cards”, instantly identifying parts that fit together and allowing you to buy and build with confidence.
Here’s a quick summary of the SFF-Ready GPU guidelines
- must be RTX 4070 or higher
- 151mm maximum height including power cable bend radius
- 304mm maximum length
- 50mm or 2.5-slots maximum depth
These guideline ensure there’s necessary space, clearance and working room inside SFF-Ready cases, and allow manufacturers to design compatible cases in the future, enabling you to upgrade your GPU without having to replace your system’s chassis. As of the announcement date, there are 36 GeForce RTX 40 Series enthusiast GPUs that meet the SFF-Ready guideline.
Grant is a Financial Management graduate from UST. His passion for gadgets and tech crossed him over in the industry where he could apply his knowledge as an enthusiast and in-depth analytic skills as a Finance Major. His passion allows him to earn at the same time help Gadget Pilipinas' readers in making smart, value-based decisions and purchases with his reviews and guides.
