NVIDIA Launches ‘Chat with RTX’: Local AI Chatbot Harnessing Personal Data

NVIDIA has recently launched a noteworthy AI chatbot, Chat with RTX, that operates directly on users’ PCs, offering access to personal files and documents for tailored responses. 

This locally-run chatbot utilizes open-source language models like Mistral or Llama 2, swiftly analysing local data to provide relevant answers and insights.

Also Read: NVIDIA CEO Jensen Huang Urges Nations to Prioritize Sovereign AI at Summit

Users can engage Chat with RTX with queries or tasks, prompting it to delve into their data for responses. The chatbot’s functionality extends to handling various file formats, including .txt, .pdf, .doc/.docx, and .xml, enabling seamless integration of diverse content into the chatbot’s dataset.

Moreover, one standout feature of Chat with RTX is its integration with YouTube videos and playlists into its knowledge base. By incorporating insights from video content, the chatbot enhances its contextual understanding, offering recommendations and summaries based on influencer videos or educational resources.

Must Read: Nvidia Hits Record High: Shares Up By 216% Over The Past Year

Early hands-on experience with the chatbot expressed positive impressions, with The Verge noting its potential for aiding data research, particularly for journalists and individuals analyzing document collections. Its ability to process sensitive data locally without reliance on cloud services ensures enhanced privacy and contextual awareness.

However, certain limitations exist, including potential bugs inherent in a demo product. NVIDIA aims to address these issues through user feedback and updates. Additionally, hardware requirements restrict Chat with RTX to Windows PCs equipped with NVIDIA GeForce RTX 30 Series GPUs or higher and at least 8GB of VRAM.

NVIDIA’s introduction of Chat with RTX reflects the company’s continued focus on AI innovation. With recent launches of next-generation AI supercomputer chips, NVIDIA solidifies its position as a leader in AI and data center technology, driving significant profits through advancements in these segments.

Also Read: AI Advancements: Microsoft Introduces Enhanced Copilot at Super Bowl