ChatRTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, or other data. Leveraging retrieval-augmented generation (RAG), TensorRT-LLM, and RTX acceleration, you can query a custom chatbot to quickly get contextually relevant answers. And because it all runs locally on your Windows RTX PC or workstation, you’ll get fast and secure results.
https://www.nvidia.com/en-us/ai-on-rt...
System Requirements:
Platform - Windows
GPU - NVIDIA GeForce™ RTX 30 or 40 Series GPU or NVIDIA RTX™ Ampere or Ada Generation GPU with at least 8GB of VRAM
RAM - 16GB or greater
OS - Windows 11
Driver - 535.11 or later
File Size - 35GB
CHAPTERS
--------------
0:15 – System Requirements
0:30 – Demo, Llama 2 13B
0:42 – Hi, how are you test
0:50 – What’s a Large Language Model (LLM) Test
#iwork4dell #NVIDIA #ChatRTX #LLM