Hardware Platform (1xA100) System Memory (164Gi) Ubuntu Version (Ubuntu 22.04.5 LTS) NVIDIA GPU Driver Version (535.183.06) Issue Type( questions, new requirements, bugs) I am trying to deploy the VSS 2.3.0, as in Remote LLM Deployment When I activate guardrails export DISABLE_GUARDRAILS=false v…

I’ve just identified the root cause of this behavior. I attempted to switch the deployment from graph-rag to vector-rag chat in the config.yaml: rag: graph-rag # graph-rag or vector-rag params: batch_size: 1 top_k: 5 However, the same error continued to occur. After a closer inspection…

VSS 2.3.0 Docker remote_llm_deployment GUARDRAILS [429] Too Many Requests

Accelerated Computing Intelligent Video Analytics Visual AI Agent

yuweiw May 22, 2025, 2:21am 3

In your previous topic 333902, was the deployment successful in the end?

Topic		Replies	Views
VSS local deployment single gpu: Failed to load VIA stream handler - Guardrails / CA-RAG setup failed Visual AI Agent nim , llama-31-8b-instruct , llama	4	80	July 4, 2025
Using non-nvidia external endpoints on custom deployment Visual AI Agent	13	140	June 12, 2025
401 unauthorized access Visual AI Agent nim , llama-31-70b-instruct , llama	12	141	April 28, 2025
VSS 2.3.0 Docker remote_llm_deployment Failed to generate TRT-LLM engine Visual AI Agent nim , paligemma , kosmos-2 , llama	5	76	May 23, 2025
VSS FAQ Visual AI Agent	8	329	July 1, 2025
Error deploying VSS blueprint Visual AI Agent nim , llama	3	84	March 10, 2025
VSS Installation problem Visual AI Agent	11	161	February 21, 2025
VSS Custom deployment docker compose build failure Visual AI Agent	9	133	May 27, 2025
Error with Nvidia VSS blueprint - nemo-rerank-ranking-deployment Visual AI Agent nvbugs	15	174	February 27, 2025
Unable to configure gpt-4o with VSS instead of vila using Openai-azure API key Visual AI Agent nim	2	41	April 21, 2025

VSS 2.3.0 Docker remote_llm_deployment GUARDRAILS [429] Too Many Requests

Related topics