I am trying to run deepstream on google virtual machine with ubuntu 22.04.
After deepstream installation I tried to run deepstream sample application. Following error was raised. How to resolve that?
rajana.k.samarakoon@instance-20250722-020309:/opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app$ deepstream-app -c source30_1080p_dec_infer-resnet_tiled_display_int8.txt
WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1152 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app/../../models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b30_gpu0_int8.engine open error
0:00:00.292739457 17811 0x59652f0c9a40 WARN nvinfer gstnvinfer.cpp:681:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2080> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app/../../models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b30_gpu0_int8.engine failed
0:00:00.292771830 17811 0x59652f0c9a40 WARN nvinfer gstnvinfer.cpp:681:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2185> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app/../../models/Primary_Detector/resnet18_trafficcamnet_pruned.onnx_b30_gpu0_int8.engine failed, try rebuild
0:00:00.292790834 17811 0x59652f0c9a40 INFO nvinfer gstnvinfer.cpp:684:gst_nvinfer_logger:<primary_gie> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2106> [UID = 1]: Trying to create engine from model files
WARNING: [TRT]: Unable to determine GPU memory usage: In getGpuMemStatsInBytes at common/extended/resources.cpp:1097
WARNING: [TRT]: Unable to determine GPU memory usage: In getGpuMemStatsInBytes at common/extended/resources.cpp:1097
terminate called after throwing an instance of ‘nvinfer1::APIUsageError’
what(): CUDA initialization failure with error: 35. Please check your CUDA installation: CUDA Installation Guide for Linux — Installation Guide for Linux 13.0 documentation In checkCudaInstalledAndPrintMemoryUsage at optimizer/api/builder.cpp:1238
Aborted (core dumped)
Following details will help to give a suitable solution,
rajana.k.samarakoon@instance-20250722-020309:/opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app$ dpkg -l | grep nvidia-driver
ii nvidia-driver-575-open 575.57.08-0ubuntu1 amd64 NVIDIA driver (open kernel) metapackage
rajana.k.samarakoon@instance-20250722-020309:/opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app$ nvidia-smi
Wed Aug 20 10:25:21 2025
±----------------------------------------------------------------------------------------+
| NVIDIA-SMI 575.57.08 Driver Version: 575.57.08 CUDA Version: 12.9 |
|-----------------------------------------±-----------------------±---------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 Tesla T4 On | 00000000:00:04.0 Off | 0 |
| N/A 49C P8 13W / 70W | 117MiB / 15360MiB | 0% Default |
| | | N/A |
±----------------------------------------±-----------------------±---------------------+±----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 2026 G /usr/lib/xorg/Xorg 108MiB |
| 0 N/A N/A 2118 G /usr/bin/gnome-shell 7MiB |
±----------------------------------------------------------------------------------------+
rajana.k.samarakoon@instance-20250722-020309:/opt/nvidia/deepstream/deepstream-7.1/samples/configs/deepstream-app$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2025 NVIDIA Corporation
Built on Fri_Feb_21_20:23:50_PST_2025
Cuda compilation tools, release 12.8, V12.8.93
Build cuda_12.8.r12.8/compiler.35583870_0