7.[Network Ports]The network ports used in the VSS deployment
During the VSS deployment, there may be issues with port conflicts. It is recommended to first use the netstat tools to check the current port usage.
$sudo apt install net-tools $sudo netstat -tuln The following are some of the default network ports of VSS.
- Deploy Using Helm
The network ports are all allocated internally by the k8s, and then mapped to the host. We only need to focus on the mapping of the two ports, backend port and frontend port. You can get that though the command below.
sudo microk8s kubectl get svc vss-service - Deploy Using Docker Compose
The local network ports are used in this mode directly. The default port usage is as follows.
LLM NIM: 8000
Reranker NIM: 9235
Embedding NIM: 9234
FRONTEND_PORT: 9100
BACKEND_PORT: 8100
If you modify the network default ports, please make the corresponding modification in the relevant files like local_deployment/config.yaml and local_deployment/guardrails/config.yml.