Implementation:Triton inference server Server L0 Grpc Test
| Knowledge Sources | |
|---|---|
| Domains | Testing, gRPC_API |
| Last Updated | 2026-02-13 17:00 GMT |
Overview
QA test script for validating the gRPC endpoint in the Triton Inference Server.
Description
This is the comprehensive test suite for the Triton Inference Server's gRPC endpoint. It exercises the full range of gRPC API functionality including server health checks, model metadata retrieval, model repository operations, inference requests with various data types and tensor shapes, streaming inference, shared memory regions (both system and CUDA), model loading/unloading, server readiness, and SSL/TLS configuration. The script also validates gRPC-specific features such as compression, keepalive settings, header forwarding, and response caching. Each sub-test starts the server with specific gRPC configurations, runs the corresponding Python gRPC client tests, and checks both inference correctness and protocol-level behavior.
Usage
Run as part of the Triton QA test suite to validate gRPC functionality. Typically executed in CI/CD pipelines within the Triton Docker container environment.
Code Reference
Source Location
- Repository: Triton Inference Server
- File: qa/L0_grpc/test.sh
- Lines: 1-687
Signature
#!/bin/bash
# Key functions and variables
source ../common/util.sh
SERVER=/opt/tritonserver/bin/tritonserver
SERVER_ARGS="--model-repository=${MODELDIR} --grpc-port=8001"
SERVER_LOG="./grpc_test.server.log"
CLIENT_LOG="./grpc_test.client.log"
GRPC_TEST="./grpc_test.py"
Import
# Sources common utilities
source ../common/util.sh
I/O Contract
Inputs
| Name | Type | Required | Description |
|---|---|---|---|
| DATADIR | env var | No | Directory containing test data |
| TRITON_DIR | env var | No | Path to Triton server installation |
| MODEL_REPO | directory | Yes | Generated test model repository |
| SSL_CERT | file | No | SSL certificate for TLS-enabled tests |
| SSL_KEY | file | No | SSL private key for TLS-enabled tests |
Outputs
| Name | Type | Description |
|---|---|---|
| exit code | int | 0 on success, 1 on failure |
| test logs | files | Server logs and test output in test directory |
Usage Examples
Running the Test
cd qa/L0_grpc/
bash test.sh