Implementation:Triton inference server Server L0 Http Test
| Knowledge Sources | |
|---|---|
| Domains | Testing, HTTP_API |
| Last Updated | 2026-02-13 17:00 GMT |
Overview
QA test script for validating the HTTP endpoint in the Triton Inference Server.
Description
This is the comprehensive test suite for the Triton Inference Server's HTTP/REST endpoint. As the largest endpoint test at 913 lines, it covers the complete HTTP API surface including server health and readiness endpoints, model metadata and statistics, inference requests using both JSON and binary data formats, model repository management, shared memory registration and usage, response compression, request tracing via HTTP headers, custom header forwarding, and SSL/TLS configuration. The script tests various content types, chunked transfer encoding, request size limits, and HTTP-specific error responses. Each sub-test configures the server with relevant HTTP options, runs Python HTTP client tests, and validates both response correctness and HTTP protocol compliance including status codes and response headers.
Usage
Run as part of the Triton QA test suite to validate HTTP endpoint functionality. Typically executed in CI/CD pipelines within the Triton Docker container environment.
Code Reference
Source Location
- Repository: Triton Inference Server
- File: qa/L0_http/test.sh
- Lines: 1-913
Signature
#!/bin/bash
# Key functions and variables
source ../common/util.sh
SERVER=/opt/tritonserver/bin/tritonserver
SERVER_ARGS="--model-repository=${MODELDIR} --http-port=8000"
SERVER_LOG="./http_test.server.log"
CLIENT_LOG="./http_test.client.log"
HTTP_TEST="./http_test.py"
Import
# Sources common utilities
source ../common/util.sh
I/O Contract
Inputs
| Name | Type | Required | Description |
|---|---|---|---|
| DATADIR | env var | No | Directory containing test data |
| TRITON_DIR | env var | No | Path to Triton server installation |
| MODEL_REPO | directory | Yes | Generated test model repository |
| SSL_CERT | file | No | SSL certificate for TLS-enabled tests |
| SSL_KEY | file | No | SSL private key for TLS-enabled tests |
Outputs
| Name | Type | Description |
|---|---|---|
| exit code | int | 0 on success, 1 on failure |
| test logs | files | Server logs and test output in test directory |
Usage Examples
Running the Test
cd qa/L0_http/
bash test.sh