Implementation:Triton inference server Server L0 Cmdline Trace Test
| Knowledge Sources | |
|---|---|
| Domains | Testing, Tracing |
| Last Updated | 2026-02-13 17:00 GMT |
Overview
QA test script for validating command-line tracing functionality in the Triton Inference Server.
Description
This test validates the tracing subsystem activated via command-line arguments. It exercises trace collection, trace file output, trace level configuration, and trace rate limiting. The script starts the server with various trace-related command-line flags (such as --trace-file, --trace-rate, --trace-level, and --trace-count), sends inference requests, and then inspects the generated trace output files to verify correctness. It checks that trace records contain expected timestamps, span names, parent-child relationships, and that trace sampling rates and count limits are respected. The test also validates OpenTelemetry-compatible trace export and per-model trace settings.
Usage
Run as part of the Triton QA test suite to validate command-line tracing. Typically executed in CI/CD pipelines within the Triton Docker container environment.
Code Reference
Source Location
- Repository: Triton Inference Server
- File: qa/L0_cmdline_trace/test.sh
- Lines: 1-722
Signature
#!/bin/bash
# Key functions and variables
source ../common/util.sh
SERVER=/opt/tritonserver/bin/tritonserver
SERVER_ARGS="--model-repository=${MODELDIR} --trace-file=${TRACE_FILE} --trace-rate=${TRACE_RATE} --trace-level=${TRACE_LEVEL}"
SERVER_LOG="./cmdline_trace_test.server.log"
CLIENT_LOG="./cmdline_trace_test.client.log"
TRACE_FILE="./trace_output.json"
Import
# Sources common utilities
source ../common/util.sh
I/O Contract
Inputs
| Name | Type | Required | Description |
|---|---|---|---|
| DATADIR | env var | No | Directory containing test data |
| TRITON_DIR | env var | No | Path to Triton server installation |
| MODEL_REPO | directory | Yes | Generated test model repository |
Outputs
| Name | Type | Description |
|---|---|---|
| exit code | int | 0 on success, 1 on failure |
| test logs | files | Server logs and test output in test directory |
| trace files | JSON files | Trace output files containing span records |
Usage Examples
Running the Test
cd qa/L0_cmdline_trace/
bash test.sh