Implementation:ArroyoSystems Arroyo Test Input Data
| Knowledge Sources | |
|---|---|
| Domains | Testing, SQL, TestData |
| Last Updated | 2026-02-08 08:00 GMT |
Overview
JSON-lines input data files consumed by the Arroyo SQL smoke test harness to feed test pipelines with realistic streaming data.
Description
The inputs/ directory contains source data files referenced by SQL test queries via the $input_dir variable. These files simulate various streaming data scenarios used to exercise different SQL operators, window functions, and data formats.
Files
| File | Lines | Description |
|---|---|---|
| aggregate_updates.json | 830 | Debezium CDC-format records from a PostgreSQL orders table. Contains before/after objects with op codes (c/u/d) plus full source metadata (connector, db, schema, table, lsn). Fields include id, customer_name, product_name, quantity, price, order_date, and status. |
| cars.json | 7932 | Ride-sharing event data with timestamp, driver_id (integer), event_type (e.g. "pickup"), and location (San Francisco neighborhoods like "Yerba Buena", "FiDi", "Bayview"). Timestamps span from 2023-09-18T14:23:10Z onward. |
| nexmark_bids.json | 11793 | Nexmark benchmark bid events with auction ID, bidder ID, price (integer cents), channel, URL, datetime, and an extra padding string. Used for benchmark-style streaming SQL tests. |
| sorted_cars.json | 77658 | A larger, time-sorted version of the cars dataset with higher driver_id values (1000+). Same schema as cars.json but with approximately 10x more records, suitable for windowed aggregation tests like most_active_driver_last_hour. |
Data Format
All files use JSON-lines format (one JSON object per line). SQL test queries reference these files using local filesystem connectors with the $input_dir path substitution. The test harness (in smoke_tests.rs) replaces this variable with the actual filesystem path at runtime.
Code Reference
Source Location
- Repository: ArroyoSystems_Arroyo
- Directory: crates/arroyo-sql-testing/inputs/
Related Pages
Page Connections
Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment