Implementation:Open compass VLMEvalKit CGAVCounting Utils
| Field | Value |
|---|---|
| source | VLMEvalKit |
| domain | Vision, Benchmarking, Video Counting Utilities |
Overview
Utility module providing scoring, timestamp parsing, and evaluation helper functions for the CG-AV-Counting benchmark in VLMEvalKit.
Description
This utility file does not define a dataset class. It provides helper functions including rating_func for computing evaluation metrics (accuracy, OBOA, MAE, RMSE) across different task modes (long_acc, ref_acc, clue_acc), timestamp conversion utilities, and timeout handling for the CGAVCounting benchmark evaluation pipeline.
Usage
Imported by vlmeval/dataset/CGAVCounting/cg_av_counting.py via wildcard import to support the CGAVCounting dataset evaluation.
Code Reference
- Source:
vlmeval/dataset/CGAVCounting/utils.py, Lines: L1-422 - Import:
from vlmeval.dataset.CGAVCounting.utils import *
Key Functions:
def rating_func(data_path):
...
def get_timestampes(frame_indices, fps):
...
def time_str_to_seconds(time_str: str) -> float:
...
I/O Contract
| Direction | Description |
|---|---|
| Inputs | Data path to evaluation results, frame indices and FPS values |
| Outputs | Rating dictionaries with metric scores, formatted timestamp strings |
Related Pages
Page Connections
Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment