Implementation:Open compass VLMEvalKit SimpleVQA
| Field | Value |
|---|---|
| source | VLMEvalKit |
| domain | Vision, Benchmarking, Visual QA |
Overview
Benchmark dataset implementation for SimpleVQA evaluation in VLMEvalKit.
Description
SimpleVQA inherits from ImageBaseDataset and implements the SimpleVQA benchmark for straightforward visual question answering. The TYPE field is set to 'VQA'. It supports Direct, CoT, and PoT question answering modes.
Usage
Registered in vlmeval/dataset/__init__.py and invoked through build_dataset() by benchmark name.
Code Reference
- Source:
vlmeval/dataset/simplevqa.py, Lines: L1-210 - Import:
from vlmeval.dataset.simplevqa import SimpleVQA
Signature:
class SimpleVQA(ImageBaseDataset):
TYPE = 'VQA'
DATASET_URL = {...}
DATASET_MD5 = {...}
...
I/O Contract
| Direction | Description |
|---|---|
| Inputs | TSV dataset file with image/video paths and questions |
| Outputs | Evaluation results DataFrame with scores per category |
Usage Examples
from vlmeval.dataset import build_dataset
dataset = build_dataset('SimpleVQA')
Related Pages
Page Connections
Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment