Implementation:Open compass VLMEvalKit SArena MINI

Field	Value
source	VLMEvalKit
domain	Vision, Benchmarking, SVG Understanding

Overview

Benchmark dataset implementation for SArena MINI evaluation in VLMEvalKit.

Description

SArena_MINI inherits from ImageBaseDataset and implements the SArena MINI benchmark for SVG understanding and generation. The TYPE field is set to 'VQA'. It supports multiple task types including I2SVG generation and SVG editing.

Usage

Registered in vlmeval/dataset/__init__.py and invoked through build_dataset() by benchmark name.

Code Reference

Source: vlmeval/dataset/sarena_mini.py, Lines: L1-47
Import: from vlmeval.dataset.sarena_mini import SArena_MINI

Signature:

class SArena_MINI(ImageBaseDataset):
    TYPE = 'VQA'
    DATASET_URL = {...}
    DATASET_MD5 = {...}
    ...

I/O Contract

Direction	Description
Inputs	TSV dataset file with image/video paths and questions
Outputs	Evaluation results DataFrame with scores per category

Usage Examples

from vlmeval.dataset import build_dataset
dataset = build_dataset('SArena_MINI')

Related Pages

Page Connections

Double-click a node to navigate. Hold to expand connections.

Principle

Implementation

Heuristic

Environment