Implementation:Open compass VLMEvalKit OlmOCRBench RepeatDetect

Field	Value
source	VLMEvalKit
domain	Vision, Benchmarking, OCR, Repetition Detection

Overview

Benchmark dataset implementation for olmOCRBench evaluation in VLMEvalKit.

Description

This utility file does not define a dataset class. It provides the RepeatDetector class for detecting repeated n-gram patterns in OCR output text, along with RepeatDetectorTest and BenchmarkRepeatDetect unittest classes for validation and benchmarking.

Usage

Registered in vlmeval/dataset/__init__.py and invoked through build_dataset() by benchmark name.

Code Reference

Source: vlmeval/dataset/olmOCRBench/repeatdetect.py, Lines: L1-175
Import: from vlmeval.dataset.olmOCRBench.repeatdetect import RepeatDetector

Signature:

class RepeatDetector(N/A):
    TYPE = 'N/A'
    DATASET_URL = {...}
    DATASET_MD5 = {...}
    ...

I/O Contract

Direction	Description
Inputs	TSV dataset file with image/video paths and questions
Outputs	Evaluation results DataFrame with scores per category

Usage Examples

from vlmeval.dataset import build_dataset
dataset = build_dataset('N/A')

Related Pages

Page Connections

Double-click a node to navigate. Hold to expand connections.

Principle

Implementation

Heuristic

Environment