Implementation:Open compass VLMEvalKit MovieChat1k

Field	Value
source	VLMEvalKit
domain	Vision, Benchmarking, Movie Understanding

Overview

Benchmark dataset implementation for MovieChat1k evaluation in VLMEvalKit.

Description

MovieChat1k inherits from VideoBaseDataset and implements the MovieChat1k benchmark for movie understanding evaluation. The TYPE field is set to 'Video-VQA'. It supports global and breakpoint subsets with configurable data limits.

Usage

Registered in vlmeval/dataset/__init__.py and invoked through build_dataset() by benchmark name.

Code Reference

Source: vlmeval/dataset/moviechat1k.py, Lines: L1-264
Import: from vlmeval.dataset.moviechat1k import MovieChat1k

Signature:

class MovieChat1k(VideoBaseDataset):
    TYPE = 'Video-VQA'
    DATASET_URL = {...}
    DATASET_MD5 = {...}
    ...

I/O Contract

Direction	Description
Inputs	TSV dataset file with image/video paths and questions
Outputs	Evaluation results DataFrame with scores per category

Usage Examples

from vlmeval.dataset import build_dataset
dataset = build_dataset('MovieChat1k')

Related Pages

Page Connections

Double-click a node to navigate. Hold to expand connections.

Principle

Implementation

Heuristic

Environment