Implementation:Open compass VLMEvalKit MiniCPM V

Field	Value
source	VLMEvalKit
domain	Vision, Model_Architecture

Overview

VLM adapter for the MiniCPM-V model enabling benchmark evaluation in VLMEvalKit.

Description

MiniCPM_V inherits from BaseModel and wraps the MiniCPM-V model for use within the VLMEvalKit evaluation framework. It initializes the model and tokenizer/processor from a HuggingFace model path (default: openbmb/MiniCPM-V) and provides the generate_inner method for inference. Also includes MiniCPM_Llama3_V, MiniCPM_V_2_6, MiniCPM_o_2_6, MiniCPM_V_4, and MiniCPM_V_4_5 adapter classes for the MiniCPM-V model family.

Usage

Register in vlmeval/config.py via supported_VLM and invoke through the standard evaluation pipeline.

Code Reference

Source: vlmeval/vlm/minicpm_v.py, Lines: L1-1271
Import: from vlmeval.vlm.minicpm_v import MiniCPM_V

Signature:

class MiniCPM_V(BaseModel):
    INSTALL_REQ = False
    INTERLEAVE = False
    def __init__(self, model_path='openbmb/MiniCPM-V', **kwargs): ...
    def generate_inner(self, message, dataset=None): ...

I/O Contract

Direction	Description
Inputs	message — list of dicts with type (text/image) and value; dataset — optional dataset name for custom prompting
Outputs	generate_inner() returns str (model response text)

Usage Examples

from vlmeval.vlm.minicpm_v import MiniCPM_V
model = MiniCPM_V(model_path='path/to/model')
response = model.generate_inner(message)

Related Pages

Page Connections

Double-click a node to navigate. Hold to expand connections.

Principle

Implementation

Heuristic

Environment