Implementation:Open compass VLMEvalKit VXVERSE
| Field | Value |
|---|---|
| source | VLMEvalKit |
| domain | Vision, Model_Architecture |
Overview
VLM adapter for the XVERSE-V model enabling benchmark evaluation in VLMEvalKit.
Description
VXVERSE inherits from BaseModel and wraps the XVERSE-V model for use within the VLMEvalKit evaluation framework. It initializes the model and tokenizer/processor from a HuggingFace model path (default: model_name='XVERSE-V-13B', root (required)) and provides the generate_inner method for inference. Uses LoRA adaptation with a CLIP vision encoder and XVERSE-13B-Chat language model.
Usage
Register in vlmeval/config.py via supported_VLM and invoke through the standard evaluation pipeline.
Code Reference
- Source:
vlmeval/vlm/vxverse.py, Lines: L1-130 - Import:
from vlmeval.vlm.vxverse import VXVERSE
Signature:
class VXVERSE(BaseModel):
INSTALL_REQ = True
INTERLEAVE = False
def __init__(self, model_path='model_name='XVERSE-V-13B', root (required)', **kwargs): ...
def generate_inner(self, message, dataset=None): ...
I/O Contract
| Direction | Description |
|---|---|
| Inputs | message — list of dicts with type (text/image) and value; dataset — optional dataset name for custom prompting |
| Outputs | generate_inner() returns str (model response text) |
Usage Examples
from vlmeval.vlm.vxverse import VXVERSE
model = VXVERSE(model_path='path/to/model')
response = model.generate_inner(message)