Implementation:Open compass VLMEvalKit LFM2VL
| Field | Value |
|---|---|
| source | VLMEvalKit |
| domain | Vision, Model_Architecture |
Overview
VLM adapter for the LFM2-VL (Liquid Foundation Model) model enabling benchmark evaluation in VLMEvalKit.
Description
LFM2VL inherits from BaseModel and wraps the LFM2-VL (Liquid Foundation Model) model for use within the VLMEvalKit evaluation framework. It initializes the model and tokenizer/processor from a HuggingFace model path (default: model_path (required)) and provides the generate_inner method for inference. Uses flash_attention_2 for efficient inference.
Usage
Register in vlmeval/config.py via supported_VLM and invoke through the standard evaluation pipeline.
Code Reference
- Source:
vlmeval/vlm/liquid.py, Lines: L1-85 - Import:
from vlmeval.vlm.liquid import LFM2VL
Signature:
class LFM2VL(BaseModel):
INSTALL_REQ = False
INTERLEAVE = False
def __init__(self, model_path='model_path (required)', **kwargs): ...
def generate_inner(self, message, dataset=None): ...
I/O Contract
| Direction | Description |
|---|---|
| Inputs | message — list of dicts with type (text/image) and value; dataset — optional dataset name for custom prompting |
| Outputs | generate_inner() returns str (model response text) |
Usage Examples
from vlmeval.vlm.liquid import LFM2VL
model = LFM2VL(model_path='path/to/model')
response = model.generate_inner(message)