Jump to content

Connect SuperML | Leeroopedia MCP: Equip your AI agents with best practices, code verification, and debugging knowledge. Powered by Leeroo — building Organizational Superintelligence. Contact us at founders@leeroo.com.

Implementation:Open compass VLMEvalKit BunnyLLama3

From Leeroopedia
Field Value
source VLMEvalKit
domain Vision, Model_Architecture

Overview

VLM adapter for the Bunny-Llama3 model enabling benchmark evaluation in VLMEvalKit.

Description

BunnyLLama3 inherits from BaseModel and wraps the Bunny-Llama3 model for use within the VLMEvalKit evaluation framework. It initializes the model and tokenizer/processor from a HuggingFace model path (default: BAAI/Bunny-v1_1-Llama-3-8B-V) and provides the generate_inner method for inference.

Usage

Register in vlmeval/config.py via supported_VLM and invoke through the standard evaluation pipeline.

Code Reference

  • Source: vlmeval/vlm/bunnyllama3.py, Lines: L1-133
  • Import: from vlmeval.vlm.bunnyllama3 import BunnyLLama3

Signature:

class BunnyLLama3(BaseModel):
    INSTALL_REQ = False
    INTERLEAVE = False
    def __init__(self, model_path='BAAI/Bunny-v1_1-Llama-3-8B-V', **kwargs): ...
    def generate_inner(self, message, dataset=None): ...

I/O Contract

Direction Description
Inputs message — list of dicts with type (text/image) and value; dataset — optional dataset name for custom prompting
Outputs generate_inner() returns str (model response text)

Usage Examples

from vlmeval.vlm.bunnyllama3 import BunnyLLama3
model = BunnyLLama3(model_path='path/to/model')
response = model.generate_inner(message)

Related Pages

Page Connections

Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment