Implementation:EvolvingLMMs Lab Lmms eval Sample MCP Server

• • File**: `/tmp/kapso_repo_sslb_59s/examples/mcp_server/sample_mcp_server.py`

• • Principle**: MCP_Tool_Integration

1. 1. Overview

The Sample MCP Server demonstrates basic MCP tool implementations with three example tools: image zoom/crop, weather query, and blank image generation. It serves as a template for creating custom MCP tools and shows various return types and parameter patterns.

1. 1. Key Components

1. 1. 1. 1. Server Initialization

```python app = FastMCP("demo") ``` Creates a minimal FastMCP application named "demo" (version omitted, defaults to None).

1. 1. 1. 2. Tool Implementations

1. 1. 1. 1. image_zoom_in_tool

```python @app.tool(name="image_zoom_in_tool", description="Zoom in on a specific region of an image by cropping it based on a bounding box (bbox) and an optional object label.") def image_zoom_in_tool(image_path: str, bbox: List[float]): ```

• • Purpose**: Crops a region from an image based on bounding box coordinates

• • Parameters**:

- `image_path` (str): Path to the input image file - `bbox` (List[float]): Bounding box coordinates [x_min, y_min, x_max, y_max]

• • Returns**: ImageContent with base64-encoded PNG

• • Implementation**:

```python image = Image.open(image_path) cropped_image = image.crop(bbox)

image_bytes = io.BytesIO() cropped_image.save(image_bytes, format="PNG") image_bytes.seek(0) png = base64.b64encode(image_bytes.getvalue()).decode("utf-8")

return ImageContent(type="image", data=png, mimeType="image/png") ```

• • Key Operations**:

1. Opens image using PIL 2. Crops using bbox coordinates (left, upper, right, lower) 3. Encodes cropped image to PNG in memory 4. Base64 encodes for transmission 5. Wraps in ImageContent with proper MIME type

1. 1. 1. 1. get_weather

```python @app.tool(name="weather", description="query weather") def get_weather(city: str): ```

• • Purpose**: Demonstrates a simple text-based tool with predefined data

• • Parameters**:

- `city` (str): City name to query weather for

• • Returns**: Dict with weather information (temp, condition) or error message

• • Implementation**:

```python weather_data = {"Beijing": {"temp": 25, "condition": "Rainy"}, "Shanghai": {"temp": 28, "condition": "Cloudy"}} result = weather_data.get(city, {"error": "未找到该城市"}) return result ```

• • Key Operations**:

1. Hardcoded weather data for two cities 2. Lookup by city name 3. Returns error dict if city not found (Chinese message: "City not found")

1. 1. 1. 1. get_blank_image

```python @app.tool(name="get_blank_image", description="get blank image") def get_blank_image(width: int = 512, height: int = 512): ```

• • Purpose**: Generates a blank white image of specified dimensions

• • Parameters**:

- `width` (int): Image width in pixels (default: 512) - `height` (int): Image height in pixels (default: 512)

• • Returns**: ImageContent with base64-encoded PNG

• • Implementation**:

```python image = Image.new("RGB", (width, height), color=(255, 255, 255)) image_bytes = io.BytesIO() image.save(image_bytes, format="PNG") image_bytes.seek(0) png = base64.b64encode(image_bytes.getvalue()).decode("utf-8") return ImageContent(type="image", data=png, mimeType="image/png") ```

• • Key Operations**:

1. Creates new RGB image with white background 2. Saves to in-memory buffer as PNG 3. Base64 encodes image data 4. Wraps in ImageContent for MCP protocol

1. 1. 1. 3. Server Entry Point

```python if __name__ == "__main__":

   app.run()

``` Launches the MCP server when script is executed.

1. 1. Dependencies

- `base64`: For encoding images to base64 - `io`: For in-memory byte buffers (BytesIO) - `typing`: For type annotations (List) - `mcp.server.fastmcp`: FastMCP framework - `mcp.types`: MCP content types (ImageContent) - `PIL.Image`: For image creation and manipulation

1. 1. Tool Patterns

1. 1. 1. Image Processing Tools

Both `image_zoom_in_tool` and `get_blank_image` demonstrate the pattern for image-returning tools: 1. Generate or process image using PIL 2. Save to BytesIO buffer as PNG 3. Base64 encode the bytes 4. Wrap in ImageContent with MIME type

1. 1. 1. Data Lookup Tools

The `get_weather` tool shows a simple lookup pattern: 1. Maintain static data structure 2. Lookup by key 3. Return dict with result or error 4. Can be extended with API calls or database queries

1. 1. Usage Examples

1. 1. 1. Starting the Server

```bash python examples/mcp_server/sample_mcp_server.py ```

1. 1. 1. Invoking Tools

```python from lmms_eval.mcp.client import MCPClient

client = MCPClient("examples/mcp_server/sample_mcp_server.py")

1. Get available tools

functions = client.get_function_list_sync()

1. Crop image region

result1 = client.run_tool_sync("image_zoom_in_tool", {

   "image_path": "/path/to/image.jpg",
   "bbox": [100, 100, 300, 300]

})

1. Query weather

result2 = client.run_tool_sync("weather", {

   "city": "Beijing"

})

1. Generate blank canvas

result3 = client.run_tool_sync("get_blank_image", {

   "width": 1024,
   "height": 768

}) ```

1. 1. Design Decisions

1. **Minimal Server Setup**: No version or complex config to keep example simple 2. **Diverse Tool Types**: Shows both image and text return types 3. **Default Parameters**: `get_blank_image` demonstrates optional params with defaults 4. **Static Data**: Weather tool uses hardcoded data for simplicity 5. **Standard Image Format**: PNG chosen for lossless quality and broad support

1. 1. Extension Points

This server can be extended by: 1. Adding database or API calls to `get_weather` 2. Implementing more image transformations (rotate, filter, etc.) 3. Adding error handling for invalid image paths 4. Validating bbox coordinates 5. Supporting additional image formats 6. Adding authentication/authorization

1. 1. Comparison with crop_video_mcp_server

| Aspect | sample_mcp_server | crop_video_mcp_server | |--------|-------------------|----------------------| | Complexity | Simple examples | Production-ready tool | | Validation | Minimal | Comprehensive | | Logging | None | Extensive | | Error Handling | Basic | Detailed with context | | Documentation | Sparse | Complete docstrings | | Use Case | Learning/template | Actual video processing |

1. 1. Related Components

- Crop_Video_MCP_Server: More complex MCP server example - MCP_Client: Client for invoking these tools - Media_Handling: Framework's built-in media processing

1. 1. Best Practices Demonstrated

1. Clear tool names and descriptions for LLM consumption 2. Type annotations for all parameters 3. Consistent return type patterns (ImageContent for images) 4. Default parameter values where appropriate 5. Simple, focused tool implementations 6. Standard image encoding approach

1. 1. Common Use Cases

1. **Prototyping**: Quick testing of MCP tool concepts 2. **Learning**: Understanding MCP tool structure 3. **Template**: Starting point for custom tools 4. **Testing**: Validating MCP client implementations 5. **Demonstration**: Showing different tool return types