LLAMA Hot Swap

httpnone★ 5development

MCP server for hot-swapping llama.cpp models in Claude Code - launchctl (macOS) + systemd (Linux)

Install

How to run this server

[ { "cmd": "uvx (no", "imports": [] } ]

server path: llama-hot-swap

Tools

What this server exposes

list_models

Lists all configured models with load status and current mode

get_current_model

Returns the alias of the currently loaded model

swap_model

Unloads current model, loads the specified one, waits for health check

create_model_config

Generates a new launchd plist (macOS) or systemd unit (Linux) for a model

Configuration

Environment & auth

authnone

envANTHROPIC_BASE_URL

envANTHROPIC_API_KEY

Resources