Registry / llm-agents / smg-grpc-servicer

smg-grpc-servicer

library0.5.2pypypiunverified

SMG gRPC servicer implementations for LLM inference engines (vLLM, SGLang). Provides gRPC service stubs and helpers for the Shepherd Model Gateway ecosystem. Current version 0.5.2, requires Python >=3.10.

llm-agents ai-ml http-networking aws devops

pip install smg-grpc-servicer

github ↗package ↗

INSTALL

IMPORT

SIG · SMG-GRPC-SERVICER

smg-grpc-servicer

llm-agentspythonv0.5.2

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

NvidiaGpuModelProviderAsyncio

✓ from smg_grpc_servicer import NvidiaGpuModelProviderAsyncio

✗ from smg_grpc_servicer import NvidiaGpuModelProviderAsyncio

Run a basic async gRPC provider for a single SGLang worker.

import asyncio from smg_grpc_servicer import NvidiaGpuModelProviderAsyncio async def main(): provider = NvidiaGpuModelProviderAsyncio( workers=[{"url": "localhost:50051", "disconnected_debounce_s": 5.0}], request_interval=0.1, inference_engine="sglang", name="my-engine", ) async with provider.run(): await asyncio.sleep(10) asyncio.run(main())

Debug

Known issues

breakingThe sync `NvidiaGpuModelProvider` is deprecated and will be removed in a future release. Use `NvidiaGpuModelProviderAsyncio`.

fix

Replace `NvidiaGpuModelProvider` with `NvidiaGpuModelProviderAsyncio` and adjust code to use `async with` context manager.

affects: >=0.4.0

gotchaThe library name on PyPI is `smg-grpc-servicer` but imports use underscores: `smg_grpc_servicer`. Common mistake is to try `import smg_grpc_servicer` with hyphens.

fix

Install as `pip install smg-grpc-servicer` and import as `import smg_grpc_servicer`.

affects: all

gotchaThe `inference_engine` parameter must match exactly the engine running on the gRPC workers. Supported values: 'sglang', 'vllm'. Case-sensitive.

fix

Set `inference_engine='sglang'` or `inference_engine='vllm'` (lowercase).

affects: all

Upgrade

Version history

0.5.2latest on PyPI · released Apr 9, 2026

Audit

Dependencies

No dependency data recorded yet.

Agent activity

33 hits · last 30 days

node

OpenAI (training)

Resources

githubhttps://github.com/lightseekorg/smg ↗

packagehttps://pypi.org/project/smg-grpc-servicer/ ↗