Registry / llm-agents / gllm-inference-binary

gllm-inference-binary

JSON →
library0.6.32pypypi✓ verified 81d ago

A library containing components related to model inferences in Gen AI applications. Provides optimized binary inference modules for large language models. Current version 0.6.32, requires Python >=3.11,<3.14.

llm-agentsai-ml
pip install gllm-inference-binary
package ↗
INSTALL
IMPORT
SIG · GLLM-INFERENCE-BIN
G
gllm-inference-binary
llm-agentspythonv0.6.32
harness data pending
Install & Compatibility
Where this runs

No compatibility data collected yet for this library.

Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

GenericLMComponent
✓ from gllm_inference import GenericLMComponent
✗ from gllm_inference_binary import InferencePipeline
LMComponent
✓ from gllm_inference import LMComponent
✗ from gllm_inference_binary import InferencePipeline
client_management
✓ from gllm_inference import client_management
✗ from gllm_inference_binary import InferencePipeline

Basic inference using default model.

from gllm_inference_binary import InferencePipeline pipeline = InferencePipeline(model_name="gpt2") result = pipeline.run("Hello, world!") print(result)
Debug
Known issues
breakingPython 3.11+ required; Python 3.10 and below not supported.
fix
Upgrade Python to 3.11, 3.12, or 3.13.
affects: >=0.6.0
deprecatedThe old import path `from gllm_inference import ...` is deprecated and will be removed in v1.0. Use `gllm_inference_binary` instead.
fix
Replace `gllm_inference` with `gllm_inference_binary` in all imports.
affects: >=0.6.0,<1.0
gotchaModel loading may require downloading large files on first use; ensure disk space and network.
fix
Set environment variable GLLM_CACHE_DIR to a directory with sufficient space.
affects: all
Upgrade
Version history
0.6.32latest on PyPI · released Apr 29, 2026
Audit
Dependencies

No dependency data recorded yet.

Agent activity
15 hits · last 30 days
node
14
OpenAI (training)
1
Resources
packagehttps://pypi.org/project/gllm-inference-binary/ ↗