Registry / llm-agents / llama-index-llms-openai-like

llama-index-llms-openai-like

library0.7.2pypypi✓ verified 85d ago

This package provides an integration for LlamaIndex to use OpenAI-compatible Large Language Models (LLMs). It acts as a thin wrapper, allowing LlamaIndex applications to interact with any API that mimics the OpenAI API, making it flexible for various third-party LLM providers. The current version is 0.7.1, with releases typically tied to the broader LlamaIndex ecosystem updates.

llm-agents ai-ml

pip install llama-index-llms-openai-like

package ↗

INSTALL

IMPORT

SIG · LLAMA-INDEX-LLMS-O

llama-index-llms-openai-like

llm-agentspythonv0.7.2

Install

19.8s avg

Import

7376ms

Disk

265MB

Pass rate

10/ 10

Env Coverage10 / 10

glibc

3.9–3.13

musl

3.9–3.13

Install & Compatibility

Where this runs

tested against v0.7.2 · pip install

no network on importno background threads

Install × environment matrix

Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux

musl

py 3.10–3.920 runs

installs and imports cleanly · install 0.0s · import 6.157s · 253.9MB

glibc

py 3.10–3.920 runs

installs and imports cleanly · install 19.8s · import 5.645s · 250MB

265MB installed

● package 265MB

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

OpenAILike

✓ from llama_index.llms.openai_like import OpenAILike

Demonstrates how to initialize and use the `OpenAILike` LLM to complete a prompt with an OpenAI-compatible API endpoint. Environment variables are used for API configuration, with fallbacks for local testing.

import os from llama_index.llms.openai_like import OpenAILike # Replace with your actual model name and API base URL # If your API doesn't require an API key, set it to a dummy string like 'fake' # Set is_chat_model and context_window to match your model's capabilities llm = OpenAILike( model="my-openai-compatible-model", api_base=os.environ.get("OPENAI_COMPATIBLE_API_BASE", "http://localhost:8000/v1"), api_key=os.environ.get("OPENAI_COMPATIBLE_API_KEY", "fake-api-key"), is_chat_model=True, context_window=4096 # Adjust based on your model's context window ) response = llm.complete("Tell me a short story about a brave knight.") print(response.text)

Debug

Known issues

breakingLlamaIndex v0.10+ introduced a significant packaging refactor. While `llama-index-llms-openai-like` maintains its direct import path, ensure your other LlamaIndex components (core, embeddings, etc.) are updated to their respective integration packages or use `llama-index-core` to avoid conflicts.

fix

Upgrade other LlamaIndex packages to their explicit integration versions (e.g., `llama-index-core`, `llama-index-embeddings-openai`). Review LlamaIndex migration guides for detailed steps.

affects: >=0.10.0 (LlamaIndex ecosystem)

gotcha`api_key` and `api_base` parameters for `OpenAILike` are crucial. `api_base` must point to the correct OpenAI-compatible API endpoint, and `api_key` must be provided, even if it's a dummy string (e.g., 'fake') for APIs that don't require authentication. Incorrect values will lead to connection or authentication errors.

fix

Always set `api_base` to the exact endpoint URL of your OpenAI-compatible service and provide an `api_key` string. Consult your LLM provider's documentation for correct values.

affects: All

gotchaParameters like `context_window`, `is_chat_model`, and `is_function_calling_model` directly influence how `OpenAILike` interacts with the underlying LLM. Incorrect settings (e.g., `is_chat_model=False` for a chat-only API) can cause unexpected behavior or errors.

fix

Configure `context_window`, `is_chat_model`, and `is_function_calling_model` to accurately reflect the capabilities and requirements of your specific OpenAI-compatible model for optimal performance and correct API calls.

affects: All

Errors

Common errors & fixes

ModuleNotFoundError: No module named 'llama_index.llms.openai_like'

The `llama-index-llms-openai-like` package is not installed in the current Python environment.

fix

Run `pip install llama-index-llms-openai-like` to install the package.

NotFoundError: 404 page not found (when using OpenAILike with local LLMs like Ollama)

The `api_base` URL or the request format (headers, body, endpoint path) configured in `OpenAILike` does not correctly match the local OpenAI-compatible server's expectations. This often happens with local models (e.g., Ollama) if the `/v1` or `/v1/chat/completions` path isn't correctly appended or if `is_chat_model` is misconfigured.

fix

Verify that `api_base` is set to the *full* endpoint URL, including any necessary API version paths (e.g., `http://localhost:11434/v1`). Ensure `is_chat_model` is correctly set (`True` for chat models, `False` for completion models) and that the `model` name is recognized by your local server. Compare your Python request with a successful `curl` command if available.

ModuleNotFoundError: No module named 'llama_index.llms.openai'

This error can occur if another LlamaIndex integration or an older version of LlamaIndex is implicitly trying to import `llama_index.llms.openai` when only `llama-index-llms-openai-like` is installed, or if `llama-index-llms-openai` is a required dependency that's missing.

fix

If your project indirectly depends on `llama-index-llms-openai`, install it with `pip install llama-index-llms-openai`. If you're solely using the `openai-like` integration, ensure all relevant LlamaIndex components are configured to use `OpenAILike` and that there are no lingering imports or dependencies on the specific OpenAI package.

Upgrade

Version history

0.7.2latest on PyPI · released Apr 23, 2026

Audit

Dependencies

llama-index-corerequiredProvides core LlamaIndex abstractions and components.

llama-index-llms-openairequiredOften a peer dependency or implicitly required by other LlamaIndex components when working with OpenAI-style models.

transformersoptionalOptional dependency, primarily for tokenizer functionality if not explicitly provided or if certain LlamaIndex features that rely on it are used.

Agent activity

9 hits · last 30 days

node

OpenAI (training)

Resources

packagehttps://pypi.org/project/llama-index-llms-openai-like/ ↗