Skip to content

[Fix] Search system paths for shared libraries #65

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
JamePeng merged 3 commits into from
Feb 21, 2026
Merged

[Fix] Search system paths for shared libraries #65

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
92f1ccf
search system paths for shared libraries
Feb 21, 2026
9a33454
fix import
Feb 21, 2026
1619c16
append errors
Feb 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 12 additions & 3 deletions llama_cpp/_ctypes_extensions.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
import ctypes
import functools
import pathlib

from ctypes.util import find_library
from typing import (
Any,
Callable,
Expand Down Expand Up @@ -95,10 +95,19 @@ def load_shared_library(lib_base_name: str, base_paths: Union[pathlib.Path, list

errors = []

# Try to load the shared library, handling potential errors
# First, try to find an available library through the system
lib_path = find_library(lib_base_name)
if lib_path:
try:
return ctypes.CDLL(lib_path, **cdll_args)
except Exception as e:
errors.append(f"{lib_path}: {e}")

# Then fallback to manually checking the list of paths.
for base_path in base_paths:
for lib_name in lib_names:
lib_path = base_path / lib_name
lib_path = pathlib.Path(base_path) / lib_name

if lib_path.exists():
try:
return ctypes.CDLL(str(lib_path), **cdll_args)
Expand Down