yera.cli.setup_handlers.llama_cpp

Llama-cpp provider setup handler.

Symbols

class LlamaCppSetup — Handler for configuring Llama-cpp local model providers.

LlamaCppSetup

Handler for configuring Llama-cpp local model providers.

This class manages the discovery of local directories containing GGUF model files, allowing Yera to locate and load local LLMs from common installation paths or user-defined locations.

Methods

detect_config — Report that llama.cpp model directories require explicit selection.
ask_for_config — Prompt the user to define explicit local model directories.

LlamaCppSetup.detect_config

detect_config() → LlamaCppConnection | None

Report that llama.cpp model directories require explicit selection.

Returns

type: LlamaCppConnection | None

Always None because Yera does not infer permission to inspect environment-defined or conventional model directories.

LlamaCppSetup.ask_for_config

ask_for_config() → LlamaCppConnection | None

Prompt the user to define explicit local model directories.

Paths are expanded and resolved to absolute paths before being saved. No environment variables or conventional application caches are inferred.

Returns

type: LlamaCppConnection | None

A connection containing the explicitly entered directories, or None when the user declines setup.