yera.cli.setup_handlers.llama_cpp
Llama-cpp provider setup handler.
Symbols
LlamaCppSetup
BaseProviderSetupHandler for configuring Llama-cpp local model providers.
This class manages the discovery of local directories containing GGUF model files, allowing Yera to locate and load local LLMs from common installation paths or user-defined locations.
Methods
LlamaCppSetup.detect_config
detect_config() → LlamaCppConnection | NoneReport that llama.cpp model directories require explicit selection.
Returns
Always None because Yera does not infer permission to inspect environment-defined or conventional model directories.
LlamaCppSetup.ask_for_config
ask_for_config() → LlamaCppConnection | NonePrompt the user to define explicit local model directories.
Paths are expanded and resolved to absolute paths before being saved. No environment variables or conventional application caches are inferred.
Returns
A connection containing the explicitly entered directories, or None when the user declines setup.