yera.setup.model_discovery.llama_cpp
Llama-cpp model discovery handler.
Symbols
LlamaCppModelSetup
Inherits:
ModelSetup[LlamaCppConnection]Handler for discovering local GGUF models for Llama-cpp.
This class crawls configured local directories, parses the binary headers of .gguf files to extract metadata.
Methods
get_config — Obtain model configuration from local GGUF files.
LlamaCppModelSetup.get_config
get_config() → SetupResult[list[BaseModelConfig]]Obtain model configuration from local GGUF files.
Configured directories are scanned recursively. Unreadable files and inaccessible directories are omitted with recoverable warnings rather than aborting the complete scan.
Returns
type: SetupResult[list[BaseModelConfig]]
Supported llama.cpp model configuration and discovery diagnostics.