0be354a920
Single-commit clean baseline after security scrub of niche-tells, project codenames, internal jargon, and contributor-email leaks. Contents: - 100 Rust crates (_primitives/_rust/) - 37 agent manifests (_manifests/) + generated specs (_generated/) - 67 user-invocable skills (skills/) - 33 hooks (hooks/) - Composition blocks (_blocks/) - Documentation (docs/, README.md) - TS adapter packages (_ts_packages/) - Assembler (_assembler/) - Roles (_roles/) - Templates (_templates/) - Forgejo CI (.forgejo/) Author: Denis Parfionovich <info@greendragon.info> License: see LICENSE.
36 lines
1.5 KiB
Rust
36 lines
1.5 KiB
Rust
//! kei-llm-router — UNIVERSAL local-LLM backend selector.
|
|
//!
|
|
//! Wave 60 of the local-LLM stack. Glues:
|
|
//! * W55 `kei-model` — model registry (catalog + selector)
|
|
//! * W56 `kei-machine-probe` — host hardware/OS detection
|
|
//! * W57 `kei-llm-ollama` — Ollama daemon HTTP adapter
|
|
//! * W58 `kei-llm-llamacpp` — llama.cpp shell-out adapter
|
|
//! * W59 `kei-llm-mlx` — Apple Silicon MLX adapter
|
|
//!
|
|
//! Public surface:
|
|
//! * `decide(...)` — pure decision over pre-probed candidates.
|
|
//! * `route(...)` — async, probes live state then decides.
|
|
//! * `health::check_all()` — health-probe every backend in parallel.
|
|
//! * `discovery::discover_models(...)` — ask each backend "have model X?"
|
|
//!
|
|
//! Hard constraints (per task spec):
|
|
//! * NO direct subprocess spawns (delegate to W57/W58/W59).
|
|
//! * NO async runtime owned by this crate (the binary's `tokio::main`
|
|
//! runs the show; lib functions are `async fn`).
|
|
//! * NO new workspace deps; reuse the existing set.
|
|
//!
|
|
//! Distinct from `kei-router` (the REMOTE provider router for Anthropic/
|
|
//! OpenAI/Kimi etc.). This crate is for LOCAL backend selection only.
|
|
|
|
pub mod backend;
|
|
pub mod cli;
|
|
pub mod discovery;
|
|
pub mod error;
|
|
pub mod health;
|
|
pub mod router;
|
|
|
|
pub use backend::{from_tier, Backend, BackendKind};
|
|
pub use discovery::{discover_models, normalise_base, pick_match, ModelMatch};
|
|
pub use error::{Error, Result};
|
|
pub use health::{check_all, check_llamacpp, check_mlx, check_ollama, BackendHealth};
|
|
pub use router::{decide, route, RouteDecision, RouteOpts};
|