A lightweight Rust foundation. The supplied v0.1.0 benchmark reports a 0.011-second startup and a 3.87 MB release, reducing startup and distribution overhead.
Built for multi-task and subagent workflows. The supplied 100-session measurement reports 0.59 GiB of memory, keeping the baseline cost of parallel sessions low.
The supplied single-session result is 5.97 MiB. A smaller baseline footprint leaves more room for tool execution, context processing and additional instances.
Focused on KV cache compatibility: stable prompt prefixes, reusable context structure and session continuity help cache-capable model services reuse repeated context.
稳定前缀系统指令与工具定义保持有序,动态内容后置。 Stable prefixes, dynamic content last.
上下文复用围绕连续任务减少重复上下文的无效改写。 Reuse context across continuing tasks.
KV cache 适配结合模型提供方的缓存机制评估命中、时延与 token 成本。 Evaluate cache hits, latency and token costs by provider.
缓存效果取决于模型服务、前缀一致性与缓存有效期;本页 benchmark 未包含缓存命中率测试。Cache benefits depend on provider support, prefix consistency and cache lifetime. Cache hit rates are not measured in the benchmark below.
Benchmark
从启动、体积到会话内存,逐项查看。Startup, release size and session memory, side by side.
以下根据提供的 v0.1.0 基准原表制作中英双语表格,数值保持原样。100 并发中 modu、jcode 为实测,其余带“推算”标记的数据为估算。测试环境、负载与脚注未随原表提供;启动耗时不代表模型推理速度。Bilingual tables transcribed from the supplied v0.1.0 benchmark, with original values preserved. The 100-session values for modu and jcode are measured; rows marked 推算 are estimates. Environment, workload and footnotes were not supplied. Startup time is not model inference speed.