3 min read
ggerganov/llama.cpp (b12262) & mlc-ai/web-llm (v0.2.88) — Build & Runtime Deep Dive
Executive Signal Synthesis
Ships @ggerganov/llama.cpp@b12262 with upstream runtime. Drop-in upgrade. Migration: None. Meanwhile, mlc-ai/web-llm (v0.2.88): Fix prompt echo in streaming text completions. Drop-in upgrade. Migration: None.
Architectural Deep-Dive & Systems Impact
Ships @ggerganov/llama.cpp@b12262 with upstream runtime refinements and stability fixes from ggerganov/llama.cpp.
Updates TypeScript declarations and internal module exports for b12262.
Fix prompt echo in streaming text completions
Fix selected-token logprobs and logprobs for buffered UTF-8 output
Actionable Upgrade & Verification Checklist
- 01Upgrade @ggerganov/llama.cpp via
npm install @ggerganov/llama.cpp@b12262. - 02Upgrade @mlc-ai/web-llm via
npm install @mlc-ai/web-llm@0.2.88.
Verification & Upgrade Command Snippet
npm install @ggerganov/llama.cpp@b12262
npm install @mlc-ai/web-llm@0.2.88