主頁 文章 關於
English 繁體中文

    2026

      The Cluster You Do Not Watch

      2026 年 8 月 19 日

      An operations loop drawn as a ring around a central AI operator: alerting into chat, into an agent, into a pull request, through CI, into a reconciler, and back around. An operations loop drawn as a ring around a central AI operator: alerting into chat, into an agent, into a pull request, through CI, into a reconciler, and back around.

      I almost never open Grafana any more. This is the operations architecture that made that true, on under US$10 a month of infrastructure — an agent that reads everything and writes nothing directly, alerts precise enough to act on, repairs that must prove they are safe before running, and one rule that turns out to be load-bearing: a check that cannot fail is not a check. None of it depends on which Kubernetes you run.

      The Shapes of Agent Memory – Files, Stores, and Experience

      2026 年 8 月 12 日

      Three side-by-side memory shapes: a file-based index of markdown lines, a structured store of embedded units linked by a graph, and trajectories of agent experience with one successful episode ringed. Three side-by-side memory shapes: a file-based index of markdown lines, a structured store of embedded units linked by a graph, and trajectories of agent experience with one successful episode ringed.

      An agent that remembers across sessions can keep its memory as curated markdown files, as an auto-mined structured store, or as trained experience. I measured all of them: files against a structured store under one fixed model, a store-only head-to-head across the structured lineages, and an experience bank on the agentic benchmarks where the state of the art trains memory into the weights.

      Why Steering Works – The Theory Beneath X Engineering for AI Agents

      2026 年 7 月 26 日

      A two-basin cost landscape with an unsteered trajectory settling in a local minimum and a steered trajectory reaching the intended minimum. A two-basin cost landscape with an unsteered trajectory settling in a local minimum and a steered trajectory reaching the intended minimum.

      An agent run is stochastic gradient descent over solution space, and steering is how the true objective enters the loop. An optimization view and a Bayesian view that ground the industry ladder — prompt, context, harness, loop engineering — in foundation theory, and explain when a big model steering a small one beats distillation, and when it does not.

      優化 Transformer 模型服務參數 – Apple Silicon GPU 的案例

      2026 年 7 月 11 日

      GPU 佔用時間軸:當 benchmark 的 prefill 區塊佔住 GPU 時,LLM 的 decode 速度從每秒 65 個 token 崩跌到每秒 0.67 個。 GPU 佔用時間軸:當 benchmark 的 prefill 區塊佔住 GPU 時,LLM 的 decode 速度從每秒 65 個 token 崩跌到每秒 0.67 個。

      一台 MacBook Pro M4 Max、一個開源 MoE 模型,針對推論優化的一次實戰:為什麼讓 LLM 吞吐量崩跌 100 倍的是 prefill(而不是 decode),以及兩個 prefill 側的關鍵優化。

      Collection Autofill 的規模化架構

      2026 年 5 月 28 日

      Instill AI Collection 正在進行 Autofill,每個儲存格都在處理中。

      這篇文章談的是 Collection Autofill 的架構設計:一個把非結構化資料整理成 structured context 的產品介面,如何在幾百列到上千萬個 AI-computed cells 的規模下,仍然保持快速、公平且可觀測。

    2025

      重新想像非結構化資料 ETL

      2025 年 2 月 14 日

      試著想像一下,一種能夠理解任何物理訊號,並且有智慧地回應任何人類語言指令的電腦系統。

      生成式 AI 正在改變軟體,那它又會如何改變我們使用文件、圖片和影片等非結構化資料的方式呢?

pinglin.tw © 2026 by Ping-Lin Chang is licensed under CC BY 4.0