Home Blog About
English 繁體中文

    2026

      The Cluster You Do Not Watch

      August 19, 2026

      An operations loop drawn as a ring around a central AI operator: alerting into chat, into an agent, into a pull request, through CI, into a reconciler, and back around. An operations loop drawn as a ring around a central AI operator: alerting into chat, into an agent, into a pull request, through CI, into a reconciler, and back around.

      I almost never open Grafana any more. This is the operations architecture that made that true, on under US$10 a month of infrastructure — an agent that reads everything and writes nothing directly, alerts precise enough to act on, repairs that must prove they are safe before running, and one rule that turns out to be load-bearing: a check that cannot fail is not a check. None of it depends on which Kubernetes you run.

      The Shapes of Agent Memory – Files, Stores, and Experience

      August 12, 2026

      Three side-by-side memory shapes: a file-based index of markdown lines, a structured store of embedded units linked by a graph, and trajectories of agent experience with one successful episode ringed. Three side-by-side memory shapes: a file-based index of markdown lines, a structured store of embedded units linked by a graph, and trajectories of agent experience with one successful episode ringed.

      An agent that remembers across sessions can keep its memory as curated markdown files, as an auto-mined structured store, or as trained experience. I measured all of them: files against a structured store under one fixed model, a store-only head-to-head across the structured lineages, and an experience bank on the agentic benchmarks where the state of the art trains memory into the weights.

      Why Steering Works – The Theory Beneath X Engineering for AI Agents

      July 26, 2026

      A two-basin cost landscape with an unsteered trajectory settling in a local minimum and a steered trajectory reaching the intended minimum. A two-basin cost landscape with an unsteered trajectory settling in a local minimum and a steered trajectory reaching the intended minimum.

      An agent run is stochastic gradient descent over solution space, and steering is how the true objective enters the loop. An optimization view and a Bayesian view that ground the industry ladder — prompt, context, harness, loop engineering — in foundation theory, and explain when a big model steering a small one beats distillation, and when it does not.

      Optimizing Transformer Model Serving Parameters – An Apple Silicon GPU Case Study

      July 11, 2026

      A GPU occupancy timeline showing chat decode collapsing from 65 to 0.67 tokens per second while benchmark prefill chunks occupy the GPU. A GPU occupancy timeline showing chat decode collapsing from 65 to 0.67 tokens per second while benchmark prefill chunks occupy the GPU.

      One MacBook Pro M4 Max, an open-source MoE, and a hands-on exercise in optimizing it for inference: why the thing that collapses LLM throughput by 100× is prefill, not decode, and the two prefill-side fixes that got it back.

      Collection Autofill at Scale

      May 28, 2026

      An Instill AI Collection mid-autofill, every cell processing.

      A design walkthrough of how Collection Autofill — a spreadsheet of AI-computed cells — stays fast, fair, and observable from a hundred rows to ten million.

    2025

      Reimagine Unstructured Data ETL

      February 14, 2025

      Imagine a computer system that interprets any physical signal and intelligently responds to any language instruction.

      Generative AI is revolutionizing software—how does it transform the way we utilize unstructured data like text, images, and videos?

pinglin.tw © 2026 by Ping-Lin Chang is licensed under CC BY 4.0