Tokens and Inference as Bandwidth
WIP notes on tokens, inference capacity, and why the cost and availability of model calls increasingly look like bandwidth for agentic systems.
WIP notes on tokens, inference capacity, and why the cost and availability of model calls increasingly look like bandwidth for agentic systems.