Peking University and StepFun Unveil TensorCast: A Programmable Tensor Management Layer That Cuts LLM Time-to-First-Token by Up to 93.2%

Peking University, StepFun, and Beijing University of Posts and Telecommunications propose TensorCast, a unified programmable tensor lifecycle management abstraction for large model infrastructure. In high-concurrency multi-turn agent scenarios, median time-to-first-token drops up to 93.2%, and model instance startup is up to 228.6x faster.