Frontiers of compute: The technologies to reduce AI inference costs

AI’s next breakthrough may not be a smarter model but a cheaper token.