Bifrost: Hybrid TEE-FHE Inference for Privacy-Preserving Transformer and LLM Serving

Cloud-hosted transformer and large language model (LLM) inference creates a direct confidentiality problem: user prompts may contain sensitive code, business data, personal information, or regulated documents, yet remote serving exposes intermediate state to the cloud software stack and accelerator ...