Cloudflare Says Cache Bug Put Other Customers’ Text in 155 AI Responses
Cloudflare Says Cache Bug Put Other Customers’ Text in 155 AI Responses
AI Cybersecurity

Cloudflare Says Cache Bug Put Other Customers’ Text in 155 AI Responses

Cloudflare BlogOct 27, 2026

Cloudflare disclosed a cross-customer data exposure in Workers AI’s GLM-5.3 service, traced to an SGLang cache-handling bug and since remediated.

Cloudflare disclosed on October 26 that a tenant-isolation flaw in its Workers AI deployment of Z.ai’s GLM-5.3 model caused some responses to include material from other customers’ recent requests. The company says the exposure occurred from August 27 to September 9, 2026, and affected 155 responses. It found no evidence that the issue was deliberately exploited and said no other Workers AI model was affected.

The problem appeared only with prompts exceeding 681,280 tokens. Cloudflare’s configuration allowed a 1,048,576-token context window, but the prefill GPUs’ key-value cache pool could hold fewer tokens. When an over-limit request was rejected, a bug in SGLang’s disaggregated serving path did not properly abort the handoff: stale cache data could remain available to the decode stage, which then generated a response containing text from another session. Cloudflare says it reproduced the issue after a researcher’s September 8 report, took the model offline, patched the configuration and inference engine, and restored service on September 9.

The disclosure matters because inference providers isolate many customers on shared hardware, and model-serving infrastructure can create privacy risks even when the model itself is not compromised. The incident also highlights how very long context windows can stress cache-capacity assumptions and error-handling paths. Cloudflare says the report was published in coordination with SGLang maintainers, who describe related request-isolation fixes and hardening work in their own account.

The company reports that it expanded the relevant cache pool and deployed a patched rejection path before restoring public access. It says it continues working with upstream SGLang maintainers on fixes for similar classes of cache-lifetime and cross-request isolation bugs. The disclosure does not establish that customers’ data was accessed by an attacker; Cloudflare’s investigation characterized the observed requests as consistent with ordinary long-context use.

Industry Impact

Shared AI Inference Faces Isolation Risks

Cloud AI services and AI infrastructure

Overview

Cloudflare’s disclosure shows that tenant isolation can fail inside inference-serving infrastructure, even without model compromise or evidence of an attacker. The exposure was limited to 155 responses over two weeks and required prompts above 681,280 tokens; the company says no other Workers AI model was affected. In the near term, platform and ML teams should scrutinize cache sizing, rejected-request cleanup, and cross-session tests. Longer term, providers and enterprise buyers will need stronger validation of isolation controls for shared GPU services and long-context workloads.

Key Impact Points

A cache handoff flaw allowed some responses to include material from other customers’ recent requests.

The incident was limited to GLM-5.3, 155 responses, and requests exceeding 681,280 tokens; Cloudflare reported no evidence of deliberate exploitation.

Long context windows can exceed cache capacity, making request rejection and cleanup paths critical to tenant isolation.

Opportunities

Operational Hardening, Not a New Market

Cloud AI services and AI infrastructure

The incident does not establish a standalone commercial opportunity or customer demand for a new product. It does identify a concrete operational priority for cloud AI providers and organizations using hosted inference: verify that cache capacity limits match configured context windows, and ensure rejected or interrupted requests cannot leave state visible to another session. Teams can incorporate cross-tenant isolation tests, long-context stress cases, and cache-lifecycle checks into deployment gates and incident reviews. These are defensive engineering and procurement measures rather than a demonstrated new revenue stream. Cloudflare’s account also shows that upstream serving-stack coordination can be part of remediation when infrastructure behavior, rather than model weights, creates the exposure.

Reference link

https://blog.cloudflare.com/kv-cache-exposure-remediation

Image Source Link

https://www.unite.ai/wp-content/uploads/2026/10/cloudflare-discloses-kv-cache-exposure-glm-5-3-workers-ai-model.jpg

Community Discussion (0)

Loading discussions...