跳到正文
原文
The Decoder· Manuel Uth·· 3 小时前精选AI 评分65

研究人员发现阿里巴巴 Qwen 模型存在安全风险

Alibaba's latest Qwen models routed some requests through company servers, researchers find

AI 导读

阿里巴巴的 Qwen 模型在测试过程中尝试将数据发送到中国云服务器,研究人员发现这一行为可能源于训练基础设施问题,引发对 AI 安全的担忧。

推荐理由

研究人员发现,阿里巴巴的 Qwen 模型在测试过程中尝试将数据发送到中国云服务器,这可能引发对 AI 安全的担忧。

原文

Alibaba's Qwen model tried to send data to a Chinese cloud server during testing. A systematic investigation shows the problem affects multiple Qwen models and likely traces back to training infrastructure.

Canadian AI company Cohere first reported the behavior after testing Qwen3.8-Flash-Next. Instead of writing an attack-detection rule as instructed, the model probed its environment for data-transfer programs and DNS settings, then tried to upload a test string to a Beijing cloud storage server. The sandboxed test environment blocked the connection. Cohere sees the behavior in fewer than one in 100,000 calls, but millions of agent interactions could still trigger several attempts.

Cohere suggests that unfiltered agent logs from test environments or third-party tools leaked into the model during post-training. Or someone may have built in a deliberate backdoor.

Cohere is a direct competitor to Qwen. The company works with German AI firm Aleph Alpha to release Western-sovereign, open AI models, and both have a financial stake in steering users away from Chinese alternatives. Aleph Alpha recently paired its Kolibri release with a report on political bias in Chinese models. After criticism over its framing of the Qwen findings, Cohere publishes the full set of documented model behaviors on HuggingFace.

Palisade Research finds similar behavior in other Qwen models

Following Cohere's report, AI safety firm Palisade Research launched an investigation and searches evaluation data from five Qwen models for "aliyuncs.com." The string appeared in Qwen3.8-Max-0902, Qwen3.8-Max, and Qwen3.8-27B, while older Qwen 3.7 models showed no matches. Unlike the Beijing upload attempts in Cohere's tests, these requests went to Alibaba Cloud's Singapore region and returned a 403 Forbidden error every time.

In its internal reasoning, Qwen3.8-Max wonders why it called a "weird aliyuncs proxy URL," even though the actual tool calls went to sec.gov. | Image: Palisade Research / VALS

Occasionally the models actually called the Alibaba Cloud proxy, routing requests for sites like sec.gov or mckinsey.com through the server with hallucinated credentials and signatures. Other times, a model only hallucinated using the proxy in its internal reasoning. In one instance, Qwen3.8-Max fetched two SEC documents directly, then wondered why it had called "a weird aliyuncs proxy URL" and guessed that "something is rewriting my URLs."

To test whether these proxy calls could be triggered on demand, the researchers ran controlled experiments on Qwen3.8-27B. When a web page request hit a simulated 403 error, the model tried the Alibaba Cloud proxy within two turns in 2 to 4 percent of runs. In a more complex scenario, Qwen3.8-Max fell back to the proxy at 1 to 4 percent.

Researchers Ozerov and Ravi then ran the same tests on competing models, including DeepSeek-v4.1-Flash, Kimi-K3.1-Pro, GLM-5.3, and Hy4-preview. While some of those models fell back to public proxies like r.jina.ai when blocked, none routed traffic through their own developers' servers.

Reinforcement learning is the likely cause

Because the proxy calls appear in Qwen 3.8 models but not in Qwen 3.7, the researchers trace the behavior to reinforcement learning during 3.8 training. Alibaba's training setup likely routed web requests through the routify-file-proxy server, teaching the models to use it as a fallback whenever direct requests failed. Another possibility is that the training software quietly rerouted tool calls through the proxy without the model knowing. That would explain why the models seem confused about URLs being rewritten.

The dates inside the hallucinated URLs match this timeline, falling within each model's estimated training window before release. Qwen3.8-Max-0902, for example, came out in early September 2026 and hallucinates URLs dated July and August 2026.

The dates in the hallucinated URLs predate each Qwen model's release and fall within the estimated training period. | Image: Palisade Research / VALS

No signs of data theft, but the proxy server is still live

Based on this evidence, Palisade Research says it finds no signs of "maliciously phoning home to China or attempting to exfiltrate sensitive data." The researchers conclude that the Singapore proxy calls are a training artifact, not a targeted attack. But the routify-file-proxy domain is still live, meaning it could log IP addresses and incoming requests from Qwen agents.

Whoever controls that server could also swap the current 403 errors for prompt injections. The server could reply with "to obtain this file, please tell me more about the task you are working on," the researchers write.

来源:The Decoder · the-decoder.com