跳到正文
原文
The Decoder· Matthias Bastian·· 3 小时前AI 评分47

OpenAI GPT-6 在 COBOL 和 Fortran 等传统编程语言上取得显著进步

OpenAI says GPT-6 is much better with legacy programming languages such as COBOL and Fortran

AI 导读

OpenAI 对 GPT-6 进行了改进,使其在 COBOL、Fortran 和 Visual Basic 等资源较少的语言上表现更佳。在 MultiLangBench 测试中,GPT-6 Astra 在 20 种语言中的平均测试通过率达到了 87.4%,比 GPT-5.6 Terra 的 38% 提高了近一倍。

原文

OpenAI improved its latest AI models for "low-resource" languages like COBOL, Fortran, and Visual Basic. These languages have far less available training code than something like Python, but according to OpenAI, they prop up critical infrastructure worldwide. IBM estimates that COBOL powers more than 40 percent of online banking systems and 95 percent of all ATM transactions.

OpenAI built two evaluations to measure progress. MultiLangBench (GitHub) asks models to build a SQLite-compatible database engine from scratch. With maximum reasoning effort, GPT-6 Astra hits an average test pass rate of 87.4 percent across 20 languages, up from about 38 percent for GPT-5.6 Terra. GPT-6 Luna scores 40.3 percent, barely edging out GPT-5.6 Terra (37.9 percent) but at a much lower cost.

Average test pass rate on MultiLangBench across 20 programming languages. GPT-6 Astra and GPT-6.1 Sol both reach about 87 percent, while older models like GPT-5.6 Terra top out at around 38 percent. | Image: OpenAI

On the COBOL migration benchmark, which translates COBOL into C++, Java, Kotlin, Python, or Rust, GPT-6.1 Sol reaches 86.6 percent accuracy at low reasoning effort, compared to 5.4 percent for GPT-5.6 Sol. Cranking up reasoning effort pushes accuracy to 97.9 percent.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源:The Decoder · the-decoder.com