The Pneumetron
NEWSTOOLSINFRASTRUCTURE
Pneumetron.OpenAI models improve chip PPA, METR updates capability trends, PAD filters driving data
Share
Skip to article content
  1. Home
  2. ›
  3. News
  4. ›
  5. AI Research
  6. ›
  7. OpenAI models improve chip PPA, METR updates capability trends, PAD filters driving data
AI Research·November 22, 2026

OpenAI models improve chip PPA, METR updates capability trends, PAD filters driving data

BY PNEUMETRON|4 MIN READ · 908 WORDS4 MIN READ
Tools
Share

In This Article

  • OpenAI reports production chip design gains
  • METR tracks capability shifts on judgment tasks
  • A gradient-based method filters synthetic driving data
  • Sources
Illustrative photo: circuit board, printed circuit board, computer, electronics
Illustrative image: webandi / Pixabay

GPT models deliver double-digit PPA gains on production silicon designs, while independent evaluations reveal a persistent gap between verifiable and judgment-heavy tasks. A new data valuation method also curbs harmful scaling in autonomous driving policies.

Key Takeaways

  • 01OpenAI reports 10 to 14 percent PPA gains on production chip designs using GPT models.
  • 02METR finds models still lag humans on judgment tasks despite exponential gains on verifiable work.
  • 03A new influence-based framework improves driving policy scores by 3.5 to 5.0 points over real data alone.
  • 04Judgment-heavy evaluations remain too noisy to establish reliable capability trends.

OpenAI reports production chip design gains

OpenAI says its frontier models have delivered double-digit improvements in power, performance, and area on production silicon designs. The company reports that GPT models reduced standard-cell area by roughly 13 percent in the vector unit and 10 percent in the matrix unit of its custom inference chip, Jalapeño. Those optimizations were silicon proven during bring-up. On third-party hardware, OpenAI claims up to 14 percent PPA improvement relative to heavily optimized baselines on AMD’s flagship GPU IP. The model identified gains by rewriting SystemVerilog RTL, a process the company estimates compressed a year of engineering progress into under five months. AMD has already incorporated some of these changes into a design sent for manufacturing.

To track capability progression, OpenAI tested successive model generations on two open-source 32-bit RISC-V cores: PicoRV32 and OpenTitan’s Ibex. The task required increasing throughput while keeping area within 16 times the original footprint. Each run consumed about 112,000 tokens. GPT-6.2 Astra achieved the highest average score across both cores, followed by GPT-6.1 Sol, which outperformed GPT-5.6 Sol. When given written requirements instead of existing RTL, all five tested models scored higher on throughput, likely because they could omit features like performance counters that do not improve the test workloads. The evaluation included 9,881 scored runs across both tasks, both cores, and multiple token budgets.

OpenAI notes that the models reason about RTL at the level of an expert microarchitect, rewriting circuits that perform calculations, control operations, or move data. The company used Synopsys tools to verify that each rewrite preserved block behavior and evaluated trade-offs in power, performance, and area. OpenAI is now partnering with Synopsys to train a model to use electronic design automation tools directly, aiming to ground capability development in trusted evaluators.

METR tracks capability shifts on judgment tasks

METR released an updated version of its time horizon plot, tracking how long it takes models to complete tasks that humans have already finished. The report confirms that capability on verifiable tasks continues to improve along an exponential trajectory, with the length of successfully completed tasks doubling roughly every four months. Coding and mathematics remain the strongest domains, where automatic verification allows reinforcement learning to strengthen successful pathways efficiently.

The update introduces open-ended tasks that require judgment, such as designing new AI evaluations or scoring philosophical arguments. On these tasks, models still fall short of human utility. The most advanced systems produced evaluation designs that METR staff did not consider useful for their research, and they struggled to match human consistency on philosophical scoring. One newer model, Opus 5.5, reached what METR calls borderline above the bar performance on evaluation design, a noticeable shift from a year ago when every model scored clearly below the bar. Experts note that these judgment-heavy tasks are difficult to score reliably, making it hard to extrapolate whether models will close the gap. METR researchers explicitly state that predicting progress on underspecified tasks will remain difficult compared to easily verifiable benchmarks.

Illustrative photo: server, technology, web, data Illustrative image: QuinceCreative / Pixabay

Task difficulty in the updated plot is measured by human completion time estimates, since paying experts to complete tasks that might take hundreds of hours is prohibitively expensive. Some tasks carry specific scoring limitations; for example, the philosophical argument task relied on a single rater for most arguments, and agent scores were judged by how well they agreed with that individual. Researchers acknowledge that scores could shift if more experts were surveyed, but the logistical cost remains high. The inclusion of these fuzzier tasks marks a deliberate shift in evaluation strategy, though the data currently supports only directional observations rather than clean trend lines.

A gradient-based method filters synthetic driving data

Researchers from Tongji University and UNC Chapel Hill introduced a framework called Policy-Aware Data Valuation (PAD) to address the problem of indiscriminate synthetic data scaling in autonomous driving. The authors report that adding more demonstrations does not guarantee better policies, as redundant or misaligned samples can cause scenario-specific regressions. PAD assigns each candidate demonstration a utility score specific to the target driving policy by combining scene-level calibration feedback with projected policy gradients and a regularized approximation of local training geometry.

The framework uses influence-based estimation to rank synthetic data without retraining the policy for every candidate. In controlled experiments on DiffusionDrive, PAD improved the EPDMS metric by 3.5 points on the NavTest benchmark and 5.0 points on NavHard compared to training on real data alone. The gains held across diffusion-, regression-, and flow-matching-based planners. The authors also show that indiscriminate synthetic augmentation can push a policy into zero-score failure states, whereas PAD’s curated selection avoids those regressions while preserving useful supervision. The method restricts gradient attribution to trajectory-producing parameters during valuation but retrains the full policy with its native objective.

PAD constructs a fixed calibration set of 4,000 real scenes and evaluates the base checkpoint on each scene to compute standardized outcome weights. The framework uses a Gaussian projection with a dimension of 2,048 to approximate the local inverse training geometry, solving a single projected linear system to compute values for every candidate. The selected demonstrations are combined with the real dataset, and the complete policy is retrained using its native architecture and training recipe. The authors note that while PAD improves data composition, it cannot eliminate errors caused by unresolved policy limitations or extreme scene complexity, and it occasionally fails to satisfy strict time-to-collision criteria in highly irregular junctions. Code and project pages are publicly available.

Sources

  • openai.com: Advancing chip design with OpenAI models
  • arXiv: PAD: Policy-Aware Data Valuation for Autonomous Driving
  • technologyreview.com: The most misunderstood graph in AI just got a major update
#chip design#model evaluation#data curation#autonomous driving#openai#metr
PE
PUBLISHED BY

PNEUMETRON EDITORIAL

Pneumetron's pipeline pairs AI-assisted drafting with human editorial review before publishing — our goal is to make staying informed easier, not to replace real reporting.

Source Material:openai.com, arXiv, technologyreview.com ↗
Share this article
Share
Stay Informed

Never miss a signal.

Subscribe to the Pneumetron Intelligence Digest.

← Previous
AURA streams real-time talking-head avatars on a single GPU
Next →
DaisyRose-27B RL Training, NVIDIA Dynamo, and Run:ai GPU Sharing on EKS

More from AI Research

View All →
AI Research4 min ago
Illustrative photo: laptop, macbook, codes, coding

Lang-SVG introduces hierarchical trees for semantic image vectorization

Researchers have published Lang-SVG, a method that reconstructs raster images as hierarchical, semantically labeled SVG trees rather than flat layers. The approach uses open-vocabulary segmentation and MLLMs to organize vector primitives into parent-child structures, improving both structural alignment and rendering fidelity under strict control-point budgets.

BY PNEUMETRON5 MIN READ
Read more
AI Research4 min ago
Illustrative photo: server, cloud, development, business

AtomicChat Releases Uncensored LoRA for Inkling-2-Mini

AtomicChat published a rank-1 LoRA adapter that strips refusal behavior from the 26.4B MoE Inkling-2-Mini model. The edit drops harmful refusal rates to zero while costing 1.5 points on MMLU and spiking first-token KL on previously refused prompts.

BY PNEUMETRON4 MIN READ
Read more
AI Research4 min ago
Illustrative photo: network, server, system, infrastructure

Open-source guard scans iOS and Android projects before app store submission

A new open-source playbook and shell-based guard automates pre-submission checks for mobile apps, integrating with AI coding agents to block submissions against 117 known rejection patterns and 95 regulatory deadlines.

BY PNEUMETRON4 MIN READ
Read more
AI Research4 min ago
Illustrative photo: switch, it, server, server cabinet

OpenAI blocks reasoning extraction and peer review homogenization rises

OpenAI reports a 54-point drop in adversarial distillation success rates after updating GPT-6.2 safeguards, while an unreviewed arXiv study finds LLM-assisted peer reviews are converging on identical critiques.

BY PNEUMETRON4 MIN READ
Read more

Comments

In This Article

  • OpenAI reports production chip design gains
  • METR tracks capability shifts on judgment tasks
  • A gradient-based method filters synthetic driving data
  • Sources

Most Read

01
AI Research·3d ago
Tencent releases LoopForge to orchestrate coding agents in self-hosted pipelines
02
AI Research·4d ago
Recent AI Research Reveals Gaps in Coding Agents and Advances Scientific Modeling
03
AI Research·4d ago
Four New AI Papers Advance Reasoning, TTS, and Decoding Efficiency
04
AI Research·4d ago
Anthropic Upgrades Fable and Mythos as Frontier AI Expands Open-Source and Robotics
05
AI Research·3d ago
Game2Player Scales Visual Agent Training with Co-Developed Game Environments
Daily Digest

Get top AI & tech signals delivered to your inbox every morning.

Subscribe →
Follow Signals
X / TWITTERLINKEDININSTAGRAMYOUTUBETELEGRAM

THE PNEUMETRON

The publication of modern technology, AI, and infrastructure.

AI-assisted, human-reviewed.

NEWS CATEGORIES

  • AI RESEARCH
  • TECHNOLOGY
  • WORLD
  • BUSINESS
  • POLITICS
  • SCIENCE
  • HEALTH
  • SPORTS
  • ENTERTAINMENT

AI & RESEARCH

  • AI RESEARCH
  • INFRASTRUCTURE
  • TOOLS
  • DEEP DIVES
  • TECHNICAL DISPATCHES

RESOURCES

  • ABOUT US
  • CONTACT
  • CAREERS
  • ADVERTISE
Pneumetron.
© 2026 Pneumetron. AI-assisted, human-reviewed.
All rights reserved.
ABOUTTOOLSPRIVACYTERMSCONTACT