GenXR-Bench: Benchmarking Coding Agents for Interactive XR Development

By Huang, Li, Chen +13Oct 21, 2026

Score████░░░░░░4.1

Key numbers

96.5% accuracy against blinded expert
50.9% overall Pass

Caveats

Preprint; not yet peer reviewed.

VerdictWorth a reader's time today.

Read the original PDF Code

Abstract

Coding agents are rapidly advancing from single-file generation to long-horizon repository-scale engineering, yet the evaluation of their capabilities to author interactive extended reality (XR) applications remains an open challenge. Unlike traditional software, XR applications operate within dynamic 3D physical environments where runtime robustness depends jointly on continuous user motion, spatial input, and environmental sensing. We introduce GenXR-Bench, the first benchmark for the end-to-end evaluation of coding agents in XR software development. GenXR-Bench contains 112 expert-authored tasks spanning 24 feature implementations, 21 bug repairs, and 67 application generation tasks. Held-out tests combine scripted and adaptive interactions with programmatic and visual assertions to evaluate core functionality and runtime behavior. GenXR-Bench's testing suite achieves 96.5% accuracy against blinded expert judgments of 124 candidate applications executed on consumer XR hardware. Evaluating 10 models on GenXR-Bench, we find that the strongest configuration achieves only 50.9% overall Pass@1. Failure analysis identifies recurring misunderstandings in asynchronous sensor lifecycles, physical grounding, and embodied interaction semantics. GenXR-Bench establishes a reproducible testbed for evaluating coding agents in the interactive and physically situated conditions of spatial computing.

William Huang, David Li, Xiang 'Anthony' Chen, Xun Qian, Nels Numan, Zhongyi Zhou, Hyunsung Cho, Salman Muin Kayser Chishti, Ding Xia, Xincheng Huang, Jiahao Ren, Faraz Faruqi, Tianyu Xu, Yang Zhang, David Kim, Ruofei Du

The editor's rubric

Heuristic review

Leverage4 / 5: A general-purpose tool used across several fields (Adam, ResNet, LoRA, next-generation sequencing).; 24% of this desk’s rubric
Magnitude2 / 5: Solid incremental gain on a meaningful problem.; 18% of this desk’s rubric
Evidence4 / 5: Strong: large scale, preregistered, independently replicated, or a well-powered randomized trial.; 14% of this desk’s rubric
Novelty3 / 5: A genuinely new approach to an open problem.; 16% of this desk’s rubric
Trajectory3 / 5: A clear path to scale.; 18% of this desk’s rubric
Stakes2 / 5: Benefits a professional community (practitioners, clinicians, engineers).; 10% of this desk’s rubric

Dimension	Level	Weight	What that level means
Leverage	████░ 4	24%	A general-purpose tool used across several fields (Adam, ResNet, LoRA, next-generation sequencing).
Magnitude	██░░░ 2	18%	Solid incremental gain on a meaningful problem.
Evidence	████░ 4	14%	Strong: large scale, preregistered, independently replicated, or a well-powered randomized trial.
Novelty	███░░ 3	16%	A genuinely new approach to an open problem.
Trajectory	███░░ 3	18%	A clear path to scale.
Stakes	██░░░ 2	10%	Benefits a professional community (practitioners, clinicians, engineers).

Editor’s rationale

Heuristic triage from title and abstract text only, not a reading of the paper. Cues found: method (we propose, we report); breadth (many tasks); novelty (open problem); design (blinded); verification (multiple benchmarks, held-out test, independent replication); scale (scalable); stakes (general AI).

How the score was computed

rank-2026-10-18

Score████░░░░░░4.1

Score = 10 × (65% × adjusted merit / 10 + 25% × attention + 10% × freshness)

Desks place stronger verdicts first, then use this score to order work within the same verdict.

Merit: 6.2 / 10; Weighted rubric, evidence-gated.
Adjusted merit: 5.1 / 10; Shrunk toward the desk prior by editor confidence (50%).
Attention: 0%; Citations, upvotes, points, mentions.
Freshness: 75%; Half-life decay since publication.

No attention signals recorded yet.

The record

Reviewed by heuristic-v7 on Oct 22, 2026, 01:55 UTC. Paper type: method.
Categories: cs.AI, cs.GR, cs.HC
BRIEF, No.4 in the Artificial Intelligence edition of October 22, 2026.