AIarXiv
Heuristic editor, no API keyVerdict: RoutineROWBench: Do Video Models Render What the Program Specifies?
Programmable world models separate executable dynamics from visual generation, offering a promising foundation for next-generation game engines.
VerdictCompetent work. Briefs at most.
Abstract
Programmable world models separate executable dynamics from visual generation, offering a promising foundation for next-generation game engines. However, their visual adherence to explicit rules and interactions remains insufficiently evaluated. Existing benchmarks assess visual quality, controllability, and instruction or physical adherence, but rarely test fidelity to fine-grained, program-specified world events. We introduce PROWBench, comprising 170 programmatically constructed episodes and 600 proxy videos covering diverse scenes and interactions. PROWBench logs entity states and timestamped events, including those outside the camera's field of view, as replayable world records, from which it renders synchronized views and proxy representations. This enables generated videos to be checked against the observable consequences of program execution. An extensible framework constructs scenes, controls behaviors, and can render each camera view in different representations, such as coarse 3D, and bounding boxes. The benchmark covers first- and third-person perspectives, with synchronized multi-view observations available for a subset of episodes. Grounded in these records, PROWBench evaluates entity control, long-horizon memory, and, with two VLM-based metrics, Logic-Render Alignment and Interaction Success Rate, adherence to the prescribed timeline and the visual realization of timestamped engine-recorded events.
The editor's rubric
| Dimension | Level | Weight | What that level means |
|---|---|---|---|
| Leverage | ███░░ 3 | 24% | A method or resource many groups across the field will adopt within a year. |
| Magnitude | ██░░░ 2 | 18% | Solid incremental gain on a meaningful problem. |
| Evidence | ██░░░ 2 | 14% | Limited: single setting, weak baselines, or an observational association presented as causal. |
| Novelty | ██░░░ 2 | 16% | A new combination of known ideas. |
| Trajectory | ██░░░ 2 | 18% | Some room to improve with obvious engineering. |
| Stakes | ██░░░ 2 | 10% | Benefits a professional community (practitioners, clinicians, engineers). |
Editor’s rationale
Heuristic triage from title and abstract text only, not a reading of the paper. Cues found: method (we propose); breadth (programmable).
How the score was computed
- Merit
- 3.7 / 10
- Adjusted merit
- 3.9 / 10
- Attention
- 82%
- Freshness
- 35%
- Citations0 (reference 15, via semantic-scholar, Oct 4, 2026, 02:05 UTC)
- Influential citations0 (reference 3, via semantic-scholar, Oct 4, 2026, 02:05 UTC)
- Hugging Face upvotes58 (reference 25, via hf-daily, Oct 4, 2026, 13:49 UTC)
- GitHub stars30 (reference 250, via hf-daily, Oct 4, 2026, 13:49 UTC)