Alaya Lab research

MASS: Multiplayer World Models with Authoritative Shared State

One shared world, rendered from any view.

MASS is a multiplayer world model that advances one authoritative typed state, then synthesizes any requested client view from that shared prediction.

Ziqi Cai · Siqi Yang · Yimu Wang · Zixian Gao · Yunheng Liu · Shuchen Weng · Erwin Wu · Kaipeng Zhang · Boxin Shi

Scroll to explore
1 authoritative state 1,024 simulated players 10,000 recurrent ticks camera-conditioned views learned RGB rendering typed world dynamics

01 / Why MASS

Visual memory breaks down in multiplayer worlds.

Visual world models often use each observed view as recurrent memory. In multiplayer settings, that means maintaining separate visual histories for the same world, and those histories can drift apart across cameras.

MASS separates world dynamics from view synthesis. Its Logic Engine predicts the complete typed state from joint actions. The Rendering Engine uses that state and a client camera to generate the requested observation.

Every client shares the same synchronization reference. The simulation cost stays fixed as more views are requested.

MASS system overview The Logic Engine advances one typed state. Rendering Engines synthesize requested client views from that shared prediction.

02 / System

Predict the state once, then render the requested views.

Select a stage to see what information it receives and produces.

03 / Across worlds

The same architecture runs
across eight game worlds.

MASS produces state-conditioned renders for Snake, Crate Pusher, Pac-Man, Tank Battle, Lunar Touchdown, Frogger, Tron, and Bomberman. Each column shows a different game, and each row shows a different predicted state.

Cross-game system overview

Each game uses the same Logic Engine and Rendering Engine architecture with its own schema and weights.

04 / Evidence

Shared state keeps multiplayer views consistent.

0.76

State recovery

On matched multiplayer Snake, MASS reaches 0.76 state recovery. The strongest video-based baseline reaches 0.128.

1,024

Simulated players

MASS advances 1,024 players together in one predicted world backed by a single authoritative state.

10,000

Recurrent ticks

The long-horizon test runs the recurrent model for 10,000 ticks. It is separate from the matched-accuracy benchmark.

Matched visual evidence

Compare the same held-out episode at the same rollout tick.

Drag the divider to compare MASS with a retrained official MultiWorld baseline. Both images use the same viewpoint and action sequence. In this example, MASS stays closer to the canonical scene structure while MultiWorld drifts.

This is one representative qualitative episode, not a test-set average.

MultiWorld baseline output at the matched rollout tick MultiWorld
MASS output at the matched rollout tick MASS

05 / Results

Counterfactual control and long-horizon execution.

The first test branches one predicted world with three action streams. The second follows a recurrent rollout for 10,000 ticks.

Counterfactual controlAction study

Three futures from the same initial state.

MASS runs the recorded joint-action stream, its reverse, and a constant action from the same Crate Pusher state. The crate positions differ by tick 64.

The left grid shows client views; the right panel compares crate positions at tick 64.
Execution scale10,000 ticks

Following one rollout for 10,000 ticks.

The test tracks Crate Pusher snapshots, entity counts, and single-GPU Logic Engine latency.

This execution-scale test is separate from matched rollout accuracy.

Publication

MASS: Multiplayer World Models with Authoritative Shared State

MASS predicts the shared game state before rendering any player view. That state carries the rollout forward and keeps clients synchronized. Each camera is rendered from it only when needed.

Download PDF

AuthorsZiqi Cai, Siqi Yang, Yimu Wang, Zixian Gao, Yunheng Liu, Shuchen Weng, Erwin Wu, Kaipeng Zhang, Boxin Shi

AffiliationsAlaya Lab · Peking University · Institute of Science Tokyo

ProjectWorld models · multiplayer simulation · learned rendering

MASS result

BibTeX copied