SalmanMKC

Open PR Google XR Blocks · addon

Session Replay — record real XR input, replay it on desktop

An opt-in addon that records a real XR session — head and controller poses, selection state and all 25 hand joints per side — into plain JSON, then replays the same camera, controllers, hands and select events in the desktop simulator. It turns captured headset interaction into repeatable simulator input for demos and debugging, with no changes to XR Blocks core.

Playback targets the desktop simulator and reproduces recorded input rather than the app clock.

Open PR Google XR Blocks · sample

Phone Companion — use your phone as an XR controller and keyboard

A phone companion flow for XR Blocks that pairs by four-character code or optional QR token. Once connected, the phone becomes a pointer/controller for moving the XR cursor, dragging and tapping, and provides native mobile keyboard input for headset text fields. It includes reconnect/recovery and secure session handling, and has been validated on Quest 3 with an Android phone.

Open work. Validated on Quest 3 with an Android phone; a device retest of the latest security follow-ups is still pending.

Solo or shared Google XR Blocks · addon

Roomcraft — author a whole virtual place together by describing it

An opt-in XR Blocks addon that turns a prompt into editable 3D content, composing catalog assets with procedural primitive-part designs. Scenes are refined in place through text, Gemini voice or direct manipulation — alone, or with several people at once. A four-letter room code opens the same scene across headsets, phones and laptops, sharing authoring, dragging, selection, presence and peer voice kept separate from Gemini, with animation running from a common timeline so late arrivals catch up. Optional virtual worlds add ground, sky, lighting, ponds, paths and seeded plants; characters and creatures can be added and set moving, objects can take bounded swing or spin animation, and the whole scene supports selection, undo/redo and JSON export. It composes and edits a scene graph — not text-to-mesh generation, and not generated JavaScript.

Runs anywhere XR Blocks does, including the desktop simulator — not a headset-only app.

Google XR Blocks · addon

AgentHands — speech-synchronised gestures and room-aware pointing

Translucent posable hands and a glowing orb that gesture while an AI agent speaks. Inline gesture markup in the reply is synchronised to real text-to-speech word boundaries, and the agent points at objects in the room, grounded through depth. A scripted demonstration runs with no API key; add one for live Gemini conversation. Gestures are driven by browser speech, with a simpler vocabulary and coarser point grounding than the paper.

Based on AgentHands (Liu et al., CHI 2026), implemented as reusable three.js / WebXR components for XR Blocks.

Google XR Blocks · addon

Persistent Spatial Anchors — content that stays put

Capability-aware WebXR anchors that keep content tied to a physical location across sessions. On Meta Quest the platform handles real anchor persistence, so markers are restored on the next visit; elsewhere the addon falls back to session-only anchors, and the desktop simulator keeps the same demo working without a headset. The same API covers dropped markers, an anchored gallery and anchored notes.

Google XR Blocks · networking

Multiplayer — shared mixed reality across devices

Multiplayer networking for XR Blocks, enabling shared mixed-reality experiences across devices: proximity voice, shared chat, shared objects that can move, RPC actions, presence and three transport protocols. It works across networks and custom servers as well as locally between devices — Meta Quest, Android XR, mobile and PC.