Principle:Google deepmind Mujoco Scene Update
| Knowledge Sources | |
|---|---|
| Domains | Visualization, 3D_Graphics |
| Last Updated | 2026-02-15 06:00 GMT |
Overview
Process of converting the current simulation state into an abstract 3D scene representation for rendering.
Description
Scene Update transforms the physics simulation state (body positions, joint angles, contact points) stored in mjData into the abstract mjvScene geometry list. This includes computing world-frame positions for all visual geometries, generating contact force visualizations, adding perturbation arrows, updating flex/skin deformations, and sorting geometries for correct transparency rendering. The scene update is independent of the rendering backend.
Usage
Call this principle in the render loop after each simulation step (or at the desired visualization frame rate) and before rendering. The camera, options, and perturbation state control what is included in the scene.
Theoretical Basis
Scene construction involves:
- Body transforms: Map local geom positions to world frame using body transforms from mjData
- Category filtering: Apply catmask to select which geom categories to include
- Decoration: Add visualization aids (contact forces, constraint forces, frames, labels)
- Transparency sorting: Sort geoms by depth for correct alpha blending
- Deformation update: Update flex vertices and skin mesh deformations