Open4D research modules are independent systems and algorithms built on the stable core API. Each module ships with source code, configuration, and evaluation scripts — and evolves on its own release cadence.
A learned codec for dynamic mesh sequences. N4MC uses neural networks to exploit spatial and temporal redundancy in time-varying meshes, targeting significantly lower bitrates than per-frame static compression while preserving geometric fidelity across time.
Integrated into Open4D as a core compression submodule under open4d/core/N4MC.
Scene-level compression for dynamic 4D environments. Where object-centric codecs compress a single performer or asset, TSMC targets entire time-varying scene meshes — the kind produced by scene reconstruction in robotics, autonomous systems, and mixed-reality capture.
Encoder and decoder for time-varying meshes with changing connectivity and vertex counts — the hard case where classic dynamic-mesh codecs break down. TVMC exploits temporal redundancy across frames to reduce bitrate for streaming and storage.
A 4D mesh decoder plugin for Unity that decodes compressed mesh sequences and renders them in real time — including on standalone XR headsets such as the Meta Quest 3. This closes the loop from capture and compression to immersive playback on-device.
Deformation-aware temporal alignment based on as-rigid-as-possible (ARAP) volume tracking. Establishes correspondences across frames of a deforming mesh sequence, enabling temporally-consistent compression, editing, and analysis downstream.
Structured editing of dynamic geometry: make an edit once and have it propagate consistently across the whole time-varying sequence, instead of frame-by-frame manual fixes.
The core package ships with playback utilities for meshes, point clouds, and Draco-compressed
point clouds, plus conversion tools that create .o4d
sequences from raw frame data.
# convert raw frames into an .o4d sequence
python open4d/tools/create_o4d_mesh.py
python open4d/tools/create_o4d_pointcloud.py
python open4d/tools/create_o4d_draco_pointcloud.py
# play back sequences
python examples/play_mesh_o4d.py
python examples/play_poincloud_o4d.py
python examples/play_draco_pointcloud_o4d.pyOpen4D is designed so new research modules can evolve independently on top of the core API. We welcome new algorithms, codecs, and tools.