Nova3D

website · open studio · paper · datasets · discord · X · issues

A working farm, written by Nova3D from one prompt. Humanoids pick tomatoes, quadrupeds carry the harvest, drones scout. Simulated and filmed in MuJoCo.

Capabilities

1. Executable source: represent assets and environments as programs that can be inspected, edited, and rebuilt.
2. Parametric control: define dimensions, proportions, materials, physical properties, and motion through explicit parameters.
3. Controlled variation: specify which parameters change and which remain fixed across design alternatives or experiments.
4. Structural editing: change components, assemblies, layouts, clearances, and connections through their construction code.
5. Reusable construction: reuse components and generation logic to build related designs, asset families, and environments.
6. Programmable motion: define articulation, animation, interactive controls, and prescribed object trajectories.
7. Geometry and motion checks: inspect dimensions, part relationships, pivots, and collisions, using checks appropriate to the design.
8. Versioned development: preserve source, parameters, build outputs, and validation results as the project evolves.
9. Target-specific exports: compile designs for CAD tools, 3D applications, and robotics simulators through dedicated export paths.

For robotics

1. Controlled scenario generation: specify which geometric, physical, and temporal parameters change, and which remain fixed.
2. Structural variation: change connectivity, obstacle arrangement, clearances, and mechanism configurations, not just textures or initial positions.
3. Reproducible evaluation: preserve the environment source, parameters, simulator configuration, and experiment results.
4. Failure-driven generation: eventually turn a failed rollout into a family of nearby scenarios to investigate the failure boundary.

Datasets

Our releases include Nova3D-Bench (preview), the benchmark used in our paper, and 20 outdoor simulation environments reconstructed from Wanderland captures, with editable scene source, annotations, and native simulator exports.

Explore the datasets

Describe it. Build it. Keep going.

Start with an idea and keep shaping it. Change the geometry, add motion and behavior, and explore new versions.

A drill, an escalator and an oven, each built part by part: assembled, taken apart, and seen through to every piece inside.

gardener_bot
Animate his arm changing from the probe into the can, and make him water the plants.

shooting_star
Make this ring. → Turn it into a pair of matching earrings. → Make the earrings rose gold. → Change the earring shape into a rising-star climber.

harlequin_doll
Animate his head unzipping, and a bright glowing moon floating out of it.

Build it together.

People and AI agents work in the same world at the same time, each on their own branch. Then the branches merge into one world.

You: Build a cottage on the empty plot, with a glass tower.
v1 · 53 parts

Maya: I want to see inside. Open up the back.
v2 · 19 new parts inside

Sam: What does it look like in winter?
v3 · snow, bare trees, frozen pond

Sam: Now make it night.
v4 · 9 lamps and the fire lit

You: Merge Maya's open back with Sam's winter night.
v5 · no conflicts

Maya: Send the gardener bot in to water the plants.
v6 · in through the open back

worlds

Robots at work.

Every world below started as a text prompt, was generated as an executable scene program, compiled to MuJoCo, and populated with robots. Doors open on real hinges, produce carries labeled masses, floors carry measured friction. The environment is code, so every physical property is authored, not painted on.

Café · Unitree G1 waiters clear tables; a Go2 serves from its back (learned walking policy, full physics)

Mall · Spot patrols, H1 delivers parcels, Stretch restocks, a Skydio X2 flies the atrium

Farm · Apptronik Apollo picks tomatoes into a basket; ANYmal hauls the crate

Apartment · a G1 tidies a generated home, object by object

Orbital lab · a UR5e throws a sample across the module in zero g; a Franka Panda catches it in flight

Traction hall · one walking policy, three floors: ice μ 0.02, steel μ 0.30, rubber μ 1.05

Simulate. Test. Revise.

Run your designs in simulation to check movement, collisions, and interactions. Find what fails, revise the design, and test it again.

Test 1 · failed
Husky, pick the ripe apples off this tree.
The low limb stops it at 50 cm.

v2 · the low limb tied up 20°
Test 2 · failed: the arm snags on branches, 0 of 3 apples picked.

v3 · 6 branches pruned out of the arm's path
Test 3 · passed: 3 ripe apples in the bin, nothing knocked.

A Clearpath Husky with a UR10e arm and a Robotiq 2F-85 gripper, in an old orchard grown as code. Asked to adapt this tree for this robot and keep every apple, Nova revises the tree and tests again. Every move is the MuJoCo run: branches bend and spring back, stems snap only when pulled or lifted.

The real kitchen
The scene was built from 8 phone photos.

Test 1 · failed
Stretch, get the milk off the island.
It bumps the bar stool, 1.1 m short.

v2 · adapted for Stretch, design kept
Test 2 · passed: 4 things moved out of its path, milk in hand at 11 s.

physics

Physics, defined in source.

Mass, inertia, friction, and joint limits are explicit and editable alongside the geometry. Change the conditions and simulate the result. Below, the same scene runs with one parameter changed: gravity, from 0 to 9.81 m/s².

g = 0 · a Booster T1 pushes off the hatch with its legs and floats the length of the module, carried only by the momentum of that push

The ramp tilts slowly, and the blocks let go in order of grip: the ice block slides at just 4.6°, steel at 15°, aluminium at 20°, oak at 26°, and the rubber block holds on to the very end. Nobody animated any of this. Each block slips at exactly the angle where physics says its grip runs out.

Build on common ground.

Bring assets, scenes, and behavior together in one programmable project. Build from the same source for design tools, game engines, and simulators.

License

MIT © RareSense.

Built on the same engine powering FormaNova for specialized jewelry CAD.