Pinokio
FeedAppsRemoteCreate
Download Pinokio
Sign inCreate accountJoin
Sign inCreate accountJoin

Post

Conversation
cocktailpeanut@cocktailpeanut·1mo ago

Interesting approach to generate a persistent world.

Instead of just generating and displaying everything in realtime, it separates what the world is, from what the world looks like. An LLM tracks objects and state externally, while the video model renders them. New objects discovered in generated frames get added back into that state, so they can be interacted with later and changes can persist even after the camera looks away.

None of the pieces are individually new. But it packages them in a single workflow where persistent interactive worlds are built by giving video models an external world state than by asking one model to handle appearance, memory, and interaction all at once.

The problem is, this is yet another empty github repo:

Code is still under preparation. All code will be available later.

But the idea itself is simple enough that anyone could probably ask an agent to implement this. Bookmarking so I can revisit when they do release code, or if someone takes a stab at implementing this on their own.

Oneiramadaoer/oneira
Loading conversation…

Replies

Post context

App used

Oneiramadaoer/oneira

Contribute to Madaoer/Oneira development by creating an account on GitHub.

View app

Published by

@cocktailpeanut1mo ago
Pinokio
PrivacyTerms
FeedAppsCreateRemote

Post context

App used

Oneiramadaoer/oneira

Contribute to Madaoer/Oneira development by creating an account on GitHub.

View app

Published by

@cocktailpeanut1mo ago

Related posts

Comfyui: open in SAM detector cannot be found while right click on load image@nicopin · 1mo agoTRELLIS.2: LINK : fatal error LNK1181: cannot open input file 'cudart.lib'@muhammad_hassain_gajjala · 2mo agoOverworld: RuntimeError: PassManager::run failed@mesutmamuk · 2mo ago