Pinokio
FeedApps
Download Pinokio
Sign inCreate accountJoin
Sign inCreate accountJoin

Post

Conversation

Hy-Nomas World Model Support in WanGP

cocktailpeanut@cocktailpeanut·2hEdited

WanGP has added support for Hy-Nomas, a world model from Tencent:

https://hy-nomas.hy.tencent.com/

You can generate the world using:

  1. WASD control
  2. Natural language prompt

Here's an example where I pressed "D" (move right), and then entered "The fox climbs up the tree":

Getting it to work

It's kind of hidden, you have to click the earth icon to open the world model view, which will display the Hy-Nomas option.

The default prompt is already filled out so you can start out by simply clicking "generate" to generate the initial world.

Once generated, you should be able to click "Explore" to explore the world, which loads the generated world (this takes some time to initialize)

Should work REALTIME on 24GB+ VRAM

Of course, the most important part: Does this work on my PC? I think if you have at least 24GB VRAM it should work in realtime.

Should work on low VRAM (8GB+ VRAM) but not realtime

But if you don't have 24GB VRAM? The model still runs with as low as 8GB VRAM, but the generation itself is probably not going to be realtime.

Does it matter if not realtime?

So why bother? If it's not realtime, isn't it just a glorified video generation model with shorter generation time? Not quite.

1. It’s a closed loop, not a single prompt. A video model takes one prompt and returns a finished clip, and you can’t step in halfway through. A world model generates a chunk, takes your next input (camera move, "fox climbs the tree"), then generates the next chunk from everything so far. That's what the page means by "Multi-turn Prompt Control" and "Interleaved Text + Camera Control". Running slowly turns it into a turn-based game instead of a real-time one, but it’s still interactive, and you can branch: same world, different action, different outcome.

2. The world persists. The "Consistent World Memory" claim is important. If you pan away from a building and come back, it should still be the same building. Normal video models drift or forget after a few seconds, which is why they top out at roughly 5–10s clips. Keeping a world consistent for up to 60 seconds of free camera movement implies the model has learned something like 3D structure and object permanence, not just plausible-looking pixels.

Why it matters even when it is slow

  • Long, controllable video: If you just want a minute-long shot where the camera moves through a coherent space, a world model is the better video tool, even offline.
  • Training and evaluating agents and robots" Simulators don't need to run in real time. They need to respond to actions and stay consistent, which is exactly what this adds.
  • Previz and game prototyping: You can walk through a scene before anyone builds it in 3D.
  • Speed tends to improve: Realtime is mostly an inference-optimization problem (distillation, fewer steps, quantization). Stable Diffusion went from minutes per image to real-time on consumer GPUs in under two years, and the capability arrived before the speed did. Not to mention there are already models like Overworld that demonstrates realtime is already possible:

https://pinokio.co/apps/github-com-cocktailpeanut-overworld-pinokio

Basically, it's not fair to call these "video model with faster generation". It's more like a video model trained to respond to your actions and remember the world it has generated.

Speed decides whether it feels like a game, but the action conditioning and memory are what make it useful. Just need to go faster.

Anyway, definitely worth trying out!

Wan2GPpinokiofactory/wan
#guide
Loading conversation…

Replies

Post context

App used

Wan2GPpinokiofactory/wan

1-click WanGP Launcher. Super Optimized Gradio UI for AI video creation for GPU poor machines (6GB+ VRAM). Supports Wan 2.1/2.2, Qwen, Hunyuan Vide...

View app

Published by

@cocktailpeanut2h ago
#guide
Pinokio
PrivacyTerms
FeedApps

Post context

App used

Wan2GPpinokiofactory/wan

1-click WanGP Launcher. Super Optimized Gradio UI for AI video creation for GPU poor machines (6GB+ VRAM). Supports Wan 2.1/2.2, Qwen, Hunyuan Vide...

View app

Published by

@cocktailpeanut2h ago
#guide

Related posts

Comfyui: open in SAM detector cannot be found while right click on load image@nicopin · 21d agoWhy YUE2 // GROOVE keeps YuE2's reference configuration — and what "16 GB" really means@bearbone · 1mo agoMaestro: [ERROR] 404 Client Error. (Request ID: Root=1-6ad1c0e5-46ff4cfa508859e21d7042a6;b2eb4908-2f2f-4…@jatt · 10d ago