arXiv · virtual production· Fatemeh Zargarbashi·精选AI 评分58
Two2Four:用普通人动作驱动四足动物动画的生成式框架
Two2Four: Generative Quadruped Puppeteering from Human Motion
AI 导读
论文提出 Two2Four 自动人转四足操控框架,可从普通人动作数据生成可信且可控的四足运动。方法采用仅用四足运动数据训练的两阶段生成扩散模型,结合结构化条件与 inpainting 策略,支持走、跑、跳、坐、卧等动作,并可细粒度控制头部与单条肢体。实验称其运动真实感与可控性优于现有重定向方法,面向动画与虚拟制作应用。
推荐理由
论文提出纯用四足动物动作数据训练的两阶段扩散模型,把普通人动作转成可控的四足动画,为虚拟制作中的动物运动提供了一条数据驱动路径。
正文 · 原文
Abstract:Realistic animal motion for virtual production is typically obtained either through motion capture of highly trained performers who accurately mimic animal behavior, or by retargeting ordinary human motion using complex control setups. Both approaches are challenging and often fail to fully reproduce the nuances of natural animal motion, motivating data-driven alternatives. We present an automatic human-to-quadruped puppeteering framework that produces plausible and controllable quadruped motions from ordinary human motion data. Our approach employs a two-stage generative diffusion model trained purely on quadruped motion data. By introducing a structured conditioning and inpainting strategy, our method supports a wide range of actions, including walking, running, jumping, sitting, and lying. Furthermore, we enable fine-grained intuitive control of the quadruped motion such as head movement control and individual limb puppeteering. Experimental results demonstrate improved motion realism and controllability compared to existing retargeting approaches, highlighting the effectiveness of our framework as a tool for animation and virtual production applications.
| Subjects: | Graphics (cs.GR); Machine Learning (cs.LG) |
| Cite as: | arXiv:2607.26108 [cs.GR] |
| (or arXiv:2607.26108v1 [cs.GR] for this version) | |
| https://doi.org/10.48550/arXiv.2607.26108 arXiv-issued DOI via DataCite |
|
| Related DOI: | https://doi.org/10.1111/cgf.70565
DOI(s) linking to related resources |
Submission history
From: Fatemeh Zargarbashi [view email]
[v1]
Tue, 28 Jul 2026 13:23:10 UTC (17,816 KB)
来源:arXiv · virtual production · arxiv.org