Jojocodex/minimax-h3-spatial-physics-lora
空间物理 LoRA · Spatial & Physics LoRA (MiniMax-H3)
空间思维与物理逻辑 LoRA,基于 MiniMax-H3(Comfy-Org/MiniMax-H3)训练,让模型学会纯物体的空间关系与物理运动(碰撞、堆叠、掉落、遮挡等)。
本 LoRA 专注物体物理。
目前还是训练和测试阶段,一些素材片段以及打标问题导致LORA还不是特别稳定。下一阶段准备修复后重新训练。目前LORA也是可以使用,强度建议0.3 ~ 0.5。纯属是在原模型基础上稍微增强一点物理反馈。 最新是重新训练到了wushuspatialphysicsclean3000_pruned.safetensors 版本。
视频对比
实测用了这个LORA,视频整体提升真实感物理的逻辑,比如物体碰撞的真实反馈。也可以用于一些打斗场景,人物真实碰撞的效果。
用了空间物理LORA的武打片段(强度 0.3)
<video src="https://cdn-uploads.huggingface.co/production/uploads/6a6748afef317ed5adb30050/f6BFLovWOi5kxKX96rrzs.mp4" controls width="40%"></video>
没有用空间物理LORA的武打片段(同样提示词)
<video src="https://cdn-uploads.huggingface.co/production/uploads/6a6748afef317ed5adb30050/AaCiljUOQUkzsOAdcMdsn.mp4" controls width="40%"></video>
其他测试视频 (wushuspatialphysicsv23000.safetensors)
<video src="https://cdn-uploads.huggingface.co/production/uploads/6a6748afef317ed5adb30050/iuQzNUb4YALFsDGilD4uI.mp4" controls width="40%"></video> <video src="https://cdn-uploads.huggingface.co/production/uploads/6a6748afef317ed5adb30050/cWdxixHdowNF690Zo-1Bd.mp4" controls width="40%"></video> <video src="https://cdn-uploads.huggingface.co/production/uploads/6a6748afef317ed5adb30050/II8HI8f7TIPjJmILXL8XD.mp4" controls width="40%"></video> <video src="https://cdn-uploads.huggingface.co/production/uploads/6a6748afef317ed5adb30050/qLpKJouZtbgoT-Y764PWt.mp4" controls width="40%"></video> <video src="https://cdn-uploads.huggingface.co/production/uploads/6a6748afef317ed5adb30050/gMSayhbcjLSvAvI2wMl0d.mp4" controls width="40%"></video> <video src="https://cdn-uploads.huggingface.co/production/uploads/6a6748afef317ed5adb30050/qqyzWY6v0yqqW0x2FspGC.mp4" controls width="40%"></video>
使用方法(ComfyUI)
- 下载
*.safetensors,放入 ComfyUImodels/loras/ - LoraLoader 加载,strength 建议 0.8~1.0
- 用空间/物理语言 prompt 描述物体运动
关键词库(从训练数据提炼)
① 主体/场景
several colored objects多个彩色物体(CLEVRER 风格)rigid objects刚体 /elastic objects弹性物体metal objects金属物体a ball/balls球billiard balls台球objects通用物体on a table桌面上(PhyCo 台球场景)in a synthetic scene合成场景(CLEVRER 风格)
② 物理行为
collision/colliding碰撞a single collision between objects单次碰撞bouncing/rebound弹跳/回弹with visible impact and bounce可见撞击与反弹with minimal bounce小幅度回弹rolling into a wall滚向墙scattering散射 / 四散momentum transfer动量传递in motion运动中的
③ 空间一致性短语(关键!)
clear spatial layout清晰的空间布局visible depth可见的纵深consistent trajectories一致的轨迹gravity-consistent/gravity-consistent movement重力一致的运动gravity-consistent rebound trajectories重力一致的回弹轨迹objects maintaining spatial relationships物体保持空间关系realistic restitution真实的恢复系数(回弹性)rigid collision with momentum transfer带动量传递的刚性碰撞
负面提示词建议
训练时 neg 为空(模型未学负向),建议只加画质/物理负向,不要加与物理矛盾的内容:
blurry, distorted, low quality, jittery motion, objects passing through each other, objects floating without gravity, morphing shapes, inconsistent lighting, flickering提示词示例(可直接使用)
碰撞类
several colored objects, a single collision between objects, metal objects with rigid, elastic collisions, clear spatial layout, visible depth, objects maintaining spatial relationships in a synthetic sceneseveral colored objects, objects colliding with visible impact and bounce, clear spatial layout, gravity-consistent trajectoriesobjects colliding with visible impact and bounce, clear spatial layout, gravity-consistent trajectories
弹跳/回弹类
Elastic objects bouncing with realistic restitution, clear spatial layout, gravity-consistent rebound trajectoriesobjects bouncing with realistic restitution, clear spatial layout, gravity-consistent rebounda ball rolling into a wall and rebounding with minimal bounce, clear spatial layout, visible depth, rigid collision with momentum transfer
多物体散射/台球类
billiard balls colliding and scattering on a table, momentum transfer between balls, clear spatial layout, visible depthseveral balls on a table, a ball striking the group, momentum transfer, balls scattering with realistic collision, clear spatial layout, gravity-consistent
轨迹/无碰撞类
Rigid objects in motion with clear spatial layout, consistent trajectories, gravity-consistent movement and visible depthseveral colored objects, objects moving with consistent trajectories, no collision, clear spatial layout, visible depth, objects maintaining spatial relationships in a synthetic scene
自由发挥模板(替换行为词)
a ball thrown across the scene, [parabolic arc / gravity-consistent trajectory], clear spatial layout, visible depthtwo balls colliding in mid-air, clear spatial layout, consistent trajectories, gravity-consistent rebound, visible depth
## 加速适配
与 MiniMax-H3 Turbo 加速 LoRA 兼容,可叠加使用。
## 训练信息
- 框架:ai-toolkit · Rank 16 · 分辨率 512 · 90 帧 @ 24fps
