kabachuha/mh3-r2va-claymation-transformation

MH3 - Claymation Transformation V2 - R2VA

<Gallery />

Model description

This Minimax H3 Reference2Video LoRA aims to replicate the surreal, handcrafted look of plasticine&#x2F;claymation animations, where objects morph into others with fluidity. Heavily inspired by the classic cartoon &quot;Last Year&#39;s Snow was Falling&quot; (LYS). (although the likeliness is obviously not 100% because of MH3&#39;s training rigidness)

Trained for 159 epochs (> 14 hours) using a musubi-tuner fork by AkaneTendo. Special thanks for the implementation of the stop-flag file as it allowed me to save the model at the minimum loss of a very unstable train. Training techniques: ostris de-distill adapter, CFG loss, base preservation loss, spatial jitter.

Example prompt:

LYS-style transformation video. <Subject 1> realistic cup of coffee is shown on a table. Suddenly, the realistic cup of coffee plasticine-transforms into a realistic parrot.

The two necessary trigger words are: &quot;LYS-style&quot;, &quot;plasticine-transforms&quot;&#x2F;&quot;plasticine-melts&quot;.

This model is trained in reference2video-audio_omni mode and is very versatile!

Workflow json is among the files.

Trigger words

You should use LYS-style to trigger the video generation and plasticine-transforms/plasticine-melts to describe the actions.

Download model

Download them in the Files & versions tab.