A depth map
A depth map gives every pixel a number for its distance from the camera. These passes come from Video Depth Anything Small (the vits checkpoint, input 518), recorded as depth_model in each clip's analysis.json. It predicts relative inverse depth: bigger means closer, and the scale only holds inside the shot. Metric depth models try to answer in metres, which matters when matching a CG camera or measuring a set, but on a fight they are usually less stable.
The trap is temporal flicker. Normalise each frame on its own and the background breathes. So the range is fixed per shot: the 1st and 99th percentile across the whole shot map to black and white, and that mapping holds until the next cut. A cut resets it, because a new camera means a new range.
A skeleton
YOLO11m-pose finds the 17 COCO joints on each person, from nose and ears to wrists and ankles, each with a confidence. ByteTrack keeps an id on a body within a shot by box overlap and motion, and starts over at every cut. Joining ids across a cut is a separate step: a SAM mask vote in clip 1, trunk colour clustering in clip 3 (both recorded under pose_tracking).
Raw joints jitter, so a One Euro filter smooths slow motion hard and fast motion lightly, which keeps a punch sharp instead of mushy. Occlusion is the honest limit: a hidden wrist drops below confidence 0.3 and is left out, not guessed. Side-on bodies swap left and right; a crossing test put back 33, 28 and 68 swapped pairs in the three clips.
How Peter uses them
As control maps. In ControlNet style and motion transfer workflows (Wan VACE, Animate style pose driving) the pose and depth sequences are the actual conditioning input: the skeleton locks the choreography, the depth locks the staging, the model paints the look.
As a Seedance reference. Seedance does not take control maps. It takes a reference video for motion and camera, so the source take (or a clean render of it) goes in as the reference and the prompt carries the new look. The pose pass is then the check that the beat survived.
In comp. The Composite layer is depth fog, a far plane softened as a cheap depth of field, and a warm lift on the near plane as a stand-in for a relight. The near plane plus the pose box is a fast start for a rotoscope mask.
In QA and continuity. Limb speed in body heights per second shows if a hand stops on the beat or sails through. Depth order shows real foreground and background staging. Ids, scale and depth order per shot catch a fighter who swaps sides or jumps in size across a cut.