AI video references

AI Video References: Choose Action, Camera Moves and Simple 3D Clips

A film contains many shots. Each may need a different action or camera move. A clip you saved earlier could be useful again. You can also plan a shot with simple 3D models and export it as a video reference. This is called 3D previs.

Start with what you want to control, then look for a suitable clip. ShotMind helps you split videos into shots on Mac, choose what to analyze, and search analyzed footage by description. Preview a candidate before preparing it for your generation tool.

For Apple silicon Macs running macOS 14 or later.

How do you choose an action reference video?

Play the whole clip to inspect how the action starts, develops and ends. These AI-generated clay-style reference clips play when you press the player controls.

Two cars taking a hairpin turn

Check the turning direction, driving paths and which car leads.

Two-person staff fight

Watch the order of attacks, weapon contact and any occlusion.

Hero landing and standing up

Check the landing pose, hand and foot contact, and the transition to standing.

Dance turn into a side lunge

Watch the turn direction, supporting foot and finishing pose.

These clips illustrate what to inspect. Check your tool’s input requirements before using them: character motion controls may not support cars or two-person interactions.

How do clay renders and depth videos differ?

A clay render uses simple models to show movement, layout and camera motion. AI can produce a similar look without an editable 3D project. Depth video represents distance from the camera; lighting and shadows on a gray surface are not depth. Name the versions separately and keep a record of their source.

Official guides to video references and motion control

After choosing a reference, prepare the input using your platform’s instructions. These links lead to each platform’s own guide.

What do you want the reference to control?

A clip carries several kinds of information. Decide which one matters for this shot.

Swipe sideways to see the full table

What do you want the reference to control?
What you want to carry overReference to look forWhat to inspect
Performance or action timingA continuous performance, gesture or body movementThe whole action is shown, and hands and feet are easy to see
Camera movement and framingFilmed camera movement or a simple 3D previs clipCamera position relative to the subject, direction, start and end frames
Layout and movement pathsA video made from simple 3D models, often called a clay render or graybox previewYou can see where objects are and how they and the camera move
Appearance, lighting or moodA reference image or representative shotWhether you need the look, color or light rather than the action

Use this table to choose a clip, then check what your tool supports. A character image may show what someone looks like, while a motion video shows how they move.

How do video-to-video and motion references differ?

Video-to-video broadly describes generating or changing imagery from an existing video. Motion reference workflows focus on borrowing performance or movement, often alongside a separate character input. Tools may provide separate entry points for these tasks.

Runway Act-Two, for example, uses a performance video alongside a character image or video. What you can control depends on which type of character file you choose. Runway documentation

Before trimming a clip, check where the tool asks you to upload it.

How can 3D previs help you plan movement and camera shots?

A simple 3D scene lets you plan where objects go and how the camera moves before adding detail. Blocks can stand in for a table and product while a camera passes alongside them. Export the scene as video to inspect when the product enters the frame and where it ends up.

Seedance 2.5 describes using simple 3D videos without surface detail to guide object placement, poses, movement and camera angles. Complex movements may still differ from the reference. Seedance introduction

Whether you build the scene yourself or ask an AI tool to help, review the exported video for camera placement, movement and timing. Organize those videos in ShotMind and keep the 3D project files in your modeling software. These simple videos have fewer visual details, so try searching your own footage to see what works. You can also browse and play clips to choose one.

How do you use saved footage as an AI video reference?

Suppose you want AI to generate a person reaching for a cup, with a natural hand movement. You can find a similar action in a video you have saved, trim that clip, and use it in a tool that accepts motion references.

  1. Import your saved video into ShotMind. Use footage you own or may manage. ShotMind detects shots; you choose which ones to analyze. If the footage is already analyzed, go straight to search.
  2. Search for the action you need. For example, type “a person reaches for a cup on a table” to look for possible matches in analyzed shots.
  3. Play the clip and check the whole action. Look for the reach, grip and lift, and check whether the hand is hidden. A similar-looking frame is not enough; watch the movement from start to finish.
  4. Trim the reference in your video editor. Open the original video in your usual editor, keep the action you need, and match the generation tool's duration and aspect-ratio requirements.
  5. Upload it in your generation tool. Choose a feature that accepts motion references. Upload the trimmed video and add the character image, text or other material that tool requires, then generate. You find footage in ShotMind and generate the new video on the chosen platform.
  6. Save the reference and result. Note which result used which reference in your own folders or spreadsheet, so you can find it again when you need a similar action.

How do you search for video references by description?

Describe the image you want to find. These example phrases give you a starting point; change the person, action or setting to suit your search.

  • Action: a person reaches for an object on a table, with a clear hand movement.
  • Camera: the camera passes beside a subject, gradually revealing the space behind it.
  • Mood: a cool industrial setting, strong side light, restrained movement.
  • Composition: a small person in a wide environment with plenty of negative space.

A result may match only part of your description. Play it before choosing it, especially if you need a particular camera direction or a complete action. Learn how to organize and search video references

Which videos does ShotMind upload?

Full videos stay on your Mac. Only the shots you choose to analyze are sent to the cloud. The results and preview images are saved on your Mac for later browsing and search. Searching and browsing analyzed content use no credits, called Points. Analyzing new shots uses Points.

ShotMind helps manage and retrieve references. Generation, character settings and platform parameters remain in your generation tool.

Frequently asked questions

Can one reference image control a full action?

Check how the tool defines that input. An image can communicate appearance or composition, but you should not assume it supplies a complete action sequence. For performance or camera movement, check for the corresponding video reference feature.

Does ShotMind generate AI videos?

No. Use it to find, preview and reuse existing shots, then take prepared media to your generation tool.

Can it search videos I previously watched online?

First save videos you own or are authorized to keep, then import the local files. ShotMind does not automatically read browser history or download social videos.

Will it find the exact same camera movement?

Exact matches are not guaranteed. Preview candidates to check direction, speed, obstructions and whether the action is complete.

Should I keep references and generated outputs?

You can keep both. Use folders or a separate spreadsheet to record their roles, projects and outcomes. See how to organize AI video tests.

Related guides

Try it with a video you know

Import a familiar video, analyze a few selected shots, then search for the kind of image your next project needs.