Video from Frames

Generate smooth video transitions between two frames using Google DeepMind's Veo 3.1 model via fal.ai.

See references/fal-api.md for setup, Python patterns, and error handling.

API Endpoint

fal-ai/veo3.1/first-last-frame-to-video

Parameters

Required

• prompt (string): Text description of how the video should transition between frames
• first_frame_url (string): URL of the first/starting frame (use fal_client.upload_file() for local files)
• last_frame_url (string): URL of the last/ending frame (use fal_client.upload_file() for local files)

Optional

CLI Script

python3 scripts/fal_generate.py \
    --endpoint video-from-frames \
    --prompt "Smooth transition from day to night" \
    --first-frame morning.jpg \
    --last-frame night.jpg \
    --duration 8s \
    --video-resolution 1080p \
    --output video.mp4

Tips

• Ensure both frames have similar composition and framing for smooth transitions
• Describe the transition motion and action clearly in the prompt
• Works best when both frames share the same subject or scene from the same viewpoint
• Use longer duration (8s) for complex transitions with many intermediate states
• The AI interpolates plausible motion between the two frames
• Upload local files with fal_client.upload_file() before passing as frame URLs
• Shorter duration (4s) generates faster and works well for simple transitions