User Guide

AI Clips — Turn Long Videos into Shorts, Automatically (VIP)

Local speech recognition transcribes your footage, an LLM picks the strongest moments, and VidFabs batch-renders captioned vertical clips — hands-free.

AI Clips is VidFabs’ flagship VIP feature. Feed it one or many long videos (podcasts, streams, lectures, gameplay commentary) and it produces ready-to-post short clips with burned-in captions.

AI Clips overview

How it works

Each video moves through a fully visible pipeline:

  1. Queued — videos wait their turn; queue up to 20 at once.
  2. Downloading AI model — first run only: the speech-recognition model is fetched once and cached locally, with a progress bar.
  3. Transcribing — a Whisper-family model converts speech to timed text entirely on your machine. Your audio never leaves the device.
  4. Selecting highlights — the transcript is sent to your configured LLM, which scores and picks up to 10 highlights per video.
  5. Rendering — each highlight is cut, reframed, and rendered with captions.

Cancel any task (or everything) at any point; finished items can be cleared in one click.

Reviewing results

Select a finished video to browse its highlights: preview each clip, read its captions, and open the output folder.

Clip results

Setup (one time)

AI Clips needs two things, both configured in Settings → AI:

  • Speech model — pick a recognition model; larger models are more accurate. VIP includes the highest-accuracy model. Downloads happen in-app with progress and can be cancelled.
  • LLM API — an OpenAI-compatible API key of your own. Provider presets, custom Base URL (Azure, local server, proxy) and model name are all configurable. The key is stored locally and used only for AI Clips.

AI settings

Output framing

Choose how clips fill the frame (Settings → AI → Output framing):

  • Portrait 9:16 — crop: fills a vertical frame, ideal for Shorts/TikTok/Reels.
  • Portrait 9:16 — fit: keeps the whole picture, blurs the padding.
  • Original 16:9 — fit: classic landscape output.

Privacy

Transcription is 100% local. The only data sent off-device is the text transcript to the LLM endpoint you configured — never the video or audio itself.

Availability

AI Clips is VIP-only. On the free tier the page shows what the feature does and offers the upgrade; the full flow unlocks the moment a license is activated.