Multimodal AI video analysis

An AI video analyzer that shows its evidence.

VideoLens analyzes what is said, what appears on screen, and when it happens. Give it a local video or a supported link, ask a question, and get a structured report with citations to specific moments.

Updated 2026-07-18 · Open source · MIT licensed · Bring your own OpenAI API key
Transcript + frame vision + OCR
Timestamp citations
~1,500 supported platforms
Markdown, PDF, and JSON
The direct answer

What VideoLens does

Most AI video tools rely mainly on a transcript. That misses silent interactions, interface state, diagrams, error messages, and other visual evidence. VideoLens combines transcript segments with sampled-frame descriptions and on-screen text recognition before it writes the report.

The result is useful for both review and automation: a human-readable explanation, timestamped findings, recommendations, and machine-readable JSON that an AI agent can consume.

Why it helps

From linear video to reviewable evidence

Multimodal context

Combines speech, visual changes, OCR, scene type, and your prompt in a time-windowed timeline.

Verifiable findings

Important claims cite timestamps so reviewers can jump back to the source instead of trusting a generic summary.

Reusable analysis

Extraction is cached. Ask follow-up questions or switch analysis goals without processing the entire video again.

Workflow

How the analysis works

Every stage is explicit and cached so the source can be checked and the analysis can be reused.

Add a local file or a supported video URL.
Choose an analysis mode and describe what you need to learn.
VideoLens transcribes audio, samples frames, reads visible text, and builds a timestamped timeline.
Review the evidence-grounded report, ask follow-up questions, or export Markdown, PDF, or JSON.
Output

What the report gives you

  • Concise video summary
  • Timestamped findings and evidence
  • Recommendations and next actions
  • Markdown, PDF, and structured JSON exports
Important limitation: VideoLens samples frames rather than interpreting every frame of a video. Results depend on source accessibility, audio and image quality, sampling settings, and the clarity of the question. DRM-protected players and live streams are not supported.
FAQ

Common questions

Can AI actually understand what is visible in the video?

VideoLens sends sampled frames to a vision-capable model, records visual descriptions and on-screen text, and merges that evidence with the transcript. It can therefore reason about more than spoken words, while still being limited by frame sampling.

Does VideoLens work with local video files?

Yes. Local files are supported by the CLI, web UI, and Chrome extension workflow. Remote sources are supported when the video can be accessed by the resolver or browser capture pipeline.

Can I ask more questions after the first report?

Yes. Follow-up questions reuse the cached timeline, making repeated analysis faster and typically much cheaper than extracting the video again.

Turn the next video into evidence.

Try the hosted app, self-host the MIT-licensed core, or connect VideoLens to an MCP client.