videosense-agent

agent
Guvenlik Denetimi
Gecti
Health Gecti
  • License — License: NOASSERTION
  • Description — Repository has a description
  • Active repo — Last push 0 days ago
  • Community trust — 33 GitHub stars
Code Gecti
  • Code scan — Scanned 12 files during light audit, no dangerous patterns found
Permissions Gecti
  • Permissions — No dangerous permissions requested

Bu listing icin henuz AI raporu yok.

SUMMARY

Ask your video library anything — an AI agent that watches, reasons in a tool-use loop, and answers with playable clips and charts.

README.md
VideoSense — ask your video library anything; it answers with proof



Python FastAPI Gemini 2.5 Postgres + pgvector Cloud Run BigQuery

It watches your videos, reasons about what it sees, and answers with the clip and the chart to prove it.

▶ Try it live — videosense.work

English · 简体中文


A replayed VideoSense session: the question 'which clips show only freefall' is typed, the agent streams its tool steps — including a self-repair — then answers '3 of 12' with three real, labelled skydiving clips and a quiet Steps footer.

A real session, replayed — the question is typed, the agent streams its tool steps (one self-repair included), then answers with three real clips from the library.  ▶ Play the interactive demo

The answer — and what it cost

Ask in plain language; get the conclusion first, the clips that prove it, and the numbers behind the claim. Every reply carries its receipts in a quiet footer: steps, tools, seconds — and dollars.

A finished VideoSense answer: '3 of 12 clips are pure freefall', three labelled clip cards with timecodes, a freefall-vs-canopy mini chart, and a footer reading Steps 12 · sql ×2 · watch ×3 · 8.4s · $0.0535 · 92k tok

How it answers

The VideoSense agent loop: a Gemini 2.5 brain decides, calls a tool, reads the result, and repeats until proven — surrounded by its tools: watch a video, query the facts, semantic search, show clips and tables, draw a chart, run code. Guardrails: read-only SQL, ids scrubbed, every request metered.

No pre-baked pipeline: the model picks every next move and keeps going until it can prove an answer, streaming each step back live. When a library went missing mid-analysis, it rewrote its own code and finished the job — see that run.

Run it in 30 seconds

export GCP_PROJECT="your-gcp-project"
export REPL_USE_MOCK_DB=1
uvicorn api.server:app --port 8000        # then open http://localhost:8000

No database, no cost — a built-in sample library. You only need gcloud auth application-default login for Gemini.


Built to be trusted

Every change ships through a 370-task automated evaluation — deterministic verifiers (no LLM judge), honesty and safety tasks pinned as must-pass, and answers that refuse to bluff: if the library doesn't have what you asked for, VideoSense says so instead of showing the nearest lookalike. Prompt changes are validated by an evolutionary loop with statistical gates before a human ever reviews them.

License & commercial use

VideoSense is source-available under the Elastic License 2.0: you're free to read, run, and modify the code — but you may not offer it (or a derivative) as a hosted or managed service. For commercial licensing, get in touch.


Built by Kenny Qiu  ·  see also SocialLens, a social-video insights demo  ·  简体中文

Yorumlar (0)

Sonuc bulunamadi