video_editing_poc/tools
JSLMPR cf8ec76430 fix(vision): Qwen2.5-VL llama.cpp backend — verified to break the moondream ceiling
Provisioned and tested the stronger Tier-2 judge on this Intel Mac (CPU-only):

- vision_caption_llamacpp.py: force CPU (-ngl 0 --no-mmproj-offload) because the
  integrated GPU times out on the vision encoder (Metal command-buffer timeout);
  extract the final assistant turn from the chat-templated output.
- docs/LOCAL-MODELS.md: the VERIFIED build+run recipe, incl. two real gotchas ->
  Command Line Tools libc++ mismatch (add -isystem <SDK>/usr/include/c++/v1 to the
  cmake flags, else ggml-base fails on <array>), and the Intel-GPU Metal timeout.

Verified result: where moondream described the bowling celebration as "standing in
a bowling alley", Qwen2.5-VL-3B says "raising their arms in a celebratory gesture"
(highlight-worthiness 1.0) and rates turn-around/anticipation low (0.2 / 0.15). End
to end, the director's judge now chooses time=10.5s score=1.0 (the celebration) vs
moondream's 13.0s score=0.15 (the turn-away). Model weights are gitignored under
models/ (Apache-2.0, provisioned offline).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-25 23:50:12 +02:00
..
beat_detect.py feat(cinematic): R10–R14 grade/cadence/edit rules + 420p compat fix 2026-07-25 12:36:18 +02:00
local_asset_requirements.txt add asset generation 2026-07-21 10:03:27 +02:00
local_asset_worker.py Wire local generative audio models into the highlight asset worker 2026-07-21 23:00:57 +02:00
local_cv_requirements.txt Add runnable local CV model worker 2026-07-11 16:40:59 +02:00
local_cv_worker.py Add rich video editing diagnostics 2026-07-11 17:11:35 +02:00
provision_local_models.py Wire local generative audio models into the highlight asset worker 2026-07-21 23:00:57 +02:00
run_local_asset_worker.sh add asset generation 2026-07-21 10:03:27 +02:00
run_local_cv_worker.sh add asset generation 2026-07-21 10:03:27 +02:00
subject_track.py feat(cinematic): R10–R14 grade/cadence/edit rules + 420p compat fix 2026-07-25 12:36:18 +02:00
vision_caption.py Automatic two-tier highlight director + source-adaptive rendering 2026-07-23 22:49:05 +02:00
vision_caption_llamacpp.py fix(vision): Qwen2.5-VL llama.cpp backend — verified to break the moondream ceiling 2026-07-25 23:50:12 +02:00