video_editing_poc/tools
JSLMPR 1da0661eea Automatic two-tier highlight director + source-adaptive rendering
Rendering (whole service, driven by source measurements, not constants):
- Orientation-aware geometry: FfmpegClipInspector reads display rotation and
  stores effective dims; HighlightFfmpegRenderer.outputGeometry renders portrait
  sources portrait and skips the 2.39 letterbox on portrait (landscape unchanged).
- Dynamic exposure: probeSourceLuma measures the frames; exposureNormalizationFilter
  maps the mean toward a target; the grade is now exposure-preserving (no crushed
  subjects: bowling final went ~63 -> ~100 mean luma).
- Motion-adaptive in-shot push-in (zoompan), amount from per-shot YDIF.
- Audio mix ducks source audio under the generated score so it leads.
- Highlight duration is no longer capped (validator + config).

Automatic director (plans were hand-authored before):
- Tier 1 HighlightMontageDirector: composes the montage from measured motion (YDIF)
  and audio-energy (RMS) curves -- setup, continuous action/tension, slow-mo payoff
  on the audio climax, resolution button, camera-whip tail trimmed.
- Tier 2 HighlightVisionDirector + tools/vision_caption.py: a local, offline
  vision-language model (moondream2) captions the payoff frame and augments the
  montage with a semantic overlay ("STRIKE") and scene-informed music; fails soft.
- Wired into the scheduler behind auto-director-enabled / vision-director-enabled
  (on in the localpoc profile).

Docs: cinematic-quality-rules.md (R1-R5, R9 both tiers), poc-plan milestones.
Tests: mvn -o verify -> 262 passing, 0 failures.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MPuJXQyAeWpFcTtcnxo1UN
2026-07-23 22:49:05 +02:00
..
local_asset_requirements.txt add asset generation 2026-07-21 10:03:27 +02:00
local_asset_worker.py Wire local generative audio models into the highlight asset worker 2026-07-21 23:00:57 +02:00
local_cv_requirements.txt Add runnable local CV model worker 2026-07-11 16:40:59 +02:00
local_cv_worker.py Add rich video editing diagnostics 2026-07-11 17:11:35 +02:00
provision_local_models.py Wire local generative audio models into the highlight asset worker 2026-07-21 23:00:57 +02:00
run_local_asset_worker.sh add asset generation 2026-07-21 10:03:27 +02:00
run_local_cv_worker.sh add asset generation 2026-07-21 10:03:27 +02:00
vision_caption.py Automatic two-tier highlight director + source-adaptive rendering 2026-07-23 22:49:05 +02:00