Fine-Tuning Open Video Generators for Cinematic Scene Synthesis: A Small-Data Pipeline with LoRA and Wan2.1 I2V

Reading time: 2 minute
...

📝 Original Info

  • Title: Fine-Tuning Open Video Generators for Cinematic Scene Synthesis: A Small-Data Pipeline with LoRA and Wan2.1 I2V
  • ArXiv ID: 2510.27364
  • Date: 2025-10-31
  • Authors: ** 정보 없음 (논문에 저자 정보가 제공되지 않음) **

📝 Abstract

We present a practical pipeline for fine-tuning open-source video diffusion transformers to synthesize cinematic scenes for television and film production from small datasets. The proposed two-stage process decouples visual style learning from motion generation. In the first stage, Low-Rank Adaptation (LoRA) modules are integrated into the cross-attention layers of the Wan2.1 I2V-14B model to adapt its visual representations using a compact dataset of short clips from Ay Yapim's historical television film El Turco. This enables efficient domain transfer within hours on a single GPU. In the second stage, the fine-tuned model produces stylistically consistent keyframes that preserve costume, lighting, and color grading, which are then temporally expanded into coherent 720p sequences through the model's video decoder. We further apply lightweight parallelization and sequence partitioning strategies to accelerate inference without quality degradation. Quantitative and qualitative evaluations using FVD, CLIP-SIM, and LPIPS metrics, supported by a small expert user study, demonstrate measurable improvements in cinematic fidelity and temporal stability over the base model. The complete training and inference pipeline is released to support reproducibility and adaptation across cinematic domains.

💡 Deep Analysis

Figure 1

📄 Full Content

📸 Image Gallery

1.1.jpeg 1.2.jpeg 1.3.jpeg 2.1.jpeg 2.2.jpeg 2.3.jpeg 2.4.jpeg 4.1.jpeg 4.2.jpeg 4.3.jpeg 5.1.jpeg 5.2.jpeg 5.3.jpeg 6.1.jpeg 6.2.jpeg 6.3.jpeg 7.1.jpeg 7.2.jpeg 7.3.jpeg 8.1.jpeg 8.2.jpeg 8.3.jpeg

Reference

This content is AI-processed based on open access ArXiv data.

Start searching

Enter keywords to search articles

↑↓
ESC
⌘K Shortcut