---
title: SmolVLM2 Video Highlights
emoji: 🎬
colorFrom: blue
colorTo: purple
sdk: docker
pinned: false
license: apache-2.0
app_port: 7860
---

# 🎬 SmolVLM2 HuggingFace Segment-Based Video Highlights API

**Generate intelligent video highlights using HuggingFace's segment-based approach**

This is a FastAPI service that uses HuggingFace's proven segment-based classification method with SmolVLM2-256M-Video-Instruct for reliable, consistent highlight generation.

## 🚀 Features

- **Segment-Based Analysis**: Processes videos in fixed 5-second segments for consistent AI classification
- **Dual Criteria Generation**: Creates two different highlight criteria sets and selects the most selective one
- **SmolVLM2-256M-Video-Instruct**: Faster processing with specialized video understanding
- **Visual Effects**: Optional fade transitions between segments for professional-quality output
- **REST API**: Upload videos and download processed highlights with job tracking
- **Background Processing**: Non-blocking video processing with real-time status updates

## 🔗 API Endpoints

- `POST /upload-video` - Upload video for processing
- `GET /job-status/{job_id}` - Check processing status
- `GET /download/{filename}` - Download generated highlights
- `GET /docs` - Interactive API documentation

## 📱 Usage

### Via API
```bash
# Upload video with optional parameters
curl -X POST \
  -F "video=@your_video.mp4" \
  -F "segment_length=5.0" \
  -F "model_name=HuggingFaceTB/SmolVLM2-256M-Video-Instruct" \
  -F "with_effects=true" \
  https://your-space-url.hf.space/upload-video

# Check processing status
curl https://your-space-url.hf.space/job-status/YOUR_JOB_ID

# Download highlights and analysis
curl -O https://your-space-url.hf.space/download/HIGHLIGHTS.mp4
curl -O https://your-space-url.hf.space/download/ANALYSIS.json
```

### Via Android App
Use the provided Android client code to integrate with your mobile app.

## ⚙️ Configuration

Default settings:
- **Segment Length**: 5 seconds (fixed segments for consistent classification)
- **Model**: SmolVLM2-256M-Video-Instruct (faster processing)
- **Effects**: Enabled (fade transitions between segments)
- **Dual Criteria**: Two prompt variations for robust selection

## 🛠️ Technology Stack

- **SmolVLM2-256M-Video-Instruct**: Efficient vision-language model optimized for video understanding
- **HuggingFace Transformers**: Latest transformer models and inference
- **FastAPI**: Modern web framework for APIs
- **FFmpeg**: Video processing with advanced filter support
- **PyTorch**: Deep learning framework with device optimization

## 🎯 Perfect For

- Social media content creators
- Educational video processing
- Meeting/lecture summarization
- Sports highlight generation
- Entertainment content curation

## �� License

Apache 2.0 - Free for commercial and personal use

## 🤝 Contributing

Built with ❤️ using Hugging Face Transformers and open-source AI models.