AutoShorts

AutoShorts is a powerful tool designed to effortlessly transform lengthy gameplay footage into engaging, vertical short clips suitable for platforms like TikTok, Instagram Reels, and YouTube Shorts. Leveraging AI-driven scene analysis and GPU-accelerated rendering, AutoShorts detects high-energy moments—whether they are action-packed sequences, unexpected failures, or memorable highlights—and processes them into consumable content with minimal manual effort.

Key Features

AI-Powered Scene Analysis

AutoShorts intelligently analyzes video content using multiple AI providers, including OpenAI and Google Gemini, to classify scenes. It offers the following modes for semantic analysis:

• Action: Emphasizes combat and intense moments.
• Funny: Identifies humorous clips and fail compilations.
• Highlight: Captures notable achievements and impressive plays.
• Mixed: Automatically determines the most engaging category for each scene.

Subtitle Generation

Enhance videos with subtitles using:

• Speech Mode: Utilizing OpenAI Whisper for accurate transcription.
• AI Captions Mode: Contextual captions generated for gameplay without voice.
• Custom Styles: Choose from several styles including gaming, dramatic, funny, or minimal.
• Dynamic Templates: Integrate visuals like hype, retro-gaming, and more through PyCaps to make the content visually appealing with suggested semantic tags and emoji enhancements.

AI Voiceover with ChatterBox TTS

Include high-quality voiceovers without relying on cloud services:

• Generate voices locally with customizable emotional tones and exaggeration levels.
• Support for over 20 languages, facilitating a broader audience reach.
• Optional voice cloning based on user-provided audio samples.
• Smart Mixing technology ensures that game audio is naturally balanced with the voiceover.

GPU-Accelerated Workflow

The processing pipeline is optimized for speed and efficiency:

• Scene Detection: Utilizes a custom GPU-based implementation for quick analysis.
• Video and Audio Processing: High-performance operations powered by decord and torchaudio.
• Image Manipulation: Uses GPU-accelerated libraries for real-time effects and transformations.
• Fast Rendering: Integrates with NVENC technology for swift output creation.

Versatile Video Processing

• Automatically ranks scenes by engagement scores and adjusts video aspect ratios, primarily set to 9:16 for optimal viewing on vertical platforms.
• Implements smart cropping techniques that maintain focus on critical action while allowing for background effects.

Reliable Fallback Systems

AutoShorts includes robust fallback methods ensuring reliability even if key components encounter failures:

• Video encoding defaults to CPU if GPU resources are unavailable,
• Subtitle generation has secondary options to ensure continuity in production amid errors.

Usage and Expected Output

1. Place the original gameplay videos in the designated directory.
2. Run the processing script to begin video conversion.
3. The resulting clips, along with subtitle data and rendering logs, will be organized in a structured output folder, making it easy to access each generated clip for sharing or further editing.

By combining advanced machine learning techniques with user-friendly features, AutoShorts significantly streamlines the content creation process for gamers and content creators alike, making it easier to capitalize on trending moments in gameplay footage.