Timeline Studio — A local first browser based AI video…

Pitch

Description

Comments

About this project

Timeline Studio offers a unique browser-based video editing experience with powerful AI tools. It features multilingual voiceovers, automatic captions, and intelligent editing capabilities, all while maintaining a local-first approach to ensure privacy and performance. Effortlessly create engaging videos with this innovative platform.

Timeline Studio is an innovative local-first AI video editor designed to operate seamlessly within a browser environment. It offers a versatile multi-track timeline akin to CapCut, integrated with advanced AI features such as voiceovers, automatic captions, vision tools, and dynamic talking avatars to create high-quality video content. With deterministic offline export capabilities, users can polish their projects without relying on cloud services.

Key Features

Multilingual Voiceovers: Supports a variety of languages including Chinese, English, German, Spanish, French, Italian, and Brazilian Portuguese through advanced voice synthesis.
Automatic Captions: Automatically generate precise captions using Whisper ONNX with enhanced timing and language recognition.
Smart Framing: Employs cutting-edge subject detection and portrait matting technology for intelligent cropping and background removal.
AI Vocal Separation: Isolate vocals while placing instrumental tracks without leaving the browser interface.
Digital Human Generation: Leverage audio-to-motion rendering techniques for realistic talking avatars in videos.
Local-First Inference: Entirely local processing ensures privacy as no project media is uploaded to external servers.

Editing and Exporting

User-friendly editing interface featuring a primary visuals track alongside timed overlays.
Comprehensive editing tools for canvas manipulation, proportions, resizing, rotating, masking, applying filters, animations, speed control, and keyframe adjustments.
Offers independent tracks for captions, stickers, voiceovers, and music to streamline your editing process.
Advanced project management functionalities like snapping, alignment guides, clip menus, undo/redo, and portable .timeline files.
Exports using WebCodecs for MP4/WebM formats, ensuring high-fidelity mixing of audio, captions, and overlays.
Installable as a Progressive Web App (PWA) for a responsive experience with a cached application shell and multilingual user interface.

Agent Skill

In addition, the repository features edit-timeline-studio, a Codex-compatible Skill that aids in planning and executing video edits. This includes:

Inspecting media and preserving the editing brief.
Describing reversible edits with stable identifiers.
Operating the editor from the browser with validation capabilities.

Getting Started

To begin using Timeline Studio, Node.js version 20+ and a modern Chromium browser are recommended. Follow the provided setup instructions to get up and running quickly.